WEB grabing parts of webpages and displaying them?

Discussion in 'OT Technology' started by MSTRMOO, Sep 23, 2009.

  1. MSTRMOO

    MSTRMOO Active Member

    Joined:
    Jul 19, 2005
    Messages:
    36,312
    Likes Received:
    0
  2. White Stormy

    White Stormy Take that, subspace!

    Joined:
    Sep 17, 2002
    Messages:
    85,489
    Likes Received:
    70
    Location:
    Sparkopolis
    learn PHP, write PHP, execute PHP
     
  3. MSTRMOO

    MSTRMOO Active Member

    Joined:
    Jul 19, 2005
    Messages:
    36,312
    Likes Received:
    0
    also, if this is doable, is there any way to make it work automaticly on pages that require a login? (most of the sites that i need this to work on have a login with a cookie that expires within an hour or something)
     
  4. MSTRMOO

    MSTRMOO Active Member

    Joined:
    Jul 19, 2005
    Messages:
    36,312
    Likes Received:
    0
    point me in the right direction? ill figure out how to do it myself, but i dont even know where to start
     
  5. White Stormy

    White Stormy Take that, subspace!

    Joined:
    Sep 17, 2002
    Messages:
    85,489
    Likes Received:
    70
    Location:
    Sparkopolis
  6. MSTRMOO

    MSTRMOO Active Member

    Joined:
    Jul 19, 2005
    Messages:
    36,312
    Likes Received:
    0
  7. MSTRMOO

    MSTRMOO Active Member

    Joined:
    Jul 19, 2005
    Messages:
    36,312
    Likes Received:
    0
    shit.. how do i edit php options? "URL file-access is disabled in the server configuration"

    :o
     
  8. MSTRMOO

    MSTRMOO Active Member

    Joined:
    Jul 19, 2005
    Messages:
    36,312
    Likes Received:
    0
    i dont see a php.ini
     
  9. MSTRMOO

    MSTRMOO Active Member

    Joined:
    Jul 19, 2005
    Messages:
    36,312
    Likes Received:
    0
    got it
     
  10. LowClass

    LowClass New Member

    Joined:
    Sep 5, 2007
    Messages:
    890
    Likes Received:
    0
    Location:
    USA
    came to post this. API bro. request it, handle the XML
     
  11. SLED

    SLED build an idiot proof device and someone else will

    Joined:
    Sep 20, 2001
    Messages:
    28,118
    Likes Received:
    0
    Location:
    AZ, like a bauce!
    this. their api works great. screen scraping FTL. as soon as there is an update to amazon's html, your app will explode.
     
  12. MSTRMOO

    MSTRMOO Active Member

    Joined:
    Jul 19, 2005
    Messages:
    36,312
    Likes Received:
    0
    i was just using amazon as an example



    for the solution given.. the ip and host that gets left after grabbing the content is "74.208.138.230 - perfora.net" ... what gives? its good that its not my actual ip and host, and that no referer is passed.. but seems sort of random..
     

Share This Page