server stat issue

Discussion in 'OT Technology' started by Leb_CRX, Sep 8, 2005.

  1. Leb_CRX

    Leb_CRX OT's resident terrorist

    Joined:
    Apr 22, 2001
    Messages:
    39,994
    Likes Received:
    0
    Location:
    Ottawa, Canada
    I built this site for a client and put a custom404 page...works fine just redirects at 0 seconds, just takes the user and redirects them to the /...well we checked stats, and its' getting 10000 requests...the next is the / with 6000...how could the redirect get more requests then the actual page it redirects to...the index.html is getting 1000?!

    even if I add up the / and index...it still doesn't equal the custom404 page...
    I am assuming anyone requesting this page gets transfered no matter what as it's a 0 second meta redirect

    anyone have any ideas?
     
    Last edited: Sep 8, 2005
  2. Leb_CRX

    Leb_CRX OT's resident terrorist

    Joined:
    Apr 22, 2001
    Messages:
    39,994
    Likes Received:
    0
    Location:
    Ottawa, Canada
    I hope my posts makes sense, it's been a long day :o
     
  3. SLED

    SLED build an idiot proof device and someone else will

    Joined:
    Sep 20, 2001
    Messages:
    28,118
    Likes Received:
    0
    Location:
    AZ, like a bauce!
    probably spiders. They will get the 404 Not found page, but won't always follow the re-direct. Spiders are not web browser rich. They just parse content.
     
  4. Leb_CRX

    Leb_CRX OT's resident terrorist

    Joined:
    Apr 22, 2001
    Messages:
    39,994
    Likes Received:
    0
    Location:
    Ottawa, Canada
    makes sense, but from what I thought spiders never search for subpages that aren't linked anywhere...they follow links...is that wrong?

    I would understand if I had broken links in the page which is causing them to get the 404, but I don't...I am just wondering do spiders randomly add common keywords to the URL like /common_name.html and look for it?

    thanks for the reply man
     
  5. SLED

    SLED build an idiot proof device and someone else will

    Joined:
    Sep 20, 2001
    Messages:
    28,118
    Likes Received:
    0
    Location:
    AZ, like a bauce!
    that's a good question. I'm not sure how that works, or if they try to "mine" for data/pages on the site, based on content or whatever. They may also try to look for common things such as /images /pics or whatever. This would be interesting to know.
     
  6. Leb_CRX

    Leb_CRX OT's resident terrorist

    Joined:
    Apr 22, 2001
    Messages:
    39,994
    Likes Received:
    0
    Location:
    Ottawa, Canada
    k cool thanks :bigthumb:
     

Share This Page