WEB Did fazle remove robots.txt?

Discussion in 'OT Technology' started by marcom10, Aug 19, 2009.

  1. marcom10

    marcom10 ...

    Joined:
    Jan 15, 2006
    Messages:
    4,096
    Likes Received:
    0
    Location:
    CT
    Offtopic is indexed in google. If I remember correctly it was never indexed?
     
  2. Die Antwoord

    Die Antwoord New Member

    Joined:
    Nov 5, 2007
    Messages:
    7,913
    Likes Received:
    0
    Location:
    Orlando, FL
    It's been in Google for a while.
     
  3. Browning

    Browning Active Member

    Joined:
    Feb 14, 2005
    Messages:
    89,465
    Likes Received:
    10
    404 Fazle
     
  4. marcom10

    marcom10 ...

    Joined:
    Jan 15, 2006
    Messages:
    4,096
    Likes Received:
    0
    Location:
    CT
  5. Tony Stark

    Tony Stark John McCain has an illegitimate mexican baby

    Joined:
    Jun 27, 2003
    Messages:
    40,060
    Likes Received:
    0
    Offtopic is now a business, by being indexed in Google he gets to sell more subscriptions to finance his F430 Scuderia
     
  6. Browning

    Browning Active Member

    Joined:
    Feb 14, 2005
    Messages:
    89,465
    Likes Received:
    10
    [​IMG]
     
  7. Audioholic

    Audioholic New Member

    Joined:
    Mar 12, 2009
    Messages:
    2,296
    Likes Received:
    0
    I always wondered why the main page to OT was so plain with no real optimization at all. I realize now the traffic just comes in droves but it still seems it could be better put to use.
     
  8. Insert Tokens

    Insert Tokens Making Cancer My Bitch OT Supporter

    Joined:
    Jan 12, 2006
    Messages:
    8,329
    Likes Received:
    76
    Location:
    Tasmania
    It made sense when the site was semi-hidden from the public (eg not showing up in google/search).. it was just a plain splash that didn't "invite" people.. but since Fazle's goal now seems to be to attract people (for obvious reasons), you'd definitely think there'd be more SEO on the front page.
     

Share This Page