Amazon Cloud

Discussion in 'OT Technology' started by Peyomp, Aug 19, 2008.

  1. Peyomp

    Peyomp New Member

    Joined:
    Jan 11, 2002
    Messages:
    14,017
    Likes Received:
    0
    I am really, really impressed with Amazon EC2/S3/Queue/SimpleDB. There have been a few issues of downtime lately, but basically I've written a web application using Perl/Catalyst/MySQL/Ubuntu (and sometimes Solaris) that needs to sale to 100K hits an hour or so, but will remain idle most of the time. In other words it needs to handle short term slashdottings.

    So, if I build out the infrastructure myself... I'll end up paying for server I am only going to use for a very small part of the time. On the other hand... EC2 is only $0.10-$0.30 an hour for a server. So at my slowest times, I'm only paying $72-$216 a month for a server... which is pretty trivial for a pay service.

    There are some other costs associated with data transfer, but for what I'm doing they don't amount to much.

    Basically, Amazon EC2 lets us:

    1) Use SimpleDB so that all new instances can access the model and I don't have to worry about scaling MySQL or another DB. Headache gone. Our app barely hits the DB, but what data is there does need to be shared by all instances.

    2) Use Amazon's queue to serve work. Right now I use an InnoDB table as a queue. Amazon's queue will do this for me, across many boxen. Another headache gone.

    3) Use S3 to serve media. Why not? Its the same price as EC2 for data xfer, xfer between EC2 and S3 is free, and if you put a cache of work you've done in SimpleDB then all instances can share S3 and not do the same work twice.

    4) Run one $0.30 an hour box all the time, and instantiate new boxes as load increases. Add then to round-robin DNS as they come up.

    This way the architecture is completely horizontal, and it all faces Amazon's cloud. So long as their cloud stays up... the app will scale to hell and back. For minimal cost.
     
  2. SLED

    SLED build an idiot proof device and someone else will

    Joined:
    Sep 20, 2001
    Messages:
    28,118
    Likes Received:
    0
    Location:
    AZ, like a bauce!
    good stuff. i have a couple of beta apps up on an EC2 instance, but i'm not completely sold on the SimpleDB though. I trust my dbms scaling over that from what I understand
     
  3. Peyomp

    Peyomp New Member

    Joined:
    Jan 11, 2002
    Messages:
    14,017
    Likes Received:
    0
    I agree and if our use of the DB wasn't trivial, I wouldn't even consider it. I've been told that 'Basically noone uses SimpleDB.' But since we're pretty light on the DB... its nice not to worry about a high available/high performance/scalable DB, huh? :) I was going to have to spend a lot of time on HA MySQL. The key is that all we really do that needs to be shared is log events, then count them later to make sure we don't repeat one kind of message too many times. Ideal use of SimpleDB.
     
  4. SLED

    SLED build an idiot proof device and someone else will

    Joined:
    Sep 20, 2001
    Messages:
    28,118
    Likes Received:
    0
    Location:
    AZ, like a bauce!
    :werd:

    The minute I need to start worrying about HA mysql or postgre, I'll probably be raking in enough $$$ from said app to afford it
     
  5. Peyomp

    Peyomp New Member

    Joined:
    Jan 11, 2002
    Messages:
    14,017
    Likes Received:
    0
    Well thats the bad part - I would have to build out an HA DB... and then we might not need it. Because I have to guarantee a certain amount of uptime and capacity, but its not automatic it will get used.

    So yeah, commodity HA distributed DB is the tits.
     

Share This Page