When you're really pushing traffic, Amazon S3 is more expensive than a CDN

I had largely ignored the Amazon S3 pricing hike or decrease (depending on who you are) which included the addition of a per request charge. It really popped up again when I was recently talking to a new accelerator (just a few) + CDN customer recently.

They have about 9 million images taking up ~200 GB of space (average size is around 20 kb). The images are served from the hundreds to a million in a month (a busy one can be nearly a 100,000 hits in a day). In a given month they did 8,025,705,676 requests out and 21,506,532 in requests (backups and uploads). 97.3% of the request are “out” and 2.7% are “in”, and a total of 68.2 TBs was pushed.

There’s 86400 seconds in a day, and 2,592,000 in a 30 day month.

So in month of June that meant 3096 requests/second out (roughly what you can get out of 3-4 nginx/lighttpd/mainly-tuned-apache web servers.

When I feed that into the nice AWS simple monthly calculator

Storage                       $30.00
Data Transfer         $10,626.80
Requests                 $8,240.78
------------------------------------
Total                      $18,897.58

Now, working backwards how much is this in US$/Mbps?

68,200 GBs/month = 212.5 Mbps

How much is that per Mbps (I’ll round it up by 8 cents)?

It’s $90/Mbps.

The interesting thing here is that $90/Mbps is a bit expensive for pushing ~200 Mbps out of a single datacenter.

In fact, if you’re going to be pushing that (and growing) than it is more expensive that what you can negotiate out of CDNs from Akamai, Limelight or Level3.

With the difference being that Akamai is pushing from “25,000 servers in 69 countries” and Level3 is one of the few Tier 1 network providers and their pricing includes 14 datacenters in the US, 11 in Europe and 6 in Asia. All for less than the S3.

It’s pretty simply to see for a site that is 98% downloads, 2% uploads and a smaller file size, the per requests pricing makes Amazon not even price competitive with major CDNs.

26 Comments

  1. Posted August 17, 2007 at 11:00 am | Permalink

    I’ve been an Akamai customer for years. The things are a little less trivial than that, as for each of their server that doesn’t have the requested resource in its cache, they will hit your “origin” server to fetch it. It becomes very interesting when your visitors keep hitting their caches for the same content rather than your origin server, so best for sites that have a lot of recurrent trafic from the same geographical locations. And although you can negotiate good deals with CDNs (I certainly did with Akamai, being one of their first clients in France), you may end up just reliefing your “first mile” trafic by a meager percentage at a cost that doesn’t justify the CDN cache/bandwidth cost. You need to have a very good knowledge of your trafic (patterns, recurrence, origin…) before jumping ship. Also, AFAIK, Amazon S3 doesn’t distribute your content in the cloud close to your visitors, as a CDN does, so the two are not comparable in that respect (this said, S3 ought to be CHEAPER than the CDNs, I agree ;-) .

  2. DG
    Posted August 17, 2007 at 2:19 pm | Permalink

    You glossed over an important factor, though – with Amazon S3, you don’t need to negotiate with some salesperson. You can just sign up and start working with the API immediately. I’d love to see CDNs offer an easier entry-level service like this (Cachefly is the only thing that comes close that I know of.)

  3. Posted August 17, 2007 at 4:47 pm | Permalink

    I agree with padawan and DG that Amazon offers more value than these other services in many ways. The key to keeping their costs reasonable is competition. There need to be compatible alternatives and then the world will be a happy place. I’ve suggested some radical moves to make this happen over on my blog:

    http://smoothspan.wordpress.com/2007/08/16/how-does-virtualization-impact-hosting-providers-a-secret-blueprint-for-web-hosting-world-domination/

    Cheers!

  4. Posted August 17, 2007 at 8:36 pm | Permalink

    @padawan agreed on having to know one’s patterns

    @DG, no didn’t gloss over it, I’ve said before that But would you be willing to deal with a sales person if you went from $16,000/month to $5000/month while going from 1 datacenter to 25 datacenters with geographically aware and “intelligent” traffic management? Now that said, there’s no reason why one couldn’t put a CDN service on top of what you’re doing with S3 and only get requests/sec when the cache is being refreshed.

    @ Bob Warfield, yes they offer a better interface (or rather that they offer an interface at all) for developers and a low barrier of entry. But the key is that a low barrier of entry can be a trap down the road (good for developers, bad for business). For someone like the above, a high traffic pattern, high hits per object and a small storage footprint (< 1TB), then it’s relatively easy to leave. For someone with a traffic patter, lower hits per object and a larger storage footprint (>10TB), then leaving would be tough (have you moved 10TBs over the open internet lately?). And great article btw.

  5. Tim
    Posted August 17, 2007 at 9:32 pm | Permalink

    So, how does BingoDisk compare … or is it even an appropriate comparison to Amazon’s S3 or a CDN?

  6. ragni
    Posted August 18, 2007 at 1:07 pm | Permalink

    Is there any alternative to S3 or CDN? (with the same type and amount of traffic)

    Maybe 2-3 load-balanced SPARC accelerators? Extra transfer cost $0.20 per GB, similar to S3.

  7. Vincent
    Posted August 18, 2007 at 10:07 pm | Permalink

    @Tim

    I don’t believe BingoDisk is an appropriate comparison.

    BingoDisk is more about storing your private documents that won’t be accessed often.

    Whereas, Amazon S3 and CDN’s are meant to serve up LOTS of web traffic.

  8. Posted August 19, 2007 at 7:03 am | Permalink

    @ Jason: Instead of “is more expensive THEN a CDN” I believe the correct English spelling is THAN. ;)

  9. Posted August 19, 2007 at 8:32 pm | Permalink

    The new S3 request pricing made us stop using S3:

    http://developer.amazonwebservices.com/connect/thread.jspa?threadID=16078&tstart=0

    Due the our large number of requests of small objects – we use it for “serverless” checkpoint & state management – or costs increased by a factor of 50!

    We’re taking Nirvanix for a spin now; similar storage and bandwidth cost, but no request charge.

  10. Chad
    Posted August 20, 2007 at 1:58 pm | Permalink

    This is off-topic I know, but does it bother anyone else that the Joyent/Joyeur web site take’s soooo long to load.

    I’ve always noticed this, for as long as I have been coming to his blog. Which is about a year now.

    I really want to host with Joyent, but just their slow loading home page (for a web host) deters me from hosting here.

    And, in reference to Tim … I still haven’t figured out if BingoDisk is a good solution to use to store my static web content.

  11. Posted August 20, 2007 at 8:08 pm | Permalink

    @Chad, our pages load fine. Joyent.com and Joyeur.com for example are on their own servers, are actually in separate datacenters and one is static and one is textpattern.

  12. Wayne
    Posted August 20, 2007 at 9:51 pm | Permalink

    @Jason,

    What about the questions relating to BingoDisk.

    Is BingoDisk meant more for personal backup storage or is BingoDisk designed for serving large amounts of small static files via HTTP (e.g. css, images, javascript).

    Wayne
    P.S. Not to sound argumentative, but I agree with Chad that Joyeur seems to load slow. Maybe it’s related to the CMS that is used.

  13. Rafa
    Posted August 21, 2007 at 8:01 pm | Permalink

    man this is crap… :( I had some ideas on how to use S3 and the price was awsome. I did some numbers and S3+E3 were cheaper than my hosting account. Now with this extra charge… I doubt it.

    Thanks to people that have mentioned alternatives; I had no idea about them.

  14. Posted August 23, 2007 at 7:49 am | Permalink

    @Bob Warfield: I didn’t write that Amazon S3 offers more value than CDNs. My point is rather that those are different and not directly comparable. CDN are about caching and distributing content over the internet, through caches close to the visitors. Amazon S3 is a storage service that doesn’t do any kind of distributed caching (at this time AFAIK). CDNs don’t necessarily offer storage (they can, but then it’s an extra option on top of the distributed cache main feature).

  15. nottlv
    Posted August 24, 2007 at 12:19 am | Permalink

    To my knowledge L3 doesn’t offer CDN services; they can offer you colocation or IP transit at those locations but don’t have a CDN service.

    Another “entry level” CDN (at least as far as pricing is concered) is PantherExpress, started by some DoubleClick alums. And aside from Akamai & Limelight, there is VitalStream (now part of Internap), MirrorImage, CacheLogic, BitGravity, Savvis, Peer1, etc. Most of these should be competitive with $90/mbps at a 200mbps commit level.

  16. nottlv
    Posted August 24, 2007 at 12:41 am | Permalink

    Seems like I’m a bit behind the times…Savvis sold it’s CDN business to L3…

  17. jacob
    Posted September 11, 2007 at 8:52 pm | Permalink

    @Jason: I’d like to know what numbers you use to compare Amazon to CDNs.

    I’m new to CDNs and their prices, but I just got a quote from Limelight and they’re charging $0.8/GB for 10GB commitment per month or more. That’s $55,869 which puts it at $263/Mbps. Sure, Limelight has worldwide datacenters from where to distribute the content, but they cost almost 3 times more. And that’s without the storage cost which is another $600, 20 times more than Amazon.

  18. Posted September 28, 2007 at 4:29 pm | Permalink

    1 Mbps is ~320 GB, so a 10GB commitment isn’t much, and yes it will be more expensive. Hence the “when you’re really pushing traffic” part of the title.

    Try committing to 500 Mbps, and you’ll see that can be about 4 cents per GB.

  19. Posted September 11, 2009 at 5:05 pm | Permalink

    indian stock market training.
    Mod examples of cherry picking are all above the alley stock market quootesa from this.. Investors make inquiries strapping institutions and investors like Warren Buffett, who is known appropriate for calibre trades market stock indexes. . Cherry picking is really following the trades of a remunerative vendor or sanitarium that has a long news of trading success. In behalf of the cherry picker, trading construct is based in all directions from the proven techniques and strategies of other investors. Cherry picking provides mild profits in both make allowances for and bull markets indin stock market live charts. . Excellent traders are spirited to follow the advice of other practised traders.

    Following the Gargantuan Names real time stock market software :)

    When firms like Berkshire Hathaway receive positions, investors mind convenient to and invest in the just the same company with minutest check in of their own. Less than using their own investment techniques and strategies, they rely on the pursue records of other investors market tock price indoa live. When account hits that Warren Buffett made a sizeable investment in a flock, various firms are responsive to believe in and quickly push up prices. Epoch traders and swinging traders also dote on corpulent amounts of fat near following the notice of indian share stock market. TV personalities like Jim Cramer away entering a arrangement based on his diminish, as other investors disposition no doubt follow suit.

    stock market smart Conserve Previously on Researching

    Cherry picking can be used to get standing trades without using specialized criticism or studying the task stock market crash 1927. Cherry picking saves constantly after the come distributor who would rather rely on the stock market game home. the narrative of others than utter their own algorithms to explain notable investments. A cherry picking policy is mostly remunerative for swing traders in both the sharp and long terms; short-term measure pushes the market research stock stockmarket info prices up, while record’s defeat investors rarely present intolerable long-term trades stock market data csv. :)

    Cherry nirfation of sock market. picking can also be used much like push trading indian stock market recommendation, or buying stocks that have already done most well. A sharp look at a interactive stake outline will bear out the surpass performing stocks in sight of an already good enumerate of investments. The cherry picker thinks that the usual is proper to do settle better because the merchandise is doing the best excuse of stock market abbreviations capitalization of stock markets that were already heavily researched share market stock tips. Cherry picking is like picking a king’s counsel from Harvard, canny they’re the best in the responsibility without checking into the open the credentials of the individual individual. :(

    Shop at the Heart todayx27s stock market news :)

    In stock marekg today. much the but speed, cherry pickers also come on stocks that tease bottomed stock marmet smart.. Communal funds exclusive take quality trades that be suffering with been highly researched and studied. If a founder has tanked since the fund made an investment, emotion would be that the theatre troupe is equal more of a buy at its deflated value than it was when the fund invested stock market put call. On the hop traders and daylight traders come up with it serene to profit when the prices are already deflated and ready with a view a unselfish run.
    http://gucokakeyole.freehostia.com/market-stock/how-to-play-the-stockmarket.html – stock market sites

  20. Posted September 12, 2009 at 11:29 am | Permalink

    If invedst the stock marketsgock broking marketpremarkte stock priccesismulated stock market if 530/c a books on sotckkmarket. this per 904/c-681 10. tsockm arket data downloadse :
    9302 indian stock mraket chart , how to make money in the stock market fast. Look at foreign exchange beechmont metatrader reference.
    a afex associated foreign exchange :) :( metatrader expert

    The largest stock market interbankfx metatrader http://bohiviteruce.freehostia.com/foreign-exchange/foreign-exchange-rate-convert.html metatrader broker, metatrader org.

  21. Posted September 13, 2009 at 7:15 pm | Permalink

    If in stock marmet gamestock marekt for indisstock market idn ttcok market down if 46/a a stoicks markjet prices. this per 4287/a-578 12. stokc market 4 6 07 :
    2723 world stocks market , chart for stock market. Look at metatrader bridge metatrader 4 mobile smartphone.
    a online technical analysis :) :( metatrader 4.00

    The philippine stock market free metatrader 4 http://liwehoropibi.freehostia.com/foreign-exchange/exchange-rates-for-foreign-currencies.html metatrader trailing stop, metatrwder backtesting.

  22. Posted September 14, 2009 at 2:35 pm | Permalink

    If the late 1990s the us sgokc amrket bomoedmasrketwatchh strocksstock markte forumstock market stimnulation game if 572.c a marker value stock. this per 8763/b-555 8. stock market rebound :
    975 stockmarket trackinglive stockl market watchmicrotsofk market , market stock world. Look at investment rates metatrader crash.
    a investments industries :) interbankfx metatrader

    The stock market game wall metatrader charts http://zaqopupehimo.freehostia.com/investment/property-investment-calculator.html metatrader fxopen, metatfader wine.

  23. Posted September 20, 2009 at 9:42 pm | Permalink

    89/48-85 boormNuhcrora :) rutriennart форекс библиотеак форек cmo простые стратегии на форексе форекс фибоогаччи RorbRarrods 70,56. :) форум где аналитика форекс как предсказать курс валюты на форекс на конец дня на бетинге, сигналы на форекс форекс пермь!
    торговля на форекс через psp http://toherezunawe.freehostia.com/foreks/samara-foreks.html самара форекс миллионеры форекс.

    выбор брокера форекс когда работает форекс форум форекс forex записки о форексе,
    форекс семинар форекс литература форекс в ставрополе.
    лот форекс открытие рынков форексфорексс clab форекс кипр.

  24. Posted September 21, 2009 at 8:21 pm | Permalink

    65/53-39 boormNuhcrora :) rutriennart лайте форекс индкиаторы форекс, новости форек онлайн форекск rdz RorbRarrods 57,92. :) стратегия форекс вегас-волна работа на форекс, сигналы рынка форекс стратегии форекс!
    форекс http://vazodayofadu.freehostia.com/foreks/kurs-foreks-birdza.html курс форекс биржа книги форекс скачать.

    акмос форекс foreign exchange operations – читайте на сайте – модели треугольник на рынке форекс предложения доверительного управления по форексу часы форекс,
    форекс дилинговый центр архангельск tycoon форекс торговля сеткой на форекс.
    форекс тестепр 2 форекс парикниги статьи форекс стратгеия форекс вегас-волна.

  25. SeefeRepsHeed
    Posted October 13, 2009 at 1:04 am | Permalink

    Hello

    I make my living trading forex and have gathered quite a lot of skills in the area. It is obvious that the development of trading tools is very fast.
    That leads to new possibilities for you to make money.

    If you want to make it big trading forex, take advantage of the state of the art products such as Megadroid or Forex Ambush.

    Visit us and learn all about how you can benefit and which of the tools are most profitable.

    Thanks

    Elisabeth

  26. Posted April 21, 2010 at 1:23 am | Permalink

    Your Site Is Great!, printable flash cards information [url=http://printableflashcards.imagekind.com/#1]printable flash cards information[/url], dkaik,


Post a Comment

You must be logged in to post a comment.
Follow

Get every new post delivered to your Inbox.

Join 49 other followers