Amazon.com made $10 billion in fiscal 2006 selling items in 35 product categories to some 59 million registered users around the world. To do that, dozens of data centers must process millions of transactions and terabytes of data each day.
“We work as hard as we can to make the guts of Amazon invisible to consumers and sellers,” says Amazon chief executive officer Jeff Bezos, who delivered a keynote speech at Technology Review’s Emerging Technologies Conference on September 27.
Now, however, the company is bringing its invisible back-end operations front and center. In a series of initiatives launched over the last year, Amazon has begun to rent out parts of its IT infrastructure as Web services.
Startups in the social-networking or media-sharing arenas, for example, can use Amazon’s S3 database service to store their users’ photos and videos, rather than buying their own servers. In another service, the Elastic Compute Cloud, or EC2, business customers can offload computing-intensive tasks to temporary “virtual servers” at Amazon’s data centers. And last week, Amazon announced two additional services, Webstore by Amazon and Amazon Fulfillment, that allow outside companies to build their own commerce sites around Amazon’s software, then ship products using Amazon’s own warehousing and shipping network.
In essence, Amazon is finding ways to monetize the software and computing resources it has developed over the last 11 years to handle its own business. “There’s a big need at many companies for back-end infrastructure,” Bezos remarked. “The problem is server hosting, bandwidth management, and the like really have nothing to do with your actual business.” Amazon wants to use the Web services it’s developed to “help with some of that heavy lifting,” Bezos said.
Technology Review contributing editor Wade Roush followed up with Bezos after his speech.
Technology Review: In your keynote talk you spoke about the benefits of S3, EC2, and other Amazon Web services for small businesses that don’t want to invest in building data centers. But isn’t there a benefit in it for Amazon as well? You get to put the vast computing and storage capacity you’ve built around the world, which would otherwise go unused, to gainful employment. I imagine there are times when you’re using less than half of your capacity.
Jeff Bezos: There are times when we’re using less than 10 percent of capacity. And that is one of the advantages of doing things this way–it promises higher rates of hardware utilization. That’s a system-wide efficiency that should make everybody happy.
But our thought process for getting here was less about underutilization and more about our own developers–building tools to lower the “cost of coordination.” Web-scale applications are hard to run reliably at a small scale, and it doesn’t get easier as you go to larger scales. At Amazon’s scale, one of the issues is coordination between the application development team and the network infrastructure team inside the data center.
Say you’re a team leader at Amazon responsible for the personalization service, and you want to make some improvements. You have to plan a set of server deployments and coordinate that with the infrastructure team several weeks or months, or even as long as a year, in advance. The cost of that coordination can be very high.
The first Web services we did, about three years ago, exposed transactions and e-commerce data, things like our catalog of products. But, as we went on, it became clear that the more primitive services that we had really built for ourselves would be very appropriate for use by developers and other companies. All we had to do was add some billing functionality.
TR: You’re talking mainly about infrastructure services today, but as you just mentioned, Amazon’s first foray into Web services was creating interfaces so that outside developers or webmasters could access your databases, for example, to grab product data that they could then display on their own pages. What’s happening in that area?
JB: There’s a significant team of people who keep improving and extending those services, and that’s a very significant source of customers for Amazon.com. It ties into our associates program, so the people using these Web services earn a commission when they send us a customer who buys product. That continues apace. One of the latest things we announced, back on September 19, is WebStore by Amazon. [The program allows businesses, such as Seattle’s Gifts, to run their own branded e-commerce sites using Amazon’s back-end infrastructure. –TR] That continues to develop.