There's a rumor that goes around cloud circles about how Amazon.com created what is now the multi-billion dollar infrastructure as a service (IaaS) cloud computing industry in the early 2000s.
Some people wrongly assume that Amazon had spare, excess computing capacity from their ecommerce site that was used as the basis for Amazon Web Services' (AWS) cloud.
It's something that Benjamin Black has heard a lot. But it's not true. And he would know: Black is widely credited with co-authoring the initial proposal at Amazon that led to the creation of AWS.
"Why will that not die?" Black says about the rumor. "It's totally false."
Black, who recently accepted a new position at cloud company Pivotal, says from day one, every part of AWS has been purpose built for AWS. And now he's hoping to work on a new project that he says could be even bigger than the cloud he helped create at Amazon.
How AWS actually got started
In 2003 Black was running a website engineering team at Amazon. The company was growing fast and IT wasn't keeping up. Black worked with Chris Pinkham, who he says is one of the best managers he's ever worked with. Pinkham pushed Black to consider how Amazon's infrastructure could more efficiently scale up. They explored how abstraction and decoupling the applications from the infrastructure could make it easier to manage.
"We realized there could be a lot of value in doing that, and a lot of value to others potentially outside of Amazon," Black told Network World. "We could sell it (the infrastructure) as a service." Black and Pinkham wrote up the idea, which made its way to Jeff Bezos, who greenlighted the proposal. Pinkham then led a team to build Elastic Compute Cloud (EC2), which are virtual machines as a service and one of AWS's first products released in 2006.
That seed of an idea turned into what is now the market-leading IaaS public cloud computing company. Amazon was estimated last year by Gartner to have a public cloud that is five times larger than its next 14 competitors combined. Needless to say, the idea Black helped start took off. Pinkham went on to found startup Nimbula, which Oracle bought and used as the basis for its cloud platform. Pinkham now works as an engineering vice president at Twitter.
How did Bezos receive the idea? Black recalls Bezos envisioning a platform that would give anyone, such as college kids in a dorm room, the tools they would need to start a new company.
"That's still the idea people have about it," Black says. "At the same time, it's taking over the world." He says the fundamental key to AWS, which remains today, is that it provides the undifferentiated technical infrastructure to anyone who wants it whether that's VMs, storage, or Hadoop as a service.
Sign up for CIO Asia eNewsletters.