Light Reading
Google's Andromeda infrastructure is designed to provide bare-metal performance and low latency to customers worldwide.

Google's Andromeda Relieves Cloud Strain

Mitch Wagner
8/26/2014
50%
50%

MOUNTAIN VIEW, Calif. -- Hot Interconnects -- Google relies on its Andromeda networking platform to deliver a global cloud infrastructure that gives customers the security and performance benefits of local private networks.

"We want bare-metal performance and low latency for the services we deliver," said Google (Nasdaq: GOOG) Distinguished Engineer Amin Vahdat, delivering a keynote at the conference here today.

SDN is key to delivering the needed performance and security, he said.

SDN at its most fundamental involves separating the control plane from the data plane, Vahdat noted. "A logically centralized hierarchical control plane beats peer-to-peer every time," he said. The data plane can run at network speed, while the control plane can run on commodity hardware, scaling as needed. The control plane requires 1% of the overhead of the entire network, Vahdat said.

But managing that infrastructure requires new tools and skills, he said.

"It turns out that running a hundred or a thousand servers is a very difficult operation. You can't hire people out of college who know how to operate a hundred or a thousand servers," Vahdat said. Tools are often designed for homogeneous environments and individual systems. Human reaction time is too slow to deliver "five nines" of uptime, maintenance outages are unacceptable, and the network becomes a bottleneck and source of outages.

Google looks to SDN and network functions virtualization (NFV) to orchestrate provisioning, high availability, and meet application performance requirements, Vahdat said. The technology must be distributed throughout the network, which is only as strong as its weakest link.

Andromeda is Google's code-name for its network virtualization platform. It's designed to provide each external user with the illusion that they're on a dedicated network with dedicated performance and its own IP address space. Applications require real-time high performance and low-latency communications to virtual machines. Users also require service chaining to tools such as load-balancing, and the ability to grow and shrink the number of servers available to applications as demand requires. (See Google, Microsoft Challenge Service Providers and Google's Andromeda Strain Is Spreading.)

Security is a huge requirement. "Large companies are constantly under attack. It's not a question of whether you're under attack but how big is the attack," Vahdat said.

Power and cooling are the major costs of a global infrastructure like Google's. "That's true of even your laptop at home if you're running it 24/7. At Google scale, that's very apparent," Vahdat said.

Google has a global infrastructure, with data centers and points of presence worldwide to provide low-latency access to services locally, rather than requiring customers to access a single point.

The company runs two networks. Its private, server-to-server network is bigger than its public network, and one of the world's largest SDN deployments. Connectivity between data centers is comparable to within data centers.

Andromeda provides significant performance improvements over a state-of-the-art baseline, as seen in Vahdat's slides:

The promise of cloud computing is just beginning.


Find out more about key developments related to the systems and technologies deployed in data centers on Light Reading's data center infrastructure channel.


"Many people think about cloud computing as being able to get on-demand access to computing. I don't have to go buy servers; I can rent them for a minute, or an hour, or a day. I can get burst capacity of as many servers as I like, whatever memory, configuration or disk, etc., that I like. I think actually yes, this is powerful, but this is really just the beginning," Vahdat said. "The really exciting parts of cloud computing are on the verge of happening."

These include a fundamentally easier operational model; higher uptime; state-of-the-art infrastructure services such as denial-of-service protection, load balancing, and storage; and new programming models for low latency and massive input-output performance.

What cloud doesn't do is take away the challenges of running an IT infrastructure. "Most cloud customers, if you poll them, say the operational overhead of running on the cloud is as hard or harder today than running on your own infrastructure," Vahdat said.

Click the photo below for a selection of Vahdat's slides -- and more.

He's Hydrated
Google Distinguished Engineer Amin Vahdat
Google Distinguished Engineer Amin Vahdat

— Mitch Wagner, Circle me on Google+Follow me on TwitterVisit my LinkedIn profileFollow me on Facebook, West Coast Bureau Chief, Light Reading. Got a tip about SDN or NFV? Send it to wagner@lightreading.com.

(8)  | 
Comment  | 
Print  | 
Newest First  |  Oldest First  |  Threaded View
pcharles09
50%
50%
pcharles09,
User Rank: Light Beer
8/31/2014 | 10:40:01 PM
Re: What's the protocol?
@jabailo,

Wouldn't the packet alterations get messy though? In the TCP case , if somethings off just a little bit. Also, there'd have to be extra overhead for error checking right?
jabailo
50%
50%
jabailo,
User Rank: Light Sabre
8/27/2014 | 10:52:17 PM
Re: What's the protocol?
Like in a private network you can make assumptions that you can't make when shipping it out across the public Internet.

For example, I'm looking at this diagram:

http://www.freesoft.org/CIE/Course/Section4/8.htm

What about all that space for "source port" and "destination port".   Inside your own network, do you need to allocate that many bits?

Seems like for every bit you can reduce in a packet you get that much greater throughput.

 
pcharles09
50%
50%
pcharles09,
User Rank: Light Beer
8/27/2014 | 5:58:28 PM
Re: What's the protocol?
@jabailo,

Ahh ok I see. That's a good point.
kq4ym
50%
50%
kq4ym,
User Rank: Light Sabre
8/27/2014 | 9:45:56 AM
Androworld
Google certainly is going to lead the way in NFV/SDN services and of course the free PR they get for all announcements is not a bad thing for them either. Security is still going to be an ongoing problem and probably others are going to see their way to NFV and the cloud just to help solve that issue.
jabailo
50%
50%
jabailo,
User Rank: Light Sabre
8/27/2014 | 12:56:38 AM
Re: What's the protocol?
Sure, I was just thinking they could reduce the packet sizes by removing some of the headers, since it all runs "in-house" on their cloud.
pcharles09
50%
50%
pcharles09,
User Rank: Light Beer
8/27/2014 | 12:29:06 AM
Re: What's the protocol?
@jabailo,

My guess is because that's what they've always used. No reason to change unless there's a problem/vulnerability.
jabailo
50%
50%
jabailo,
User Rank: Light Sabre
8/26/2014 | 10:51:07 PM
What's the protocol?
Just how raw is the data layer protocol?  Is there any reason for it to be tcp/ip? 
Atlantis-dude
50%
50%
Atlantis-dude,
User Rank: Light Sabre
8/26/2014 | 7:42:42 PM
Autopilot
Is Andromeda the same as Azure's Autopilot? And what is the baseline?
Flash Poll
From The Founder
It's clear to me that the communications industry is divided into two types of people, and only one is living in the real world.
LRTV Documentaries
EE: The Road to 5G

12|16|14   |   16:02   |   (1) comment


Andy Sutton, the principal network architect at UK mobile operator EE, explains how his company is using Wembley stadium as a wireless test bed and how that's helping EE to plan the evolution to 5G.
LRTV Huawei Video Resource Center
Highlights of Huawei's NFV Open Cloud Forum 2014

12|16|14   |     |   (0) comments


Huawei hosted its inaugural NFV Open Cloud Forum during the SDN & OpenFlow World Congress 2014 in Düsseldorf, Germany. The Forum brought together technology thought leaders, senior executives and telecom professionals from global carriers, industry associations, as well as other partner companies in the ecosystem, to exchange views on and collectively explore how ...
LRTV Custom TV
Realizing Operators' Digital Vision

12|16|14   |   5:23   |   (0) comments


Leveraging technology is fundamental to digital transformation but understanding customers and serving them really well is at the heart of digital businesses. TM Forum lists the following as the strategic pillars of the digital business: business agility and rapid innovation, operational agility and effectiveness, IT and data centricity, plus customer centricity. ...
LRTV Documentaries
US Cellular Injects Analytics Into LTE

12|16|14   |   2:57   |   (1) comment


US Cellular's Mario Vela explains how the operator uses analytics for network planning and what comes next as the carrier looks to eke more value out of its metrics.
LRTV Interviews
How Cox Biz Plans to Keep Growing

12|15|14   |     |   (1) comment


Steve Rowley, SVP of Cox Business, details how the third-biggest US MSO intends to boost its revenues to $2 billion and beyond over the rest of the decade
LRTV Huawei Video Resource Center
Interview With Bill Zhang, Director of SoftCOM Product Management, Huawei

12|15|14   |   2:50   |   (0) comments


Bill Zhang elaborated on Huawei's open philosophy in NFV solution development and network architecture design at the SDN & OpenFlow World Congress 2014.
LRTV Huawei Video Resource Center
Event Highlights: Huawei at SDN & OpenFlow World Congress 2014

12|15|14   |   3:43   |   (0) comments


Huawei joined the 2014 SDN & OpenFlow Congress as one of the key sponsors and contributors. At the event, Huawei reinforced the openness and flexibility of its network infrastructure strategies, and provided updates on its SDN and NVF innovations. Through participations at the exhibitions, forums and speeches, Huawei encouraged the industry to "think bigger and ...
LRTV Interviews
How Cable Biz Services Hit $10B Mark

12|12|14   |     |   (1) comment


Cable operators reached $10 billion in annual business services revenues by delving deeper into their vertical markets and expanding beyond the smallest firms.
LRTV Documentaries
Mediacom Aims to Test Connected Tractors

12|11|14   |   05:07   |   (3) comments


Cable business service provider is taking its services to the 'agribusiness' sector in partnership with farm equipment specialist John Deere and is getting involved in Gigabit Cities developments.
LRTV Interviews
TWC Business Looks Beyond $3B

12|10|14   |     |   (0) comments


TWC Business Services chief Phil Meeks explains how his unit has reached $3 billion in annual revenues and what its plans are for next year.
LRTV Documentaries
AT&T's New Security Strategy

12|10|14   |   02:36   |   (1) comment


AT&T's Chief Security Officer Ed Amoroso explains how his company is wrapping virtual security layers around micro network domains.
LRTV Documentaries
2020 Vision: A First View

12|9|14   |   02:25   |   (3) comments


At the 2020 Vision Executive Summit in Iceland, unique Heavy Reading research shows that comms service providers are optimistic about the next five or so years.
Upcoming Live Events
February 10, 2015, Atlanta, GA
April 14, 2015, New York City, NY
May 6, 2015, McCormick Convention Center, Chicago, IL
May 13-14, 2015, The Westin Peachtree, Atlanta, GA
June 9-10, 2015, Chicago, IL
Hot Topics
Vodafone to Ride T-Mobile Back Into US
Dan Jones, Mobile Editor, 12/12/2014
1-Gig: Coming to a Small Town Near You
Jason Meyers, Senior Editor, Gigabit Cities/IoT, 12/17/2014
Cisco Makes Big Analytics Push
Mitch Wagner, West Coast Bureau Chief, Light Reading, 12/11/2014
Gardner's Departure a Cautionary Tale
Carol Wilson, Editor-at-large, 12/12/2014
T-Mobile Lights Up 27 Wideband LTE Cities
Sarah Reedy, Senior Editor, 12/15/2014
Like Us on Facebook
Twitter Feed
Upcoming Webinars
Webinar Archive