Light Reading
Google's Andromeda infrastructure is designed to provide bare-metal performance and low latency to customers worldwide.

Google's Andromeda Relieves Cloud Strain

Mitch Wagner
8/26/2014
50%
50%

MOUNTAIN VIEW, Calif. -- Hot Interconnects -- Google relies on its Andromeda networking platform to deliver a global cloud infrastructure that gives customers the security and performance benefits of local private networks.

"We want bare-metal performance and low latency for the services we deliver," said Google (Nasdaq: GOOG) Distinguished Engineer Amin Vahdat, delivering a keynote at the conference here today.

SDN is key to delivering the needed performance and security, he said.

SDN at its most fundamental involves separating the control plane from the data plane, Vahdat noted. "A logically centralized hierarchical control plane beats peer-to-peer every time," he said. The data plane can run at network speed, while the control plane can run on commodity hardware, scaling as needed. The control plane requires 1% of the overhead of the entire network, Vahdat said.

But managing that infrastructure requires new tools and skills, he said.

"It turns out that running a hundred or a thousand servers is a very difficult operation. You can't hire people out of college who know how to operate a hundred or a thousand servers," Vahdat said. Tools are often designed for homogeneous environments and individual systems. Human reaction time is too slow to deliver "five nines" of uptime, maintenance outages are unacceptable, and the network becomes a bottleneck and source of outages.

Google looks to SDN and network functions virtualization (NFV) to orchestrate provisioning, high availability, and meet application performance requirements, Vahdat said. The technology must be distributed throughout the network, which is only as strong as its weakest link.

Andromeda is Google's code-name for its network virtualization platform. It's designed to provide each external user with the illusion that they're on a dedicated network with dedicated performance and its own IP address space. Applications require real-time high performance and low-latency communications to virtual machines. Users also require service chaining to tools such as load-balancing, and the ability to grow and shrink the number of servers available to applications as demand requires. (See Google, Microsoft Challenge Service Providers and Google's Andromeda Strain Is Spreading.)

Security is a huge requirement. "Large companies are constantly under attack. It's not a question of whether you're under attack but how big is the attack," Vahdat said.

Power and cooling are the major costs of a global infrastructure like Google's. "That's true of even your laptop at home if you're running it 24/7. At Google scale, that's very apparent," Vahdat said.

Google has a global infrastructure, with data centers and points of presence worldwide to provide low-latency access to services locally, rather than requiring customers to access a single point.

The company runs two networks. Its private, server-to-server network is bigger than its public network, and one of the world's largest SDN deployments. Connectivity between data centers is comparable to within data centers.

Andromeda provides significant performance improvements over a state-of-the-art baseline, as seen in Vahdat's slides:

The promise of cloud computing is just beginning.


Find out more about key developments related to the systems and technologies deployed in data centers on Light Reading's data center infrastructure channel.


"Many people think about cloud computing as being able to get on-demand access to computing. I don't have to go buy servers; I can rent them for a minute, or an hour, or a day. I can get burst capacity of as many servers as I like, whatever memory, configuration or disk, etc., that I like. I think actually yes, this is powerful, but this is really just the beginning," Vahdat said. "The really exciting parts of cloud computing are on the verge of happening."

These include a fundamentally easier operational model; higher uptime; state-of-the-art infrastructure services such as denial-of-service protection, load balancing, and storage; and new programming models for low latency and massive input-output performance.

What cloud doesn't do is take away the challenges of running an IT infrastructure. "Most cloud customers, if you poll them, say the operational overhead of running on the cloud is as hard or harder today than running on your own infrastructure," Vahdat said.

Click the photo below for a selection of Vahdat's slides -- and more.

He's Hydrated
Google Distinguished Engineer Amin Vahdat
Google Distinguished Engineer Amin Vahdat

— Mitch Wagner, Circle me on Google+Follow me on TwitterVisit my LinkedIn profileFollow me on Facebook, West Coast Bureau Chief, Light Reading. Got a tip about SDN or NFV? Send it to wagner@lightreading.com.

(8)  | 
Comment  | 
Print  | 
Newest First  |  Oldest First  |  Threaded View
pcharles09
50%
50%
pcharles09,
User Rank: Light Beer
8/31/2014 | 10:40:01 PM
Re: What's the protocol?
@jabailo,

Wouldn't the packet alterations get messy though? In the TCP case , if somethings off just a little bit. Also, there'd have to be extra overhead for error checking right?
jabailo
50%
50%
jabailo,
User Rank: Light Sabre
8/27/2014 | 10:52:17 PM
Re: What's the protocol?
Like in a private network you can make assumptions that you can't make when shipping it out across the public Internet.

For example, I'm looking at this diagram:

http://www.freesoft.org/CIE/Course/Section4/8.htm

What about all that space for "source port" and "destination port".   Inside your own network, do you need to allocate that many bits?

Seems like for every bit you can reduce in a packet you get that much greater throughput.

 
pcharles09
50%
50%
pcharles09,
User Rank: Light Beer
8/27/2014 | 5:58:28 PM
Re: What's the protocol?
@jabailo,

Ahh ok I see. That's a good point.
kq4ym
50%
50%
kq4ym,
User Rank: Light Sabre
8/27/2014 | 9:45:56 AM
Androworld
Google certainly is going to lead the way in NFV/SDN services and of course the free PR they get for all announcements is not a bad thing for them either. Security is still going to be an ongoing problem and probably others are going to see their way to NFV and the cloud just to help solve that issue.
jabailo
50%
50%
jabailo,
User Rank: Light Sabre
8/27/2014 | 12:56:38 AM
Re: What's the protocol?
Sure, I was just thinking they could reduce the packet sizes by removing some of the headers, since it all runs "in-house" on their cloud.
pcharles09
50%
50%
pcharles09,
User Rank: Light Beer
8/27/2014 | 12:29:06 AM
Re: What's the protocol?
@jabailo,

My guess is because that's what they've always used. No reason to change unless there's a problem/vulnerability.
jabailo
50%
50%
jabailo,
User Rank: Light Sabre
8/26/2014 | 10:51:07 PM
What's the protocol?
Just how raw is the data layer protocol?  Is there any reason for it to be tcp/ip? 
Atlantis-dude
50%
50%
Atlantis-dude,
User Rank: Light Sabre
8/26/2014 | 7:42:42 PM
Autopilot
Is Andromeda the same as Azure's Autopilot? And what is the baseline?
Flash Poll
From The Founder
Is your network built on 'The Old IP,' or are you part of 'The New IP' revolution?
LRTV Huawei Video Resource Center
Innovating Access Technology With G.fast

10|1|14   |   3.42   |   (0) comments


Exploring the potential of G.fast technology from the point of view of the Broadband Forum, Huawei – and an end-user.
LRTV Documentaries
A Cultural Shift for an OTT World

9|26|14   |   01:41   |   (3) comments


Telcos need to embrace a new approach to partnerships if they are to generate extra revenues quickly and give customers what they want.
LRTV Documentaries
New Skills Needed as Telecom, IT Collide

9|26|14   |   4:07   |   (1) comment


As telecom and IT collide, new technologies are emerging, new skills are needed and new opportunities for women are arising.
UBB Forum News
Do IP Networks Need An Overhaul?

9|25|14   |   02:01   |   (0) comments


As traffic levels ramp, do IP networks need new technologies and topologies?
LRTV Documentaries
Sprint Wields Its Influence in the Valley

9|25|14   |   3:09   |   (11) comments


Anne-Louise Kardas, Sprint's connection to startups in the Valley, explains how telcos can be innovative and find new opportunities with partners.
LRTV Documentaries
SDN, NFV & The Future of XO's Network

9|25|14   |   3:47   |   (1) comment


XO Communications COO Don MacNeil explains how cloud, SDN and NFV are altering its network requirements as well as changing data centers of the future.
UBB Forum News
The OTT Conundrum

9|24|14   |   01:39   |   (0) comments


What is holding back prosperous partnerships between telcos and the OTT players?
LRTV Documentaries
Putting Broadband to Work

9|24|14   |   01:26   |   (0) comments


High-speed broadband network rollout is key to telco strategies, but it's what happens after the network is built that counts.
Light Reedy
Light Reading's Women in Telecom Recap

9|24|14   |   0:55   |   (4) comments


Our first Women in Telecom breakfast was a huge success, and we hope you'll join us in London for the next event on November 6.
UBB Forum News
Monetizing Ultra-Broadband

9|24|14   |   01:43   |   (2) comments


Ultra-broadband networks need to be built, with fiber-to-the-premises the ultimate goal, but they need to be monetized, too.
LRTV Huawei Video Resource Center
Sales Director of INIT on Plug & Play Switch Devices

9|19|14   |   3:21   |   (0) comments


INIT Italy uses both the Huawei S5700 and S7700 series switches for the campus LAN environment. Sales Director Andrea Curti says their company chose these Huawei devices over others because of their performance, flexible scalability and plug-and-play features.
LRTV Huawei Video Resource Center
Saudi Arabia Upgrades Vocational Training System

9|19|14   |   3:31   |   (0) comments


The Technical and Vocational Training Corporation (TVTC) has 100,000 students, 150 government-owned institutions and oversees 1000 private institutes. The CIO of TVTC explains that Huawei devices have allowed them to manage multiple datacenters using just one software program, scientifically tracking the progress of students and teachers, saving them millions.
Upcoming Live Events
October 29, 2014, New York City
November 6, 2014, Santa Clara
November 11, 2014, Atlanta, GA
December 2, 2014, New York City
December 3, 2014, New York City
December 9-10, 2014, Reykjavik, Iceland
June 9-10, 2015, Chicago, IL
Infographics
Half of the world's population will be connected to the Internet by 2017, but not just by smartphones and desktops.
Hot Topics
Facebook Pokes Around LTE Direct
Sarah Reedy, Senior Editor, 9/25/2014
Is Redbox Instant Shutting Down?
Mari Silbey, Independent Technology Editor, 9/30/2014
Sprint Wields Its Influence in the Valley
Sarah Reedy, Senior Editor, 9/25/2014
US Ignite Cultivates Gigabit Apps
Jason Meyers, Senior Editor, Utility Communications/IoT, 9/25/2014
SoftBank Eyes a DreamWorks Buy – Report
Sarah Reedy, Senior Editor, 9/29/2014
Like Us on Facebook
Twitter Feed