Light Reading
Google's Andromeda infrastructure is designed to provide bare-metal performance and low latency to customers worldwide.

Google's Andromeda Relieves Cloud Strain

Mitch Wagner
8/26/2014
50%
50%

MOUNTAIN VIEW, Calif. -- Hot Interconnects -- Google relies on its Andromeda networking platform to deliver a global cloud infrastructure that gives customers the security and performance benefits of local private networks.

"We want bare-metal performance and low latency for the services we deliver," said Google (Nasdaq: GOOG) Distinguished Engineer Amin Vahdat, delivering a keynote at the conference here today.

SDN is key to delivering the needed performance and security, he said.

SDN at its most fundamental involves separating the control plane from the data plane, Vahdat noted. "A logically centralized hierarchical control plane beats peer-to-peer every time," he said. The data plane can run at network speed, while the control plane can run on commodity hardware, scaling as needed. The control plane requires 1% of the overhead of the entire network, Vahdat said.

But managing that infrastructure requires new tools and skills, he said.

"It turns out that running a hundred or a thousand servers is a very difficult operation. You can't hire people out of college who know how to operate a hundred or a thousand servers," Vahdat said. Tools are often designed for homogeneous environments and individual systems. Human reaction time is too slow to deliver "five nines" of uptime, maintenance outages are unacceptable, and the network becomes a bottleneck and source of outages.

Google looks to SDN and network functions virtualization (NFV) to orchestrate provisioning, high availability, and meet application performance requirements, Vahdat said. The technology must be distributed throughout the network, which is only as strong as its weakest link.

Andromeda is Google's code-name for its network virtualization platform. It's designed to provide each external user with the illusion that they're on a dedicated network with dedicated performance and its own IP address space. Applications require real-time high performance and low-latency communications to virtual machines. Users also require service chaining to tools such as load-balancing, and the ability to grow and shrink the number of servers available to applications as demand requires. (See Google, Microsoft Challenge Service Providers and Google's Andromeda Strain Is Spreading.)

Security is a huge requirement. "Large companies are constantly under attack. It's not a question of whether you're under attack but how big is the attack," Vahdat said.

Power and cooling are the major costs of a global infrastructure like Google's. "That's true of even your laptop at home if you're running it 24/7. At Google scale, that's very apparent," Vahdat said.

Google has a global infrastructure, with data centers and points of presence worldwide to provide low-latency access to services locally, rather than requiring customers to access a single point.

The company runs two networks. Its private, server-to-server network is bigger than its public network, and one of the world's largest SDN deployments. Connectivity between data centers is comparable to within data centers.

Andromeda provides significant performance improvements over a state-of-the-art baseline, as seen in Vahdat's slides:

The promise of cloud computing is just beginning.


Find out more about key developments related to the systems and technologies deployed in data centers on Light Reading's data center infrastructure channel.


"Many people think about cloud computing as being able to get on-demand access to computing. I don't have to go buy servers; I can rent them for a minute, or an hour, or a day. I can get burst capacity of as many servers as I like, whatever memory, configuration or disk, etc., that I like. I think actually yes, this is powerful, but this is really just the beginning," Vahdat said. "The really exciting parts of cloud computing are on the verge of happening."

These include a fundamentally easier operational model; higher uptime; state-of-the-art infrastructure services such as denial-of-service protection, load balancing, and storage; and new programming models for low latency and massive input-output performance.

What cloud doesn't do is take away the challenges of running an IT infrastructure. "Most cloud customers, if you poll them, say the operational overhead of running on the cloud is as hard or harder today than running on your own infrastructure," Vahdat said.

Click the photo below for a selection of Vahdat's slides -- and more.

He's Hydrated
Google Distinguished Engineer Amin Vahdat
Google Distinguished Engineer Amin Vahdat

— Mitch Wagner, Circle me on Google+Follow me on TwitterVisit my LinkedIn profileFollow me on Facebook, West Coast Bureau Chief, Light Reading. Got a tip about SDN or NFV? Send it to wagner@lightreading.com.

(8)  | 
Comment  | 
Print  | 
Newest First  |  Oldest First  |  Threaded View
pcharles09
50%
50%
pcharles09,
User Rank: Light Beer
8/31/2014 | 10:40:01 PM
Re: What's the protocol?
@jabailo,

Wouldn't the packet alterations get messy though? In the TCP case , if somethings off just a little bit. Also, there'd have to be extra overhead for error checking right?
jabailo
50%
50%
jabailo,
User Rank: Light Sabre
8/27/2014 | 10:52:17 PM
Re: What's the protocol?
Like in a private network you can make assumptions that you can't make when shipping it out across the public Internet.

For example, I'm looking at this diagram:

http://www.freesoft.org/CIE/Course/Section4/8.htm

What about all that space for "source port" and "destination port".   Inside your own network, do you need to allocate that many bits?

Seems like for every bit you can reduce in a packet you get that much greater throughput.

 
pcharles09
50%
50%
pcharles09,
User Rank: Light Beer
8/27/2014 | 5:58:28 PM
Re: What's the protocol?
@jabailo,

Ahh ok I see. That's a good point.
kq4ym
50%
50%
kq4ym,
User Rank: Light Sabre
8/27/2014 | 9:45:56 AM
Androworld
Google certainly is going to lead the way in NFV/SDN services and of course the free PR they get for all announcements is not a bad thing for them either. Security is still going to be an ongoing problem and probably others are going to see their way to NFV and the cloud just to help solve that issue.
jabailo
50%
50%
jabailo,
User Rank: Light Sabre
8/27/2014 | 12:56:38 AM
Re: What's the protocol?
Sure, I was just thinking they could reduce the packet sizes by removing some of the headers, since it all runs "in-house" on their cloud.
pcharles09
50%
50%
pcharles09,
User Rank: Light Beer
8/27/2014 | 12:29:06 AM
Re: What's the protocol?
@jabailo,

My guess is because that's what they've always used. No reason to change unless there's a problem/vulnerability.
jabailo
50%
50%
jabailo,
User Rank: Light Sabre
8/26/2014 | 10:51:07 PM
What's the protocol?
Just how raw is the data layer protocol?  Is there any reason for it to be tcp/ip? 
Atlantis-dude
50%
50%
Atlantis-dude,
User Rank: Light Sabre
8/26/2014 | 7:42:42 PM
Autopilot
Is Andromeda the same as Azure's Autopilot? And what is the baseline?
Flash Poll
From The Founder
It's clear to me that the communications industry is divided into two types of people, and only one is living in the real world.
LRTV Custom TV
Distributed Access Architectures – 2

10|21|14   |   8:51:00 AM   |   (0) comments


ARRIS CTO Network Solutions Tom Cloonan discusses why many if not most MSOs will continue with integrated CCAP, while addressing why some are also looking at two futuristic, distributed access architectures: Remote PHY and Remote CCAP.
LRTV Custom TV
Distributed Access Architectures – 1

10|21|14   |   9:01   |   (0) comments


SCTE Sr. Director of Engineering Dean Stoneback discusses the pros and cons of distributed access architecture (DAA) and its various forms, which range from basic Remote PHY to full CMTS functionality in the node.
LRTV Custom TV
The WiFi Road to Riches – 2

10|21|14   |   3:58   |   (0) comments


ARRIS Senior Solution Architect Eli Baruch talks about how MSOs can enable public and community WiFi through 1) outdoor access points, 2) businesses seeking to offer WiFi to customers, and 3) residential WiFi gateway extensions.
LRTV Custom TV
The WiFi Road to Riches – 1

10|21|14   |   10:15   |   (0) comments


SCTE Director of Advanced Technologies Steve Harris discusses WiFi deployments, drivers, challenges and advances, including 802.11ac, carrier-grade WiFi, community WiFi, Hotspot 2.0, Passpoint, WiFi-First and voice-over-WiFi.
LRTV Custom TV
Advantech Accelerates 100G Traffic Handling

10|17|14   |   7:56   |   (0) comments


Paul Stevens from Advantech explains why handling 100GbE needs a whole new platform design approach and how Advantech is addressing the needs of equipment providers and carriers to give them the flexibility and performance they will need for SDN and NFV deployment.
LRTV Huawei Video Resource Center
Holland's Imtech Traffic & Infra Discusses Huawei's ICT Solution and Services

10|16|14   |   4:49   |   (0) comments


Dimitry Theebe is from the business unit at Imtech Traffic & Infra which delivers communications solutions for transportations. His partnershp with Huawei began about a years ago. In this video, Theebe speaks more about this partnership and what he hopes to accomplish with Huawei.
LRTV Huawei Video Resource Center
Huawei's Comprehensive Storage Solutions Vital for SVR

10|16|14   |   6:16   |   (0) comments


SVR Information Technology provides cloud services for academic and special sectors. With Huawei's support, SVR and Yildiz Technical University has established Turkey's largest and most advanced High Performance Computing system. CSO Ismail Cem Aslan talks about what he hopes Huawei's OceanStor storage system will bring for him.
LRTV Huawei Video Resource Center
Mexico's Servitron's Impression of Huawei at CCW 2014

10|16|14   |   6:35   |   (0) comments


Servitron is a network operator in Mexico that has been in the trunking industry for the past 20 years. Its COO, Ing. Ragnar Trillo O., explains at Critical Communications World 2014 that his company has been interested in the long-term evolution of LTE technology and its adoption for TETRA.
LRTV Huawei Video Resource Center
Building a Better Dubai

10|16|14   |   2:06   |   (0) comments


Abdulla Ahmed Al Falasi is the director of commercial affairs, a telecommunications coordinator for the government of Dubai. Their areas of service span across multiple industries, including police, safety, shopping malls and more. In this video, Abdulla talks about his department's work with Huawei.
LRTV Huawei Video Resource Center
Huawei Lights Up Malaysia Partner Maju Nusa

10|16|14   |   1:59   |   (0) comments


Malaysia's Maju Nusa is an enterprise partner to Huawei in networking, route switches and telco equipment. At this year's Critical Communications World in Singapore, CTO Pushpender Singh talks about what Huawei's eLTE solutions mean to his company and for Malaysia.
LRTV Custom TV
Evolving From HFC to FTTH Networks

10|15|14   |   2:19   |   (0) comments


Cisco's Todd McCrum delves into the future of cable's HFC plant, examining how DOCSIS 3.1 and advanced video compression will extend its life and how the IP video transition will usher in GPON and EPON over FTTH.
LRTV Custom TV
Exploring the Future of Cable Access

10|15|14   |   6:23   |   (0) comments


Cisco's Brett Wingo looks at where cable access architectures are heading, discussing the impact of DOCSIS 3.1, CCAP, Remote PHY, SDN, virtualization of cable networks and related technologies.
Upcoming Live Events
October 29, 2014, New York City
November 6, 2014, Santa Clara
November 11, 2014, Atlanta, GA
December 2, 2014, New York City
December 3, 2014, New York City
December 9-10, 2014, Reykjavik, Iceland
June 9-10, 2015, Chicago, IL
Infographics
WhoIsHostingThis.com presents six of the world's most extreme WiFi hotspots, enabling the most epic selfies you can imagine.
Hot Topics
Forget the Internet, Brace for Skynet
Stephen Saunders, 10/15/2014
HBO Will Go OTT in 2015
Mari Silbey, Independent Technology Editor, 10/15/2014
Google: Carriers & Cloud Providers Need to Cooperate
Mitch Wagner, West Coast Bureau Chief, Light Reading, 10/16/2014
Could Data Be the New 'Currency'?
Ray Le Maistre, Editor-in-chief, 10/16/2014
iPad Air 2 Lets Users Switch Carriers Any Time
Mitch Wagner, West Coast Bureau Chief, Light Reading, 10/17/2014
Like Us on Facebook
Twitter Feed