Light Reading
Facebook's load balancing is designed to keep its servers running at a moderate speed -- not too slow.

Facebook Slashes Data Center Power Consumption

Mitch Wagner
8/8/2014
50%
50%

Facebook is developing a new traffic management technology called Autoscale to optimize energy consumption by 10-15% at its data centers.

Facebook currently uses a traditional round-robin approach to load balancing, but found that was less than optimal, because servers running low-level loads use power more inefficiently than idle servers or servers running at moderate or greater loads, writes Qiang Wu, Facebook infrastructure software engineer, on the Facebook Code Engineering Blog.

Autoscale is designed to optimize workloads so that servers are either idling, or running at medium capacity. It tries to avoid assigning workloads in a way that results in servers running at low capacity, Wu writes.

An idle server consumes about 60 watts. It takes a big power hit, to 130 watts, when it jumps to low-level CPU utilization, for a small number of requests per second. But it only takes a small power hit, to 150 watts, when it goes from low-level to medium-level CPU utilization, Wu writes.

Therefore, from a power-efficiency perspective, we should try to avoid running a server at low RPS and instead try to run at medium RPS.

To tackle this problem and utilize power more efficiently, we changed the way that load is distributed to the different web servers in a cluster. The basic idea of Autoscale is that instead of a purely round-robin approach, the load balancer will concentrate workload to a server until it has at least a medium-level workload. If the overall workload is low (like at around midnight), the load balancer will use only a subset of servers. Other servers can be left running idle or be used for batch-processing workloads.

Though the idea sounds simple, it is a challenging task to implement effectively and robustly for a large-scale system.

Autoscale dynamically adjusts the size of the server pool in use, so that each active server will get at least a medium-level CPU load. Servers not in the active pool don't receive traffic.


Power up your data center knowledge on Light Reading's data center infrastructure channel


Optimizing both performance and power consumption was key in developing decision logic for traffic management: "On one hand, we want to maximize the energy-saving opportunity. On the other, we don't want to over-concentrate the traffic in a way that could affect site performance."

Results have been promising:

Autoscale led to a 27% power savings around midnight (and, as expected, the power saving was 0% around peak hours). The average power saving over a 24-hour cycle is about 10-15% for different web clusters.

Normalized power consumption for a production web cluster with and without Autoscale. Source: Facebook.
Normalized power consumption for a production web cluster with and without Autoscale. Source: Facebook.

Facebook is driving open source data center hardware design with its own Open Compute project. The project is self-serving -- Facebook runs among the most massive data centers in the world, and data center cost savings improves Facebook's bottom line. Facebook says it has saved $1.2 billion over three years using the Open Compute hardware designs it champions. (See Open Compute Project Takes on Networking.)

Earlier this week, Facebook bought PrivateCore, a security software company, to beef up its server security. (See Facebook Buys PrivateCore for Server Security.)

— Mitch Wagner, Circle me on Google+Follow me on TwitterVisit my LinkedIn profileFollow me on Facebook, West Coast Bureau Chief, Light Reading. Got a tip about SDN or NFV? Send it to wagner@lightreading.com.

(9)  | 
Comment  | 
Print  | 
Newest First  |  Oldest First  |  Threaded View
SachinEE
50%
50%
SachinEE,
User Rank: Light Sabre
8/12/2014 | 2:23:27 PM
Re: good news for Facebook
With the millions of users that Facebook has bagged over he years, it is good to know that they have found a way to improve their data centers. Facebook is used world wide and they make a lot of profit but this new occurrence will no doubt help them to cut costs and probably boost their earnings by a great percentage. It is a wonder that they did not do this sooner.
brooks7
50%
50%
brooks7,
User Rank: Light Sabre
8/11/2014 | 11:44:17 AM
Re: Not been done before ?
Dennis,

Note, that the applications that people like Amazon and Google do are diverse.  It may not be as easy to eliminate compute power in that environment.  Scaling computing and storage in those environments might have very different curves.

seven

 
mendyk
50%
50%
mendyk,
User Rank: Light Sabre
8/11/2014 | 11:39:05 AM
Re: Not been done before ?
Maybe they have but choose not to crow about it. Or maybe they haven't. The point of the story was to highlight what FB is doing to improve its efficiency and margins.
Whatdoyouwant
50%
50%
Whatdoyouwant,
User Rank: Light Beer
8/11/2014 | 11:31:47 AM
Re: Not been done before ?
I meant by the industry in general.  Google, Yahoo, Amazon, etc..   none of these guys have figured this out ?
mendyk
50%
50%
mendyk,
User Rank: Light Sabre
8/11/2014 | 10:36:51 AM
Re: Not been done before ?
When your growth is in triple digits, you don't worry so much about sweating down costs. That comes with maturity. Now that Facebook is a public company, it has to focus more on stuff like margins.
Whatdoyouwant
50%
50%
Whatdoyouwant,
User Rank: Light Beer
8/11/2014 | 9:46:42 AM
Not been done before ?
Is it me or does this seem like something that would have been done a long time ago ?
danielcawrey
50%
50%
danielcawrey,
User Rank: Light Sabre
8/9/2014 | 6:31:59 PM
Re: Something good from Facebook
I did not realize that the optimum power consumption for a server instance was at medium level capacity. This is really useful - something that hardware designers and cloud service providers should usel to optimize machines and cut costs.

More and more services are being powered through the cloud - which means there is huge opportunity to slash operating expenses. 
thebulk
50%
50%
thebulk,
User Rank: Light Sabre
8/9/2014 | 11:36:47 AM
Re: Something good from Facebook
Just think of the cost they are cutting with this! It really is impressive. 
mendyk
50%
50%
mendyk,
User Rank: Light Sabre
8/9/2014 | 9:01:31 AM
Something good from Facebook
Congratulations to Facebook for figuring out how to make its data centers more efficient. Do you think there's a similar potential for energy cost savings for network operators that deploy virtualization?
Educational Resources
sponsor supplied content
Educational Resources Archive
Flash Poll
From The Founder
It's clear to me that the communications industry is divided into two types of people, and only one is living in the real world.
LRTV Huawei Video Resource Center
Interview With Rick Talbot, Principal Analyst, Current Analysis

10|31|14   |   2:12   |   (0) comments


At the NFV Open Cloud Forum 2014, Rick Talbot shared his positive feedback about the holistic and open approach that Huawei adopts for SDN and NFV. He also found the open sharing at the event valuable as it features different perspectives from Huawei experts, telecom operators, industry analysts as well as security experts.
LRTV Huawei Video Resource Center
Interview With David Snow, Principal Analyst, Current Analysis

10|31|14   |   2:24   |   (0) comments


David Snow talked about his understanding of Huawei and its SoftCOM strategy at the NFV Open Cloud Forum 2014, saying that Huawei's wide approach combining IT and CT expertise, introducing big data and analytics into solutions and contributing to the OpenStack community particularly resonate with him and make the company stand out in the industry.
LRTV Huawei Video Resource Center
Interview With Roz Roseboro, Senior Analyst, Heavy Reading

10|31|14   |   3:13   |   (0) comments


Roz Roseboro commented on Huawei's data center capabilities and NFV solutions at the NFV Open Cloud Forum 2014, saying that in addition to covering all three key domains of compute, storage and networking, the company also emphasizes the importance of management capabilities and professional services, which are essential in making NFV a reality.
LRTV Huawei Video Resource Center
Interview With Michael Howard, Co-founder & Principal Analyst, Infonetics Research

10|31|14   |   5:25   |   (0) comments


Michael Howard talked about SDN, NFV, and OpenStack adoption at Huawei's NFV Open Cloud Forum 2014. Particularly, he pointed out that Virtual Enterprise CPE is the top NFV use case that operators plan to invest in over 2014 and 2015 to deliver new enterprise services through virtualized functions.
LRTV Huawei Video Resource Center
Interview With Jerry Caron, Senior Vice President, Current Analysis

10|31|14   |   3:11   |   (0) comments


At Huawei's NFV Open Cloud Forum 2014, Jerry Caron from Current Analysis said that orchestration and management are key to realizing SDN and NFV for global carriers, and the approach that Huawei is taking, with its FusionSphere Cloud OS at the core, is in the right direction to address the challenges.
LRTV Documentaries
Broadband Battles

10|31|14   |   01:39   |   (0) comments


This year's Broadband World Forum featured a number of show floor battles focused on access gear, components and coffee.
Jonestown
Mobile Backhaul: Going to the Dark Side?

10|30|14   |   2:26   |   (1) comment


Heavy Reading's Patrick Donegan shares his view on a dark trend that bubbled up at Light Reading's annual backhaul conference in NYC.
LRTV Huawei Video Resource Center
2014 Huawei Electric Power Industry Summit: Interview With CEO of SwitchCom

10|30|14   |   4:13   |   (0) comments


SwitchCom, an IT company based in Angola, recommends a variety of Huawei solutions and hardware to their customers in the energy industry.
LRTV Huawei Video Resource Center
2014 Huawei Electric Power Industry Summit: Interview With Ethiopia's Ministry of Water Irrigation & Energy

10|30|14   |   4:08   |   (0) comments


Gosaye Mengistie of Ethiopia's Ministry of Water Irrigation & Energy discusses the collaboration with Huawei in that country.
LRTV Huawei Video Resource Center
2014 Huawei Electric Power Industry Summit: Interview with Dongfang Electronics Corporation

10|30|14   |   5:46   |   (0) comments


Dongfang Electronics Corporation, headquartered in Chengdu, China, is one of China's largest manufacturers of power generators and contractors of power station projects.
LRTV Huawei Video Resource Center
2014 Huawei Electric Power Industry Summit: Interview with Zimbabwe's Customers

10|30|14   |   3:31   |   (0) comments


Representatives of Zimbabwe's Ministry of Power and Development discuss the energy needs of their country as well as new areas of improvement due to enhanced ICT capabilities.
LRTV Huawei Video Resource Center
2014 Huawei Electric Power Industry Summit: Interview With Colbún Chile

10|30|14   |   4:29   |   (0) comments


In Chile, an aging energy infrastructure was in dire need of a modern update. Claudio Valenzuela of Colbún discusses how Huawei's ICT solutions continue to provide crucial information to improve the grid and how an in-country engineer is a cricial asset.
Upcoming Live Events
November 6, 2014, Santa Clara
November 11, 2014, Atlanta, GA
December 2, 2014, New York City
December 3, 2014, New York City
December 9-10, 2014, Reykjavik, Iceland
February 10, 2015, Atlanta, GA
May 6, 2015, McCormick Convention Center, Chicago, IL
May 30, 2015, The Westin Peachtree, Atlanta, GA
June 9-10, 2015, Chicago, IL
Infographics
WhoIsHostingThis.com presents six of the world's most extreme WiFi hotspots, enabling the most epic selfies you can imagine.
Hot Topics
Microsoft's Skype Embraces WebRTC on IE
Sarah Reedy, Senior Editor, 10/27/2014
FTC Slaps AT&T With Throttling Lawsuit
Sarah Reedy, Senior Editor, 10/28/2014
Wheeler Gets Down With OTT
Mari Silbey, Independent Technology Editor, 10/29/2014
China's MVNOs Hit the Wall
Robert Clark, 10/27/2014
Let's Not Kill SDN & NFV With Silos
Francois Locoh-Donou, Senior VP, Global Products Group, Ciena, 10/28/2014
Like Us on Facebook
Twitter Feed