& cplSiteName &

Facebook Slashes Data Center Power Consumption

Mitch Wagner
8/8/2014
50%
50%

Facebook is developing a new traffic management technology called Autoscale to optimize energy consumption by 10-15% at its data centers.

Facebook currently uses a traditional round-robin approach to load balancing, but found that was less than optimal, because servers running low-level loads use power more inefficiently than idle servers or servers running at moderate or greater loads, writes Qiang Wu, Facebook infrastructure software engineer, on the Facebook Code Engineering Blog.

Autoscale is designed to optimize workloads so that servers are either idling, or running at medium capacity. It tries to avoid assigning workloads in a way that results in servers running at low capacity, Wu writes.

An idle server consumes about 60 watts. It takes a big power hit, to 130 watts, when it jumps to low-level CPU utilization, for a small number of requests per second. But it only takes a small power hit, to 150 watts, when it goes from low-level to medium-level CPU utilization, Wu writes.

Therefore, from a power-efficiency perspective, we should try to avoid running a server at low RPS and instead try to run at medium RPS.

To tackle this problem and utilize power more efficiently, we changed the way that load is distributed to the different web servers in a cluster. The basic idea of Autoscale is that instead of a purely round-robin approach, the load balancer will concentrate workload to a server until it has at least a medium-level workload. If the overall workload is low (like at around midnight), the load balancer will use only a subset of servers. Other servers can be left running idle or be used for batch-processing workloads.

Though the idea sounds simple, it is a challenging task to implement effectively and robustly for a large-scale system.

Autoscale dynamically adjusts the size of the server pool in use, so that each active server will get at least a medium-level CPU load. Servers not in the active pool don't receive traffic.


Power up your data center knowledge on Light Reading's data center infrastructure channel


Optimizing both performance and power consumption was key in developing decision logic for traffic management: "On one hand, we want to maximize the energy-saving opportunity. On the other, we don't want to over-concentrate the traffic in a way that could affect site performance."

Results have been promising:

Autoscale led to a 27% power savings around midnight (and, as expected, the power saving was 0% around peak hours). The average power saving over a 24-hour cycle is about 10-15% for different web clusters.

Normalized power consumption for a production web cluster with and without Autoscale. Source: Facebook.
Normalized power consumption for a production web cluster with and without Autoscale. Source: Facebook.

Facebook is driving open source data center hardware design with its own Open Compute project. The project is self-serving -- Facebook runs among the most massive data centers in the world, and data center cost savings improves Facebook's bottom line. Facebook says it has saved $1.2 billion over three years using the Open Compute hardware designs it champions. (See Open Compute Project Takes on Networking.)

Earlier this week, Facebook bought PrivateCore, a security software company, to beef up its server security. (See Facebook Buys PrivateCore for Server Security.)

— Mitch Wagner, Circle me on Google+Follow me on TwitterVisit my LinkedIn profileFollow me on Facebook, West Coast Bureau Chief, Light Reading. Got a tip about SDN or NFV? Send it to wagner@lightreading.com.

(9)  | 
Comment  | 
Print  | 
Newest First  |  Oldest First  |  Threaded View        ADD A COMMENT
SachinEE
50%
50%
SachinEE,
User Rank: Light Sabre
8/12/2014 | 2:23:27 PM
Re: good news for Facebook
With the millions of users that Facebook has bagged over he years, it is good to know that they have found a way to improve their data centers. Facebook is used world wide and they make a lot of profit but this new occurrence will no doubt help them to cut costs and probably boost their earnings by a great percentage. It is a wonder that they did not do this sooner.
brooks7
50%
50%
brooks7,
User Rank: Light Sabre
8/11/2014 | 11:44:17 AM
Re: Not been done before ?
Dennis,

Note, that the applications that people like Amazon and Google do are diverse.  It may not be as easy to eliminate compute power in that environment.  Scaling computing and storage in those environments might have very different curves.

seven

 
mendyk
50%
50%
mendyk,
User Rank: Light Sabre
8/11/2014 | 11:39:05 AM
Re: Not been done before ?
Maybe they have but choose not to crow about it. Or maybe they haven't. The point of the story was to highlight what FB is doing to improve its efficiency and margins.
Whatdoyouwant
50%
50%
Whatdoyouwant,
User Rank: Light Beer
8/11/2014 | 11:31:47 AM
Re: Not been done before ?
I meant by the industry in general.  Google, Yahoo, Amazon, etc..   none of these guys have figured this out ?
mendyk
50%
50%
mendyk,
User Rank: Light Sabre
8/11/2014 | 10:36:51 AM
Re: Not been done before ?
When your growth is in triple digits, you don't worry so much about sweating down costs. That comes with maturity. Now that Facebook is a public company, it has to focus more on stuff like margins.
Whatdoyouwant
50%
50%
Whatdoyouwant,
User Rank: Light Beer
8/11/2014 | 9:46:42 AM
Not been done before ?
Is it me or does this seem like something that would have been done a long time ago ?
danielcawrey
50%
50%
danielcawrey,
User Rank: Light Sabre
8/9/2014 | 6:31:59 PM
Re: Something good from Facebook
I did not realize that the optimum power consumption for a server instance was at medium level capacity. This is really useful - something that hardware designers and cloud service providers should usel to optimize machines and cut costs.

More and more services are being powered through the cloud - which means there is huge opportunity to slash operating expenses. 
thebulk
50%
50%
thebulk,
User Rank: Light Sabre
8/9/2014 | 11:36:47 AM
Re: Something good from Facebook
Just think of the cost they are cutting with this! It really is impressive. 
mendyk
50%
50%
mendyk,
User Rank: Light Sabre
8/9/2014 | 9:01:31 AM
Something good from Facebook
Congratulations to Facebook for figuring out how to make its data centers more efficient. Do you think there's a similar potential for energy cost savings for network operators that deploy virtualization?
From The Founder
NFV's promises of automation and virtualization are intriguing, but what really excites service providers is the massive amount of money they could save.
Flash Poll
Live Streaming Video
Charting the CSP's Future
Six different communications service providers join to debate their visions of the future CSP, following a landmark presentation from AT&T on its massive virtualization efforts and a look back on where the telecom industry has been and where it's going from two industry veterans.
Huawei Videos
The Power of Next-Gen Unified Communications

8|23|17   |   04:46   |   (0) comments


How Huawei's unified communications and videoconferencing platforms are saving time and money and improving customer experience for users in Italy.
LRTV Documentaries
Phone Review: Moto Z2 Play

8|22|17   |   1:54   |   (0) comments


Light Reading Mobile Editor Dan Jones reviews the Moto Z2 Play, which he calls 'a nice modern Android phone with good battery life and one of the nicest cameras' he's seen. The Moto Z2 Play is a Gigabit LTE-ready phone, but we were not able to test speeds that fast in the US.
LRTV Documentaries
Three Gets Smart(y), BT Invokes Twitter – The Recap

8|21|17   |     |   (0) comments


From Telecoms.com, a recap of the week's telecoms talking points. It's been a week of gimmicks as Three tests out a pay-as-you-go sub-brand called Smarty; Comcast
Women in Comms Introduction Videos
VMWare VP Brings Women Up With Her

8|16|17   |   6:49   |   (1) comment


It's an art and a science to make mentorship, inclusive leadership, diversity and promotion of high-potential women work, says Honore' LaBourdette, vice president of Global Market Development at VMWare.
LRTV Documentaries
5G Spectrum Wars – The Recap

8|15|17   |   2:22   |   (0) comments


Service provider 3 has filed a lawsuit against Ofcom over 5G spectrum auction in the UK.
LRTV Custom TV
Say What? Facebook Unleashes AI Anarchy – The Recap

8|7|17   |     |   (0) comments


A recap of the week's talking points on Light Reading's sister site, telecoms.com. Facebook AI programmers had a bit of a brain-fade as they allowed one of its AI applications to invent its ...
Women in Comms Introduction Videos
Fujitsu's Women Band Together to Help Girls Do STEM

8|2|17   |   9:35   |   (1) comment


Supporting women both inside and outside of Fujitsu is a top priority of the telecom vendor. Yanbing Li, Fujitsu Network Communication's director of System Software Development & Delivery, shares why it's important, but why there's still a long road ahead.
LRTV Custom TV
If You're Not First, You're Last – The Recap

7|31|17   |   08:18   |   (1) comment


In case you missed it, Amazon's 1% stock increase helped Jeff Bezos dethrone Bill Gates as the richest man in the world. Also, Taiwanese electronics manufacturer
Women in Comms Introduction Videos
AT&T's Tech President Preps Workforce for the Future

7|26|17   |   5:47   |   (10) comments


AT&T is focused on the software-defined network of the future and is reskilling its workforce to get ready too, according to AT&T's President of Technology Development Melissa Arnoldi.
Women in Comms Introduction Videos
Cisco: Mentoring Critical to Attract & Retain Women

7|19|17   |   6:40   |   (1) comment


Liz Centoni, senior vice president and general manager of Cisco's Computing System Product Group, shares why mentoring in all its forms is important for women and what Cisco is doing that's made a difference for women in tech.
LRTV Custom TV
Gigabit LTE With Snapdragon 835

7|12|17   |     |   (1) comment


At an event in Wembley stadium, EE used its live network to demonstrate gigabit LTE using a Sony Xperia XZ Premium smartphone with a Qualcomm Snapdragon 835 chip.
LRTV Custom TV
Implementing Machine Intelligence With Guavus

7|12|17   |     |   (0) comments


Guavus unites big data and machine intelligence, enabling many of the the largest service providers in the world to save money and drive measureable revenue. Learn how applying Machine Intelligence substantially reduces operational costs and in many cases can eliminate subscriber impact, meaning a better subscriber experience and higher NPS.
Upcoming Live Events
September 28, 2017, Denver, CO
October 18, 2017, Colorado Convention Center - Denver, CO
November 1, 2017, The Royal Garden Hotel
November 1, 2017, The Montcalm Marble Arch
November 2, 2017, 8 Northumberland Avenue, London, UK
November 30, 2017, The Westin Times Square
All Upcoming Live Events
Infographics
With the mobile ecosystem becoming increasingly vulnerable to security threats, AdaptiveMobile has laid out some of the key considerations for the wireless community.
Hot Topics
AT&T Spreads Fiber & G.fast Wings
Alan Breznick, Cable/Video Practice Leader, Light Reading, 8/22/2017
Why AT&T May Dump Home Security Biz
Mari Silbey, Senior Editor, Cable/Video, 8/21/2017
Verizon & Friends Bust Through Gigabit LTE in the Lab
Dan Jones, Mobile Editor, 8/21/2017
Disney, iflix Team Up to Take Down Netflix
Aditya Kishore, Practice Leader, Video Transformation, Telco Transformation, 8/22/2017
WiCipedia: Dolly Babes, Manifesto Backlash & 'Brotastic' Failures
Eryn Leavens, Special Features & Copy Editor, 8/18/2017
Like Us on Facebook
Twitter Feed
Animals with Phones
Talk About a Custom-Made Workstation! Click Here
Proper ergonomics indeed.
Live Digital Audio

Understanding the full experience of women in technology requires starting at the collegiate level (or sooner) and studying the technologies women are involved with, company cultures they're part of and personal experiences of individuals.

During this WiC radio show, we will talk with Nicole Engelbert, the director of Research & Analysis for Ovum Technology and a 23-year telecom industry veteran, about her experiences and perspectives on women in tech. Engelbert covers infrastructure, applications and industries for Ovum, but she is also involved in the research firm's higher education team and has helped colleges and universities globally leverage technology as a strategy for improving recruitment, retention and graduation performance.

She will share her unique insight into the collegiate level, where women pursuing engineering and STEM-related degrees is dwindling. Engelbert will also reveal new, original Ovum research on the topics of artificial intelligence, the Internet of Things, security and augmented reality, as well as discuss what each of those technologies might mean for women in our field. As always, we'll also leave plenty of time to answer all your questions live on the air and chat board.