Light Reading

Facebook Slashes Data Center Power Consumption

Mitch Wagner
8/8/2014
50%
50%

Facebook is developing a new traffic management technology called Autoscale to optimize energy consumption by 10-15% at its data centers.

Facebook currently uses a traditional round-robin approach to load balancing, but found that was less than optimal, because servers running low-level loads use power more inefficiently than idle servers or servers running at moderate or greater loads, writes Qiang Wu, Facebook infrastructure software engineer, on the Facebook Code Engineering Blog.

Autoscale is designed to optimize workloads so that servers are either idling, or running at medium capacity. It tries to avoid assigning workloads in a way that results in servers running at low capacity, Wu writes.

An idle server consumes about 60 watts. It takes a big power hit, to 130 watts, when it jumps to low-level CPU utilization, for a small number of requests per second. But it only takes a small power hit, to 150 watts, when it goes from low-level to medium-level CPU utilization, Wu writes.

Therefore, from a power-efficiency perspective, we should try to avoid running a server at low RPS and instead try to run at medium RPS.

To tackle this problem and utilize power more efficiently, we changed the way that load is distributed to the different web servers in a cluster. The basic idea of Autoscale is that instead of a purely round-robin approach, the load balancer will concentrate workload to a server until it has at least a medium-level workload. If the overall workload is low (like at around midnight), the load balancer will use only a subset of servers. Other servers can be left running idle or be used for batch-processing workloads.

Though the idea sounds simple, it is a challenging task to implement effectively and robustly for a large-scale system.

Autoscale dynamically adjusts the size of the server pool in use, so that each active server will get at least a medium-level CPU load. Servers not in the active pool don't receive traffic.


Power up your data center knowledge on Light Reading's data center infrastructure channel


Optimizing both performance and power consumption was key in developing decision logic for traffic management: "On one hand, we want to maximize the energy-saving opportunity. On the other, we don't want to over-concentrate the traffic in a way that could affect site performance."

Results have been promising:

Autoscale led to a 27% power savings around midnight (and, as expected, the power saving was 0% around peak hours). The average power saving over a 24-hour cycle is about 10-15% for different web clusters.

Normalized power consumption for a production web cluster with and without Autoscale. Source: Facebook.
Normalized power consumption for a production web cluster with and without Autoscale. Source: Facebook.

Facebook is driving open source data center hardware design with its own Open Compute project. The project is self-serving -- Facebook runs among the most massive data centers in the world, and data center cost savings improves Facebook's bottom line. Facebook says it has saved $1.2 billion over three years using the Open Compute hardware designs it champions. (See Open Compute Project Takes on Networking.)

Earlier this week, Facebook bought PrivateCore, a security software company, to beef up its server security. (See Facebook Buys PrivateCore for Server Security.)

— Mitch Wagner, Circle me on Google+Follow me on TwitterVisit my LinkedIn profileFollow me on Facebook, West Coast Bureau Chief, Light Reading. Got a tip about SDN or NFV? Send it to wagner@lightreading.com.

(9)  | 
Comment  | 
Print  | 
Newest First  |  Oldest First  |  Threaded View        ADD A COMMENT
SachinEE
50%
50%
SachinEE,
User Rank: Light Sabre
8/12/2014 | 2:23:27 PM
Re: good news for Facebook
With the millions of users that Facebook has bagged over he years, it is good to know that they have found a way to improve their data centers. Facebook is used world wide and they make a lot of profit but this new occurrence will no doubt help them to cut costs and probably boost their earnings by a great percentage. It is a wonder that they did not do this sooner.
brooks7
50%
50%
brooks7,
User Rank: Light Sabre
8/11/2014 | 11:44:17 AM
Re: Not been done before ?
Dennis,

Note, that the applications that people like Amazon and Google do are diverse.  It may not be as easy to eliminate compute power in that environment.  Scaling computing and storage in those environments might have very different curves.

seven

 
mendyk
50%
50%
mendyk,
User Rank: Light Sabre
8/11/2014 | 11:39:05 AM
Re: Not been done before ?
Maybe they have but choose not to crow about it. Or maybe they haven't. The point of the story was to highlight what FB is doing to improve its efficiency and margins.
Whatdoyouwant
50%
50%
Whatdoyouwant,
User Rank: Light Beer
8/11/2014 | 11:31:47 AM
Re: Not been done before ?
I meant by the industry in general.  Google, Yahoo, Amazon, etc..   none of these guys have figured this out ?
mendyk
50%
50%
mendyk,
User Rank: Light Sabre
8/11/2014 | 10:36:51 AM
Re: Not been done before ?
When your growth is in triple digits, you don't worry so much about sweating down costs. That comes with maturity. Now that Facebook is a public company, it has to focus more on stuff like margins.
Whatdoyouwant
50%
50%
Whatdoyouwant,
User Rank: Light Beer
8/11/2014 | 9:46:42 AM
Not been done before ?
Is it me or does this seem like something that would have been done a long time ago ?
danielcawrey
50%
50%
danielcawrey,
User Rank: Light Sabre
8/9/2014 | 6:31:59 PM
Re: Something good from Facebook
I did not realize that the optimum power consumption for a server instance was at medium level capacity. This is really useful - something that hardware designers and cloud service providers should usel to optimize machines and cut costs.

More and more services are being powered through the cloud - which means there is huge opportunity to slash operating expenses. 
thebulk
50%
50%
thebulk,
User Rank: Light Sabre
8/9/2014 | 11:36:47 AM
Re: Something good from Facebook
Just think of the cost they are cutting with this! It really is impressive. 
mendyk
50%
50%
mendyk,
User Rank: Light Sabre
8/9/2014 | 9:01:31 AM
Something good from Facebook
Congratulations to Facebook for figuring out how to make its data centers more efficient. Do you think there's a similar potential for energy cost savings for network operators that deploy virtualization?
Educational Resources
sponsor supplied content
Educational Resources Archive
Flash Poll
From The Founder
Anshul Sadana answers questions from Steve Saunders, Light Reading's founder and CEO, about Arista's CloudVision, a global cloud network controller for workload orchestration and workflow automation delivering a turnkey solution for cloud networking.
Live Streaming Video
CLOUD / MANAGED SERVICES: Prepping Ethernet for the Cloud
Moderator: Ray LeMaistre Panelists: Jeremy Bye, Leonard Sheahan
LRTV Custom TV
End-User or Enterprise Benefits to the New IP

7|30|15   |   04:27   |   (0) comments


Andrew Coward discusses what the New IP means to end users or enterprise customers. He explains compelling reasons, including how every customer can get their own network, from the transformation to the New IP.
LRTV Custom TV
Network Visibility & the New IP

7|30|15   |   02:23   |   (0) comments


Mukund Srigopal provides an explanation of what network visibility is and how it is essential as service providers transition to the New IP. In addition, the importance of the network packet broker is discussed.
Between the CEOs
Video Exclusive With Basil Alwan, Alcatel-Lucent

7|24|15   |   26:44   |   (5) comments


Basil Alwan, President of IP Routing & Transport at Alcatel-Lucent, discusses virtualization, cultural challenges, the capex crunch and more with Light Reading founder and CEO Steve Saunders.
LRTV Custom TV
VDF: Enable the Financial With Mobile Money

7|20|15   |   06:53   |   (0) comments


Ian Ravenscroft discusses how operators can expand to occupy the entire digital services value chain through service innovation.
LRTV Custom TV
Telefónica on OSS Transformation

7|20|15   |   06:01   |   (0) comments


Jose Gonzales discusses the details of Telefónica's operation transformation program.
LRTV Custom TV
Judi Achmadi on Huawei's Cloud Storage Solution

7|20|15   |   03:33   |   (0) comments


Judi discusses the key business goals of TelekomSigma's public cloud service and how Huawei's solution helps them address challenges.
LRTV Custom TV
KPN Enlightening Digital Business & IT Transformation

7|20|15   |   06:19   |   (0) comments


Rob de Beer discusses the changes that operators need to make with service innovation now coming from the Internet world.
LRTV Custom TV
Stratus Telco-Grade Cloud Solutions & NFV

7|20|15   |   07:34   |   (0) comments


Ali Kafel from Stratus Technologies addresses high-availability concerns within the telco industry with a solution that enables telcos to provide high-availability and stateful fault-tolerance using a software-based approach.
LRTV Documentaries
The Six Million Dollar Business Man

7|20|15   |   01:52   |   (0) comments


Steve Saunders, publisher. A man barely alive after an acquisition malfunction imploded the company he founded. Gentlemen, we can rebuild Light Reading. Better, faster, stronger.
Between the CEOs
CEO Chat With Anukool Lakhina, Guavus

7|20|15   |   38:51   |   (1) comment


Guavus CEO Anukool Lakhina talks to Light Reading founder and CEO Steve Saunders about the role of operational analytics in the communications services and networking sectors, particularly in relation to IoT.
LRTV Custom TV
IBM's Flash Storage With Intel QuickAssist

7|20|15   |   03:18   |   (0) comments


Intel's Bev Crair and IBM's Eric Herzog discuss how IBM's V9000 Flash Storage System has helped customers around the world. Featuring real-time compression powered by Intel QuickAssist Technology, the V9000 is a next-gen flash storage solution.
LRTV Huawei Video Resource Center
Thailand's AIS: Transforming to an FMC Operator

7|17|15   |   4:53   |   (0) comments


Saran Phaloprakarn, Senior VP of Fixed Broadband Business Management of Thailand's AIS, was a keynote speaker at the first Asia-Pacific Ultra Broadband Summit in Bangkok. In this video, he talks to Heavy Reading about transforming into an FMC (FBB+MBB+Content) operator.
Upcoming Live Events
September 16-17, 2015, The Westin Galleria Dallas, Dallas, TX
September 16, 2015, The Westin Galleria Dallas, Dallas, TX
September 16, 2015, The Westin Galleria Dallas, Dallas, TX
September 29-30, 2015, The Westin Grand Müchen, Munich, Germany
October 14-15, 2015, New Orleans Ernest N. Morial Convention Center, New Orleans, LA
November 5, 2015, Hilton Santa Clara, Santa Clara, CA
November 17, 2015, Santa Clara, California
December 1, 2015, The Westin Times Square, New York City
All Upcoming Live Events
Infographics
Network operators start seeing savings from NFV in the first year, according to a study by Affirmed Networks and ACG.
Hot Topics
Robbins Succeeds Chambers as Cisco Changes CEOs
Mitch Wagner, West Coast Bureau Chief, Light Reading, 7/27/2015
RJio to Launch Its Own 4G Devices Brand
Gagandeep Kaur, Contributing Editor, 7/27/2015
Qualcomm Wants FCC to Stay Out of LTE-U Fray
Sarah Thomas, Editorial Operations Director, 7/27/2015
Silence Like Diamonds – Episode 2: Warning Shot
John Barnes, Author, 7/28/2015
Like Us on Facebook
Twitter Feed
September 22, 2015
Media Begins With “Me”
Webinar Archive
BETWEEN THE CEOs - Executive Interviews
Basil Alwan, President of IP Routing & Transport at Alcatel-Lucent, discusses virtualization, cultural challenges, the capex crunch and more with Light Reading founder and CEO Steve Saunders.
Guavus CEO Anukool Lakhina talks to Light Reading founder and CEO Steve Saunders about the role of operational analytics in the communications services and networking sectors, particularly in relation to IoT.
Cats with Phones
Comes With Free Phone Stand Click Here
Who says cats don't have any skills?