& cplSiteName &

Facebook Slashes Data Center Power Consumption

Mitch Wagner
8/8/2014
50%
50%

Facebook is developing a new traffic management technology called Autoscale to optimize energy consumption by 10-15% at its data centers.

Facebook currently uses a traditional round-robin approach to load balancing, but found that was less than optimal, because servers running low-level loads use power more inefficiently than idle servers or servers running at moderate or greater loads, writes Qiang Wu, Facebook infrastructure software engineer, on the Facebook Code Engineering Blog.

Autoscale is designed to optimize workloads so that servers are either idling, or running at medium capacity. It tries to avoid assigning workloads in a way that results in servers running at low capacity, Wu writes.

An idle server consumes about 60 watts. It takes a big power hit, to 130 watts, when it jumps to low-level CPU utilization, for a small number of requests per second. But it only takes a small power hit, to 150 watts, when it goes from low-level to medium-level CPU utilization, Wu writes.

Therefore, from a power-efficiency perspective, we should try to avoid running a server at low RPS and instead try to run at medium RPS.

To tackle this problem and utilize power more efficiently, we changed the way that load is distributed to the different web servers in a cluster. The basic idea of Autoscale is that instead of a purely round-robin approach, the load balancer will concentrate workload to a server until it has at least a medium-level workload. If the overall workload is low (like at around midnight), the load balancer will use only a subset of servers. Other servers can be left running idle or be used for batch-processing workloads.

Though the idea sounds simple, it is a challenging task to implement effectively and robustly for a large-scale system.

Autoscale dynamically adjusts the size of the server pool in use, so that each active server will get at least a medium-level CPU load. Servers not in the active pool don't receive traffic.


Power up your data center knowledge on Light Reading's data center infrastructure channel


Optimizing both performance and power consumption was key in developing decision logic for traffic management: "On one hand, we want to maximize the energy-saving opportunity. On the other, we don't want to over-concentrate the traffic in a way that could affect site performance."

Results have been promising:

Autoscale led to a 27% power savings around midnight (and, as expected, the power saving was 0% around peak hours). The average power saving over a 24-hour cycle is about 10-15% for different web clusters.

Normalized power consumption for a production web cluster with and without Autoscale. Source: Facebook.
Normalized power consumption for a production web cluster with and without Autoscale. Source: Facebook.

Facebook is driving open source data center hardware design with its own Open Compute project. The project is self-serving -- Facebook runs among the most massive data centers in the world, and data center cost savings improves Facebook's bottom line. Facebook says it has saved $1.2 billion over three years using the Open Compute hardware designs it champions. (See Open Compute Project Takes on Networking.)

Earlier this week, Facebook bought PrivateCore, a security software company, to beef up its server security. (See Facebook Buys PrivateCore for Server Security.)

— Mitch Wagner, Circle me on Google+Follow me on TwitterVisit my LinkedIn profileFollow me on Facebook, West Coast Bureau Chief, Light Reading. Got a tip about SDN or NFV? Send it to wagner@lightreading.com.

(9)  | 
Comment  | 
Print  | 
Newest First  |  Oldest First  |  Threaded View        ADD A COMMENT
SachinEE
50%
50%
SachinEE,
User Rank: Light Sabre
8/12/2014 | 2:23:27 PM
Re: good news for Facebook
With the millions of users that Facebook has bagged over he years, it is good to know that they have found a way to improve their data centers. Facebook is used world wide and they make a lot of profit but this new occurrence will no doubt help them to cut costs and probably boost their earnings by a great percentage. It is a wonder that they did not do this sooner.
brooks7
50%
50%
brooks7,
User Rank: Light Sabre
8/11/2014 | 11:44:17 AM
Re: Not been done before ?
Dennis,

Note, that the applications that people like Amazon and Google do are diverse.  It may not be as easy to eliminate compute power in that environment.  Scaling computing and storage in those environments might have very different curves.

seven

 
mendyk
50%
50%
mendyk,
User Rank: Light Sabre
8/11/2014 | 11:39:05 AM
Re: Not been done before ?
Maybe they have but choose not to crow about it. Or maybe they haven't. The point of the story was to highlight what FB is doing to improve its efficiency and margins.
Whatdoyouwant
50%
50%
Whatdoyouwant,
User Rank: Light Beer
8/11/2014 | 11:31:47 AM
Re: Not been done before ?
I meant by the industry in general.  Google, Yahoo, Amazon, etc..   none of these guys have figured this out ?
mendyk
50%
50%
mendyk,
User Rank: Light Sabre
8/11/2014 | 10:36:51 AM
Re: Not been done before ?
When your growth is in triple digits, you don't worry so much about sweating down costs. That comes with maturity. Now that Facebook is a public company, it has to focus more on stuff like margins.
Whatdoyouwant
50%
50%
Whatdoyouwant,
User Rank: Light Beer
8/11/2014 | 9:46:42 AM
Not been done before ?
Is it me or does this seem like something that would have been done a long time ago ?
danielcawrey
50%
50%
danielcawrey,
User Rank: Light Sabre
8/9/2014 | 6:31:59 PM
Re: Something good from Facebook
I did not realize that the optimum power consumption for a server instance was at medium level capacity. This is really useful - something that hardware designers and cloud service providers should usel to optimize machines and cut costs.

More and more services are being powered through the cloud - which means there is huge opportunity to slash operating expenses. 
thebulk
50%
50%
thebulk,
User Rank: Light Sabre
8/9/2014 | 11:36:47 AM
Re: Something good from Facebook
Just think of the cost they are cutting with this! It really is impressive. 
mendyk
50%
50%
mendyk,
User Rank: Light Sabre
8/9/2014 | 9:01:31 AM
Something good from Facebook
Congratulations to Facebook for figuring out how to make its data centers more efficient. Do you think there's a similar potential for energy cost savings for network operators that deploy virtualization?
Educational Resources
sponsor supplied content
Educational Resources Archive
Light Reading’s Upskill U is a FREE, interactive, online educational resource that delivers must-have education on themes that relate to the overall business transformation taking place in the communications industry.
NEXT COURSE
Wednesday, September 14, 1:00PM EDT
What Is Agile?
Kent J. McDonald, Product Owner, Agile Alliance
UPCOMING COURSE SCHEDULE
Friday, September 16, 1:00PM EDT
How to Implement Agile
Alan Bateman, Director, Agile Transformation
Wednesday, September 21, 1:00PM EDT
What Is DevOps?
Colin Kincaid, CTO, Service Provider, Cisco
Friday, September 23, 1:00PM EDT
How to Implement DevOps
,
in association with:
From The Founder
Light Reading today starts a new voyage as part of a larger Enterprise.
Flash Poll
Live Streaming Video
Charting the CSP's Future
Six different communications service providers join to debate their visions of the future CSP, following a landmark presentation from AT&T on its massive virtualization efforts and a look back on where the telecom industry has been and where it's going from two industry veterans.
Between the CEOs
CEO Chat: UXP Systems' Gemini Waghmare

8|26|16   |     |   (0) comments


Light Reading CEO Steve Saunders and UXP Systems CEO Gemini Waghmare discuss the strategic importance of digital identity for operators in the midst of transformation.
LRTV Custom TV
F5 Virtual Network Function Integrations With Partner Orchestration Platform

8|24|16   |   6:38   |   (0) comments


F5's Kishore Patnam, product manager for F5's service provider solutions, discusses why service providers are moving towards virtualization and how his clients are utilizing F5's solutions.
Between the CEOs
CEO Chat: Intel's Alexis Black Bjorlin

8|17|16   |   06:23   |   (0) comments


Join us for an in-depth interview between Steve Saunders of Light Reading and Alexis Black Bjorlin of Intel as they discuss the release of the company's Silicon Photonics platform, its performance, long-term prospects, customer expectations and much more.
Telecom Innovators Video Showcase
Accelerating Telecom Digital Transformation With Nominum DNS

8|1|16   |   12:04   |   (0) comments


Light Reading's Steve Saunders gets an update from Nominum CEO Gary Messiana on how his company is helping carriers on the digital transformation journey.
LRTV Custom TV
Reinventing Operations for a Virtual, Software-Defined World

7|28|16   |   5:23   |   (0) comments


Heavy Reading Senior Analyst Jim Hodges speaks with Accenture's Larry Socher and Matt Anderson about what service providers must do to transform their business to get the benefits of SDN and NFV including: leveraging DevOps, introducing real-time OSS and implementing analytics.
Women in Comms Introduction Videos
Fujitsu Sales Leader Shares Lessons Learned

7|27|16   |   5:12   |   (1) comment


As Fujitsu's only female sales leader, Annie Bogue knows the importance of asking for what you want, being flexible (she's been relocated five times), keeping a meticulous calendar, 'leaning in,' working harder than everyone else around you, being aware and more.
Telecom Innovators Video Showcase
VeEX Test & Measurement Solutions

7|25|16   |   08:57   |   (0) comments


Cyrille Morelle, president and CEO of VeEX Inc., talks test and measurement with Light Reading's Steve Saunders at BCE 2016. This includes innovative products such as VeSion Cloud-Based platform for network monitoring; MTTplus Modular Test platform for Access, Business, Carrier Ethernet, Transport and Core services; and OPX-BOX+ for Fiber Optics.
LRTV Custom TV
VeEX: Live From BCE 2016

7|25|16   |   03:20   |   (0) comments


VeEX's Senior Director of Business Development, Perry Romano, explains how VeEX provides tools to help install, maintain, monitor and manage network infrastructure efficiently and effectively. The portfolio of products on display include the RXT-6000, MTTplus and TX300s.
LRTV Custom TV
Real-Time Telemetry & Analytics for Intelligent SDN Orchestration

7|25|16   |   03:09   |   (0) comments


Packet Design CEO Scott Sherwood discusses how real-time network telemetry and analytics are enabling a new breed of SDN orchestration applications.
From the Founder
The Russo Report: Driving Disruption

7|25|16   |   07:44   |   (2) comments


In the first episode of a four-part series, Light Reading Founder and CEO Steve Saunders and Calix President and CEO Carl Russo drive around town discussing the disruptive mega-changes in the communications industry and where hope lies for service providers to meet the escalating demands of the cloud.
LRTV Custom TV
NetScout: Maximizing Enterprise Cloud for Digital Transformation

7|20|16   |   04:53   |   (0) comments


Light Reading Editor Mitch Wagner talks to NetScout CMO Jim McNiel about maximizing the benefits of enterprise cloud and digital transformation while minimizing potential pitfalls with a proper monitoring and instrumentation strategy.
Women in Comms Introduction Videos
Ciena's VP Offers a Career Crash Course

7|20|16   |   4:14   |   (2) comments


How did Ciena's Vice President of Sales, Angela Finn, carve out her career path? Simple, she tells WiC. She stayed true to her company, customers and principles. She shares her advice for women on how to be authentic and credible, as well as for companies that want to make a real change to their culture and practices.
Upcoming Live Events
September 13-14, 2016, The Curtis Hotel, Denver, CO
November 3, 2016, The Montcalm Marble Arch, London
November 30, 2016, The Westin Times Square, New York City
December 1, 2016, The Westin Times Square, New York, NY
December 6-8, 2016, The Westin Excelsior, Rome
May 16-17, 2017, Austin Convention Center, Austin, TX
All Upcoming Live Events
Infographics
Hot Topics
Cisco Developing 'Monica' Digital Assistant
Mitch Wagner, West Coast Bureau Chief, Light Reading, 8/22/2016
FirstNet: A Billion-Dollar Boondoggle?
Dan Jones, Mobile Editor, 8/26/2016
WiCipedia: Should Men Be Included? & Olympians Face Discrimination
Eryn Leavens, Special Features & Copy Editor, 8/26/2016
Google Fiber Can't Be Called a Failure
Carol Wilson, Editor-at-large, 8/26/2016
Google Fiber Downsizing Not Confirmed
Mari Silbey, Senior Editor, Cable/Video, 8/25/2016
Like Us on Facebook
Twitter Feed
BETWEEN THE CEOs - Executive Interviews
Light Reading CEO Steve Saunders and UXP Systems CEO Gemini Waghmare discuss the strategic importance of digital identity for operators in the midst of transformation.
Join us for an in-depth interview between Steve Saunders of Light Reading and Alexis Black Bjorlin of Intel as they discuss the release of the company's Silicon Photonics platform, its performance, long-term prospects, customer expectations and much more.
Animals with Phones
Live Digital Audio

Bridging the tech skills gap is a major challenge for service providers and suppliers alike today – and the challenge is two-fold when it comes to increasing the number of women in the comms space. Level 3 Communications has made it a priority to overcome both challenges by implementing several unique programs focused on building the right candidates from within – in addition to filling the funnel by supporting STEM and other education programs. During this radio show, you’ll learn about these programs from Mary Beth McGrath, SVP of Global Talent Management at Level 3, and the best ways to bridge your own skills gap so that you are motivated and equipped for change. Plus you’ll have the chance to ask Mary Beth your questions live on the air.