Facebook Releases Data Center Tech
SAN JOSE, Calif. -- OCP U.S. Summit 2015 -- Network operators looking to buy or build technology Facebook uses to run its massive data centers will get their wish.
Facebook designs its own switches, racks and networking software to achieve the hyperscale needs of its global service. Now, Facebook says it's opening up key networking and data center technologies. These include its Wedge switch, board management software, and a server it's calling Yosemite.
Why is Facebook making all this technology public, rather than keeping it as proprietary jewels? In a word, collaboration. Facebook wants "to work with not just the best minds under one roof, but the best minds in the world -- and that's where the Open Compute Project [OCP] comes in," the company said in a post on its blog.
The OCP, an independent nonprofit launched by Facebook in 2011, works in conjunction with thousands of participants and 200 companies to develop open source data center hardware designs.
Facebook uses OCP designs to power its services. Its new Altoona, Iowa, data center, which went online in November, is 100% OCP gear, Facebook engineering VP Jay Parikh said in a presentation here.
Facebook's OCP bet has big stakes. The company's data centers support 1.39 billion users on Facebook itself, with 500 million using Facebook Messages and 300 million users on Instagram.
With that kind of workload, efficiency was essential. "We had this approach of working on efficiency from the get-go," Parikh said.
Facebook has saved over $2 billion over the past three years using OCP technology. Power saved is the equivalent of 80,000 homes per year, with reduced carbon equivalent to taking 95,000 cars off the road annually, Parikh said.
Disaggregation has been key to improved efficiency. "Break down building blocks to small components and use the components to build rapidly what you need in the business," Parikh said.
For example, the Facebook News Feed -- the rapidly updating stream of friends' activity that every Facebook user sees when they log in -- is complicated and resource intensive.
Multifeed is a distributed backend system involved in News Feed. When a person visits their Facebook feed, "Multifeed looks up the user's friends, finds all their recent actions, and decides what should be rendered," the company said in a blog post.
Previously, Facebook put Multifeed components on a single server. But as the algorithms deciding what content to put in the feed got more sophisticated and content got richer, putting those components together on a single server wasn't working. Now, by splitting the components Facebook can optimize threading and memory management. As the Facebook product evolves, it can adjust the ratio of server types without wasting computing resources, Parikh says.
And now Facebook is opening key technologies to the public.
Specifically, Facebook wants to contribute the specs of its top-of-rack Wedge switch to the OCP. The OCP will need to decide whether to accept the specs. (See Facebook in Production Testing of Open 'Wedge' Switch.)
Network operators that don't want to build Wedge switches for themselves can buy the kit off-the-shelf. Accton Technology Corp. plans to sell Wedge switches in the first half of of the year. And Cumulus Networks and Big Switch Networks will support the hardware with their SDN software.
Facebook also released OpenBMC, open low-level board management software to speed up feature development for BMC chips. Wedge will be the first hardware supporting OpenBMC, followed by Facebook's 6-pack switch.
And Facebook introduced the FBOSS Agent, opening the central library of its FBOSS Wedge software. The agent is built on the Broadcom Corp. (Nasdaq: BRCM) OpenNSL Library to program the Broadcom ASIC inside Wedge.
Additionally, Facebook introduced Yosemite, a system-on-a-chip compute server to dramatically increase speed and serve Facebook traffic more efficiently. It "supports four independent servers at a performance-per-watt superior to traditional data center servers for heavily parallelizable workloads," Facebook said.
Facebook's homebrew hardware and software drives staggering amounts of traffic, and will help services providers meet their customers' demands. It'll be interesting to see what other hardware and software Facebook develops and makes available, and how much competitive pressure that will put on networking and IT vendors.