New Open Workgroup to Accelerate Edge Computing

Simon Stanley
Heavy Lifting Analyst Notes
Simon Stanley

Edge computing, artificial intelligence, machine learning and security are all applications that are important for cloud and networking service providers and can benefit from domain-specific accelerators.

Domain-specific accelerators are silicon-on-chip (SoC) devices that are optimized to deliver cost-effective acceleration of specific applications and networking functions.

The Open Domain-Specific Accelerator (ODSA) Workgroup is an industry initiative driven by seven leading silicon companies to develop an open architecture for domain-specific accelerators. This could dramatically increase the range of opportunities for service providers to accelerate edge computing and related applications.

The bandwidth demands on server processors has significantly outgrown the increases in CPU performance during the past few years. Domain-specific accelerators such as SmartNICs, machine learning/inference coprocessors and security processors can be used to offload processing from CPU cores. This can significantly increase application performance and release additional CPU cores for other revenue-earning workloads or allow the use of less powerful, and significantly lower-cost, processors in edge computing applications. To deliver the best benefits, these accelerators should integrate best-of-breed components including processors, hardware engines, memory and I/O peripherals.

The shift to smaller silicon geometries has enabled larger SoC devices with big caches and many cores but each new silicon technology generation requires huge investment and can result in significantly higher development and die costs. This is becoming a key issue for the development of SoC devices using the 7nm technology that has recently started in volume production. This is causing even the largest semiconductor companies to look at alternatives to a monolithic SoC design for all but the highest-volume applications.

Chiplets are silicon die for subsystem components that can provide an alternative to monolithic SoC design. The chiplets are mounted on a multi-chip module (MCM) which can be configured for different SoC requirements. Chiplets have been widely used where SoC blocks are developed on different silicon technology, for example where you have an analog interface block and a DSP or a processor. Chiplets are also increasingly being used to provide modular solutions. Recent examples using chiplets are the AMD EPYC processors, the Marvell MoChifmodular SOC architecture developed for smartphone applications and high-bandwidth memory (HBM) using 3D stack memory blocks with an interposer.

Most chiplets have, to date, been used in closed development environments where the SoC developer defines all the interfaces and the functionality, and, in many cases, has also developed the chiplets. An open chiplets ecosystem will enable wider use of chiplets and accelerate SoC development, as MCMs are quicker to develop than monolithic SoCs.

The ODSA reference architecture, which is nearing completion, defines common component chiplets and a switching and interface chiplet to which all the other chiplets are connected. The reference architecture will support a communication agent protocol stack to implement inter-die networking. The network infrastructure offers a memory model and performance that is designed to be comparable to a monolithic architecture.

Open domain-specific accelerators and the ODSA reference architecture were discussed during a recent Light Reading webinar that featured speakers from Netronome and Avera Semiconductor (formerly Global Foundries ASIC). In polls conducted during the webinar, 50% of respondents said they were working on domain-specific accelerator solutions now, or would need solutions within one to two years, and almost 30% said their primary application was edge computing. An archive of the webinar -- Open Domain-Specific Accelerators: What Are They & Why Should They Matter to Cloud & Network Providers? -- can be found on the Light Reading website and is free for anyone to access (registration required).

The webinar is based on a white paper produced by Heavy Reading and sponsored by Netronome.

Open specifications are key to a strong chiplets ecosystem and will enable a wider range of domain-specific accelerators for many applications, including edge computing. The ODSA architecture and related specifications will help the development of the chiplets with open interfaces and a common protocol stack that are required to build a strong ecosystem. If you wish to help build this ecosystem, or partner with the ODSA and its members, please contact [email protected] or come to the ODSA Workshop in Santa Clara, CA, on January 29, 2019. For more information, visit:

This article was sponsored by Netronome.

— Simon Stanley, Analyst at Large, Heavy Reading

(0)  | 
Comment  | 
Print  | 
Newest First  |  Oldest First  |  Threaded View        ADD A COMMENT
More Blogs from Heavy Lifting Analyst Notes
Enterprises and other organizations want to operate private mobile networks, but what are their options for getting the needed spectrum?
For the first time, Light Reading will offer two breakfast roundtables on key tech topics at this fall's SCTE|ISBE Cable-Tec Expo in New Orleans – the first on network virtualization and the second on cable and 5G.
As a keen OSS-BSS observer, I like to parse financial disclosures to gauge the health of the market.
For any operator, revamping an entire business support system (BSS) architecture in just six months and cutting IT opex by 80% as a result is a notable achievement.
Dedicated 5G campus networks, designed to meet the coverage, performance and security requirements of industrial users, are one of the most exciting – and tangible – advanced 5G use-cases under development.
Featured Video
Upcoming Live Events
September 17-19, 2019, Dallas, Texas
October 1-2, 2019, New Orleans, Louisiana
October 10, 2019, New York, New York
October 22, 2019, Los Angeles, CA
November 5, 2019, London, England
November 7, 2019, London, UK
November 14, 2019, Maritim Hotel, Berlin
December 3-5, 2019, Vienna, Austria
December 3, 2019, New York, New York
March 16-18, 2020, Embassy Suites, Denver, Colorado
May 18-20, 2020, Irving Convention Center, Dallas, TX
All Upcoming Live Events