Light Reading
400Gbit/s bandwidth granularity is not only feasible, but already useful today.

The 400Gbit/s Demonstrator

Eduard Beier
8/21/2013
100%
0%

A collaboration between research institutions and industrial partners demonstrated at the ISC'13 that 400Gbit/s bandwidth granularity is not only feasible, but already useful today.

For demonstration purposes a number of innovative technologies such as 400Gbit/s DWDM Super Channel, high-speed flash memory and a distributed parallel file system are used in combination.

The project is set up to have real data and realistic applications instead of yet another "hero experiment" with test generators and analyzers. Initial performance tests were performed to check the operational condition of all components working together in the demonstrator. Synthetic data and load was put on the connectivity and IT components and showed overall good operational conditions.

Then two applications were activated on the demonstrator:

  • Climate Research with centralized computing accessing to distributed data

  • Turbine Development with multi-stage processing dynamically both shifting big-data between Munich and Dresden (620km standard fiber) over a single 400Gbit/s wavelength Super Channel.

    From the research community are involved: the German Centre for Aerospace (DLR); the Leibniz Supercomputing Centre (LRZ); the Max Planck Institute for Meteorology (MPI-M) from the Max Planck Society and the computing center of the Max Planck Society in Garching (RZG); the computer center of the Technical University of Freiberg (RZ TUBAF); and the Center for Information Services and High Performance Computing Dresden University of Technology (ZIH).

    Industrial partners are: Alcatel-Lucent (NYSE: ALU), Barracuda Networks Inc. , Bull SA , Cluster Vision, EMC2, IBM Corp. (NYSE: IBM), Mellanox Technologies Ltd. (Nasdaq: MLNX), Deutsche Telekom AG (NYSE: DT), and T-Systems International GmbH .

    The fundamental network structure of the Demonstrator is shown by the following picture:

    Network Structure

    The compute clusters on both sides are clients of the distributed parallel file system which consists of 12 servers with three flash memory boards in each server. Both clusters are able to read and write at 400 Gbit/s on that file system.

    Standard Sandy Bridge servers with at least five PCIe3.0x8 slots and 128GB DRAM are used. The design goal was to create about 18 GBytes of sustained duplex data rate per node (Ethernet: 5GBytes, Memory: 6 GBytes, Fabric: 7 GBytes). The Fabric data rate has not yet been tested, the other rates have been confirmed by tests.

    For performance margin reasons the setup is moderately overbooked between memory and network. Below are the total theoretical performance numbers.

    Theoretical Throughput

    The predecessor project in 2010 (100Gbit/s Testbed Dresden Freiberg) required arrays of about 800 spinning disks on each side to form a 100Gbit/s data path. Because that setup was, for scaling reasons, not possible for 400 Gbit/s, the 2 GBytes I/O throughput flash memory board is one of the enablers of this 400Gbit/s project.

    For the ISC configuration (in the picture below), the following systems were added: a 10GbE Cluster in Dresden; a 2x100GbE link to Freiberg (not connected during ISC); in Garching the SuperMUC at LRZ (one of the fastest supercomputers in Europe) and a 480 GBytes cluster (> 2500 cores) at RZG; and a commercial Cloud Service from T-Systems (not connected during ISC).

    The Big Picture

    The project links to SDN and NFV -- in particular as it is very active in NSI (Network-to-Service-Interface) definition. (For further information, see the link below to additional project information).

    Because the "distributed high speed GPFS" approach is of some universal nature (e.g. for HPC datacenter backup and HPC workload distribution reasons) the setup will be tested for commercial applicability during the post ISC phase. The possibility to use network functions like encryption, firewalling and data compression is definitely a must in a commercial case.

    Network appliances for 40 Gbit/s and 100 Gbit/s are neither available nor would they be affordable in many cases. Therefore we are going to test virtualized network functions on standard server hardware (see picture below); that additional "module," which is based on the same server hardware as the other servers, gets in between each server and the router on each side.

    NFV Module

    Please feel free to ask questions about any technical aspect of the project. The project team, which consists of some of the best specialists on their individual field, will be happy to answer. For additional project information: http://tu-dresden.de/zih/400gigabit.

    The Partners

    — Eduard Beier, process systems engineer, T-Systems International

    (6)  | 
    Comment  | 
    Print  | 
  • Newest First  |  Oldest First  |  Threaded View
    RolfSperber
    50%
    50%
    RolfSperber,
    User Rank: Light Beer
    9/26/2013 | 10:11:00 AM
    Re: SDN and NFV
    Ray, we are at a very early stage, but abstracting from both hardware (and in consequence IOS) layer and utilizing a common framework (see NSI WG in OGF) and at the same time allow for docking of virtalized network functions will work for multi vendor, multi carrier and multi domain. Still, its a long way to go!
    Ray@LR
    50%
    50%
    Ray@LR,
    User Rank: Blogger
    9/26/2013 | 7:51:13 AM
    Re: SDN and NFV
    Rolf

    You say it is not restricted to a single domain, but is it applicable in networks that traverse multiple infrastructures run and managed by multiple network operators?
    RolfSperber
    100%
    0%
    RolfSperber,
    User Rank: Light Beer
    9/25/2013 | 8:43:49 AM
    Re: Is this another route in for NFV?
    Requirements in industry will not be so different from those in R&D. Looking at the plans in the context of Horizon 2020 Puplic Private Partnership is a target of European efforts. Taking into account the cost of infrastructure and the prevailing attitude to pay as little as possible for utilization of infrastructure, more sophisticated multiplexing methods, and this include NFV, are inevitable.

    For network operators this scheme means significantly reduced time to market.
    RolfSperber
    100%
    0%
    RolfSperber,
    User Rank: Light Beer
    9/25/2013 | 8:36:55 AM
    SDN and NFV
    In this project we will be going a step further. Our plan is to create an environment that allows for creating a virtual network based on the requirements of either applications or  carrier provided network functionality. We will not be restricted to a single domain and connectivity, our target is a network created from building blocks out of a repository. These building blocks can be connectivity with certain quality parameters or virtualized network functions like e.g. firwall functionality, compression, encryption, accelleration.

     

     
    Eddie_
    50%
    50%
    Eddie_,
    User Rank: Blogger
    8/21/2013 | 3:00:47 PM
    Re: Is this another route in for NFV?
    NFV simply scales better than HW based approaches (if NFV tests in September show good results).

    A possible 2013 roadmap for the project:
    • fully SDN controlled network
    • 200GBit/s datapath
    • NFV in the data path 

    a possible 2014 roadmap for the project:
    • scale up to a 1TBit/s data path

    how else could you do that?

     

     

     

     

     
    Ray@LR
    50%
    50%
    Ray@LR,
    User Rank: Blogger
    8/21/2013 | 1:01:52 PM
    Is this another route in for NFV?
    Interesting that functions virtualization takes the place of appliances that are either too expensive to deploy or have not yet been created... is NFV going to help the R&D sector more than production network operatins in the early years?
    Educational Resources
    sponsor supplied content
    Educational Resources Archive
    More Blogs from Column
    There are three important questions service providers need to address for in-market and out-of-market expansion.
    Cablevision's new Freewheel WiFi service will offer 'unlimited data, talk and text' plus access to Cablevision hotspots for a smallish monthly fee, but is hotspot access worth the price?
    Space Division Multiplexing (SDM) technologies could help relieve future bottlenecks in communications networks.
    Small cells with advanced C-RAN capabilities create a new opportunity to meet wireless demand more economically and deliver the best possible user experience to subscribers.
    To get real customer visibility and to consistently deliver a higher quality experience, MNOs must have access to real-time location awareness.
    Flash Poll
    From The Founder
    It's clear to me that the communications industry is divided into two types of people, and only one is living in the real world.
    LRTV Huawei Video Resource Center
    Dr. Dong Sun Talks About Carriers' Digital Transformation & Huawei’s Telco OS

    1|29|15   |   6:28   |   (0) comments


    Dr. Dong Sun, Chief Architect of Digital Transformation Solutions at Huawei, discusses how telecom operators can become digital ecosystem enablers and deliver optimal user experiences that are in real-time, on-demand, all-online, DIY and social (ROADS).
    LRTV Huawei Video Resource Center
    Huawei's Chief Network Architect Talks about Network Experience & Operators’ Strategies

    1|29|15   |   3:39   |   (0) comments


    In the digital age, network experience has become the primary productivity especially for telecom operators. In this video, Wenshuan Dang, Huawei’s Chief Network Architect, discusses how carriers can tackle the challenge of infrastructure complexity in order to enhance business agility and improve user experience.
    LRTV Documentaries
    The Rise of Virtual CPE

    1|27|15   |   01:38   |   (3) comments


    As NFV strategies evolve from tests and trials to production telco networks, expect to hear a lot about virtual CPE (customer premises equipment) rollouts during 2015.
    LRTV Documentaries
    Optical Is Hot in 2015

    1|23|15   |   01:56   |   (2) comments


    Optical comms technology underpins the whole communications sector and there are some really hot trends set for 2015.
    LRTV Custom TV
    Policy Control in the Fast Lane

    1|22|15   |   2:57   |   (0) comments


    What's making policy control strategic in 2015 and beyond? Amdocs talks with Heavy Reading's Graham Finnie about the key factors driving change in the data services landscape. Find out what his policy management research reveals about the road ahead for policy control – and sign up for
    LRTV Documentaries
    Highlights From the 2020 Vision Executive Summit

    1|21|15   |   4:33   |   (2) comments


    In December 2014, Light Reading brought together telecom executives in Reykjavik, Iceland to discuss their vision for high-capacity networks through the end of the decade. The intimate, interactive meeting was set against the backdrop of Iceland's spectacular natural beauty. As one of the event's founding sponsors, Cisco's Doug Webster shared his company's ...
    LRTV Huawei Video Resource Center
    Huawei Pay-TV Partner Harmonic, Helping Carriers Accelerate 4K Video Deployment with Huawei

    1|20|15   |   5:42   |   (1) comment


    At IBC, Peter Alexander, Senior Vice President & CMO at Harmonic, speaks about the growing interest in pay-TV service and its branching into multiple devices.
    LRTV Huawei Video Resource Center
    Sony Marketing Director Olivier Bovis Discusses the Outlook for 4K and Cooperation With Huawei at IBC 2014

    1|20|15   |   6:50   |   (0) comments


    At IBC, Olivier Bovis, Marketing Director of Sony, speaks about the coming of the 4K era.
    LRTV Huawei Video Resource Center
    Huawei Pay-TV Partner Envivio, Helping Carriers Accelerate 4K Video Deployment

    1|20|15   |   2:57   |   (0) comments


    At IBC, Olivier Bovis, Marketing Director of Sony, speaks about the coming of the 4K era.
    LRTV Huawei Video Resource Center
    Pay-TV's Networked Future

    1|20|15   |   6:29   |   (0) comments


    At IBC, Jeff Heynen, Principal Analyst at Infonetics, speaks about the future of the pay-TV industry and its transition.
    LRTV Huawei Video Resource Center
    Jeff Heynen: Distributed Access Will Help MSOs Compete in the Future

    1|20|15   |   2:26   |   (0) comments


    At IBC, Jeff Heynen, Principal Analyst at Infonetics, speaks about moving to distributed access and the future trend of cable business.
    LRTV Interviews
    Cisco Talks Transformation

    1|20|15   |   13:02   |   (0) comments


    In December 2014, Steve Saunders sat down with Cisco VP of Products & Solutions Marketing Doug Webster at Light Reading's 2020 Vision executive summit in Reykjavik, Iceland. They spoke about Cisco's approach to network virtualization as well as how service providers can begin to monetize high-capacity networks through the end of the decade.
    Upcoming Live Events
    February 5, 2015, Washington, DC
    February 19, 2015, The Fairmont San Jose, San Jose, CA
    March 17, 2015, The Cable Center, Denver, CO
    April 14, 2015, The Westin Times Square, New York City, NY
    May 12, 2015, Grand Hyatt, Denver, CO
    May 13-14, 2015, The Westin Peachtree, Atlanta, GA
    June 8, 2015, Chicago, IL
    June 9-10, 2015, Chicago, IL
    June 9, 2015, Chicago, IL
    September 9-10, 2015, The Westin Galleria Dallas, Dallas, TX
    September 29-30, 2015, The Westin Grand Müchen, Munich, Germany
    November 11-12, 2015, The Westin Peachtree Plaza, Atlanta, GA
    December 1, 2015, The Westin Times Square, New York City
    December 2-3, 2015, The Westin Times Square, New York City
    Infographics
    Hot Topics
    Google Continues Gigabit Expansion
    Jason Meyers, Senior Editor, Gigabit Cities/IoT, 1/27/2015
    Cablevision's New WiFi Try – Freewheeling Enough?
    Mari Silbey, Independent Technology Editor, 1/26/2015
    LightSpeed Looks to Plug the Gigabit Gap
    Jason Meyers, Senior Editor, Gigabit Cities/IoT, 1/23/2015
    Overture Builds on NFV Foundation
    Mitch Wagner, West Coast Bureau Chief, Light Reading, 1/27/2015
    Parks Predicts HBO OTT Success
    Mari Silbey, Independent Technology Editor, 1/23/2015
    Like Us on Facebook
    Twitter Feed
    Webinar Archive
    BETWEEN THE CEOs - Weekly Executive Interview
    Join us live for Light Reading's interview with Jay Samit, the newly appointed CEO of publicly traded SeaChange International Inc. With a resume that includes Sony, EMI, Universal, Intel and Microsoft, Samit brings a reputation as an entrepreneur and a disruptor to his new role at the video solutions company. Hear what he has to say about the opportunities in video, as well as the outlook for cable, telco, OTT and mobile service providers.