& cplSiteName &

Testing Cisco's Next-Gen Mobile Network

Light Reading

The future of network communications is mobile – where wireless broadband technologies will be ubiquitously available, scaling to the whole world’s needs, and delivering revenue-generating video and data applications to diverse subscriber groups. (See Cisco: Video to Drive Mobile Data Explosion.)

Well, that is at least the joint goal of operators and vendors. The main question is: How do we get from today’s voice-driven networks – some struggling already under smartphone loads by a minority of their subscriber base – to tomorrow’s heavily broadband-enabled solutions for all? (See AT&T Intros Mobile Data Caps.)

How can such vast bandwidth be delivered to the growing number of cell towers cost effectively? How will this beast scale in the mobile core? Are any operator-provided data applications generating more revenue than adding cost? And if so, should the network be neutral, or should it favor such applications?

Lifting the cover off mobile testing
Light Reading and the European Advanced Networking Test Center AG (EANTC) thought it is about time to add some objectivity and facts to the discussion. At this point, most network knowledge is contained inside vendor labs and mobile operator network design departments, under non-disclosure agreements. Our goal was to stage an independent, public test of a vendor’s complete mobile infrastructure – including the wired backhaul (from cell sites to the mobile service nodes), the network core (connections among service functions and to the Internet), and the so-called “mobile core” with the large-scale packet and voice gateways. (See Juniper Challenges Cisco in the Mobile Core.)

Cisco Systems Inc. (Nasdaq: CSCO) was the first vendor to approach us with an offer to stage and test all these functions. This came as a surprise, because Cisco has not been well known as a premier mobile infrastructure supplier in the past, but things changed with the Starent acquisition. (See Cisco to Buy Starent for $2.9B and Cisco/Starent Deal Hurts Juniper.)

And Cisco has a history of independent public tests with Light Reading:

Indeed, Cisco's commitment to public, independent tests is well known. But it need not be the only vendor we hear from and report on: Participation in this test program is open for any vendor.

EANTC is an independent test lab founded in 1991 and based in Berlin. It conducts vendor-neutral proof-of-concept and acceptance tests for service providers, governments, and large enterprises. Packet-based mobile backhaul and mobile packet gateway (GGSN) testing for vendors and service providers has been a focus area at EANTC since the mid 2000s. Carsten Rossenhoevel of EANTC has co-chaired the MEF 's mobile backhaul marketing working group since 2007.

EANTC’s role in this program was to define the test topics in detail, communicate with Cisco during the network design and pre-staging phase, coordinate with test equipment vendors (Spirent and Developing Solutions), conduct the tests at Cisco’s labs in San Jose, Calif., and extensively document the results in this, and a subsequent, report. For this independent test, EANTC was commissioned by, and exclusively reported to, Light Reading. Cisco did not review draft versions of the articles before publication.

Network under test
Cisco provided a complete, realistic mobile operator’s network for GSM/GPRS (2G), UMTS (3G), and Long Term Evolution (LTE) services spanning the mobile core, radio network controllers, and IP backhaul infrastructure.

The network was based on an EANTC requirements specification (black-box RFP) that we created as a blueprint for the common denominator of current and future mobile networks in the US, Europe, and Asia/Pacific. Specifically, Cisco selected the following equipment:

  • ASR5000 mobile gateway – contributed by the recently acquired Starent group
  • Cisco’s brand-new CRS-3 flagship carrier router including pre-production 100-Gigabit Ethernet equipment
  • Data center equipment such as the Nexus 7000
  • The ASR9000 and 7600 aggregation layer routers
  • Pre-aggregation systems such as the ASR1000, ME3600, and the unreleased ME3800 families
  • Cell site gateways like the MWR2941.

Base stations, subscribers, and additional access rings were emulated. All the components were racked in a Cisco lab, taking 13 full 19" racks. The scale of the network was sufficient to cater to more than 1.5 million active mobile subscribers across more than 4,500 emulated base stations. The tests were planned since December 2009 by a permanent project team of eight people and executed in June and July 2010 with a team of more than 30 experts.

Before we get to the test result highlights, here’s a hyperlinked list of this report's contents:

Results highlights
We validated an impressive range of Cisco products for most of the pieces of the mobile puzzle. Cisco showed that they truly support all mobile network generations – from GSM (2G) and current generation UMTS (3G) to Long Term Evolution (LTE), the next generation of radio technology. Without exaggerating, our nine-month exercise was by far the largest and most in-depth public, independent, third-party test of mobile infrastructure vendor performance ever.

Cisco showed reassuring scalability and state-of-the-art functionality across all technologies and products. Specifically, the mobile core tests of the ASR5000 showed that the Starent acquisition was a smart move, adding a rock-solid and mature product to Cisco’s offerings. A couple of brand-new products put to test showed some teething trouble, such as the ME3800 access router and the CRS-3’s 100GigE interfaces – all of which were resolved during the test. These bugs discovered during the EANTC tests were actually a feature: They allowed us to rate how fast Cisco’s engineering and quality assurance teams are, and how much of the engineering knowledge is internal as opposed to pure OEM products or third-party component assembly as seen by other vendors.

Integration of all these components into a consistent and working network design is a major aspect of the challenge: The various business units involved had to align their language and understand mutual protocol support. Some new product lines supported LTE greenfield deployment cases; other products were presented for the 2G/3G/LTE migration case – I guess one cannot have it all at the same time. In surprisingly few cases, our test became a Cisco-to-Cisco interoperability exercise – nothing specific to Cisco, according to our experience, but rather a reality across large industry players.

Now, is LTE deployment ready for prime time? Well, it depends. As far as we can tell from this very extensive lab test, the building blocks for key components in the backhaul and core wireline infrastructure and in the mobile core exist and are scaling right now. But, in the dry language of mathematics, these are mandatory, not necessarily sufficient, preconditions. The integration of actual charging and billing functions, provisioning and fault management aspects, etc., remain in the realm of future work for the individual mobile operator.

How could we summarize our findings, now that we are digesting what Cisco served us? As you can tell, the EANTC team is hard to impress – a bit like the prototypical Michelin Guide restaurant critic who leans back after a 12-course feast including oysters and black caviar, raspberry soufflé, and foamed espresso – comparing the experience with the other famed restaurants he has seen. This test really was outstanding, a true industry-first, an innovative and courageous undertaking, and, after all, an exciting experience for everybody involved. We have the pleasure to share the wealth of results and insight into Cisco’s solutions here. Cisco’s products tested are not exactly like black caviar... but we liked the soufflé. Full stop.

— Carsten Rossenhövel is Managing Director of the European Advanced Networking Test Center AG (EANTC) , an independent test lab in Berlin. EANTC offers vendor-neutral network test facilities for manufacturers, service providers, and enterprises. Carsten is responsible for the design of test methods and applications. He heads EANTC's manufacturer testing, certification group and interoperability test events. Carsten has over 15 years of experience in data networks and testing. His areas of expertise include Multiprotocol Label Switching (MPLS), Carrier Ethernet, Triple Play, and Mobile Backhaul.

Jambi Ganbar, EANTC, managed the project, executed the IP core and data center tests and co-authored the article.

Jonathan Morin, EANTC, created the test plan, supervised the IP RAN and mobile core tests, co-authored the article, and coordinated the internal documentation.

Page 2: Introduction to Network Backbone & IP Radio Access Network Tests

(12)  | 
Comment  | 
Print  | 
Newest First  |  Oldest First  |  Threaded View        ADD A COMMENT
Page 1 / 2   >   >>
User Rank: Light Beer
12/5/2012 | 4:25:15 PM
re: Testing Cisco's Next-Gen Mobile Network

I just spent a good 30 minutes reading this, twice, and am still digesting it. Can't wait for part 2. Will you be offering an easy to digest PDF to make sharing this around the office easier?


User Rank: Light Beer
12/5/2012 | 4:25:14 PM
re: Testing Cisco's Next-Gen Mobile Network

Looking forward to it!

I have to admit that the first run through was a quick skim to see if a more thorough reading was worthy of my time. The second reading is where I focused. Skipped the charts, relied on the heavy text descriptions.

Been a heavy reader since as far back as I can remember. I'm fast! ;-)

User Rank: Light Beer
12/5/2012 | 4:25:14 PM
re: Testing Cisco's Next-Gen Mobile Network

Thanks. We'll post a link to a PDF once we're through making some minor tweaks (and adding a couple of photos of the testing dungeon).

Quick question: How'd you get through this thing in just 30 mins? It's a beast.

User Rank: Light Beer
12/5/2012 | 4:25:10 PM
re: Testing Cisco's Next-Gen Mobile Network

Article is very extensive and interesting. I was specially interested in the QoS techniques that were tested, and couldn't really understand exactly the scope. Most of these tests should be done with Radio and backhauling, as there is were congestion relies. At the moment this seems limited, so please include more details.

Also, name of the article should better be "Testing Cisco Core Solution for Mobile Networks". As the equipment involved is far from being a complete Mobile Network.

User Rank: Light Beer
12/5/2012 | 4:25:09 PM
re: Testing Cisco's Next-Gen Mobile Network

A heavy-weighted player is entering the muddy water of Core network solution.

User Rank: Light Beer
12/5/2012 | 4:25:07 PM
re: Testing Cisco's Next-Gen Mobile Network

Hi miusuario,

Thanks for your review and kind words.  You raise a good point about testing a complete mobile network: This is only the first of two articles - the second article, focusing the REAL mobile core (GGSN, SGSN, LTE P-GW/MME), mobile applications and the mobile operator's data center will be published after labor day next week. Stay tuned!

With regards to QoS, I certainly agree - congestion is most likely and critical in the backhaul.  We tested QoS on the ASR9010 and 7609 routers. Both routers were loaded with application traffic types in five classes (Expedited Forwarding; Assured Forwarding cs5/cs4/cs2; Best Effort).  Under congestion we expected them to only lose Best Effort traffic (7609) and BE + cs2 traffic (ASR9000), respectively.  The test was passed.  For more info please see Page 5 of the report.

Thanks! Carsten

User Rank: Light Beer
12/5/2012 | 4:24:34 PM
re: Testing Cisco's Next-Gen Mobile Network

Hello Carsten:

Thanks to the very informative posting. Although I did not understand some of the things your lab is doing but it was interesting to know about them.

I would be intrested to know about EANTC's activities in the LTE EPC Core testing. Do you have any LTE network set up in your lab with UE's, ENB, MME, SGW, PGW etc ?

Thanks and regards,

Bud Biswas (bbiswas@polarisnetworks.net)

Polaris Networks (www.polarisnetworks.net)

User Rank: Light Beer
12/5/2012 | 4:22:16 PM
re: Testing Cisco's Next-Gen Mobile Network

It's really interesting to know that CRS-1 to CRS-3 upgrade was very smooth.

I think you upgrade the router to IOS-XR 4.0 first and then swap the new fabric with old fabric one by one ?

is the above assumption correct ? or do we have any restriction on the ROMMON versions on the existing modules ?

User Rank: Light Beer
12/5/2012 | 4:22:06 PM
re: Testing Cisco's Next-Gen Mobile Network

Thanks Carsten, for your effort on getting this clarrified.



User Rank: Light Beer
12/5/2012 | 4:22:06 PM
re: Testing Cisco's Next-Gen Mobile Network

Dear Carsten,

Your article is really interesting. Can I have a PDF version of total of article?

Thanks, Alireza

Page 1 / 2   >   >>
Educational Resources
sponsor supplied content
Educational Resources Archive
Light Reading’s Upskill U is a FREE, interactive, online educational resource that delivers must-have education on themes that relate to the overall business transformation taking place in the communications industry.
Wednesday, September 14, 1:00PM EDT
What Is Agile?
Kent J. McDonald, Product Owner, Agile Alliance
Friday, September 16, 1:00PM EDT
How to Implement Agile
Alan Bateman, Director, Agile Transformation
Wednesday, September 21, 1:00PM EDT
What Is DevOps?
Colin Kincaid, CTO, Service Provider, Cisco
Friday, September 23, 1:00PM EDT
How to Implement DevOps
in association with:
From The Founder
Light Reading today starts a new voyage as part of a larger Enterprise.
Flash Poll
Live Streaming Video
Charting the CSP's Future
Six different communications service providers join to debate their visions of the future CSP, following a landmark presentation from AT&T on its massive virtualization efforts and a look back on where the telecom industry has been and where it's going from two industry veterans.
Between the CEOs
CEO Chat: UXP's Gemini Waghmare

8|26|16   |     |   (0) comments

Light Reading CEO Steve Saunders and UXP Systems CEO Gemini Waghmare discuss the strategic importance of digital identity for operators in the midst of transformation.
LRTV Custom TV
F5 Virtual Network Function Integrations With Partner Orchestration Platform

8|24|16   |   6:38   |   (0) comments

F5's Kishore Patnam, product manager for F5's service provider solutions, discusses why service providers are moving towards virtualization and how his clients are utilizing F5's solutions.
Between the CEOs
CEO Chat: Intel's Alexis Black Bjorlin

8|17|16   |   06:23   |   (0) comments

Join us for an in-depth interview between Steve Saunders of Light Reading and Alexis Black Bjorlin of Intel as they discuss the release of the company's Silicon Photonics platform, its performance, long-term prospects, customer expectations and much more.
Telecom Innovators Video Showcase
Accelerating Telecom Digital Transformation With Nominum DNS

8|1|16   |   12:04   |   (0) comments

Light Reading's Steve Saunders gets an update from Nominum CEO Gary Messiana on how his company is helping carriers on the digital transformation journey.
LRTV Custom TV
Reinventing Operations for a Virtual, Software-Defined World

7|28|16   |   5:23   |   (0) comments

Heavy Reading Senior Analyst Jim Hodges speaks with Accenture's Larry Socher and Matt Anderson about what service providers must do to transform their business to get the benefits of SDN and NFV including: leveraging DevOps, introducing real-time OSS and implementing analytics.
Women in Comms Introduction Videos
Fujitsu Sales Leader Shares Lessons Learned

7|27|16   |   5:12   |   (1) comment

As Fujitsu's only female sales leader, Annie Bogue knows the importance of asking for what you want, being flexible (she's been relocated five times), keeping a meticulous calendar, 'leaning in,' working harder than everyone else around you, being aware and more.
Telecom Innovators Video Showcase
VeEX Test & Measurement Solutions

7|25|16   |   08:57   |   (0) comments

Cyrille Morelle, president and CEO of VeEX Inc., talks test and measurement with Light Reading's Steve Saunders at BCE 2016. This includes innovative products such as VeSion Cloud-Based platform for network monitoring; MTTplus Modular Test platform for Access, Business, Carrier Ethernet, Transport and Core services; and OPX-BOX+ for Fiber Optics.
LRTV Custom TV
VeEX: Live From BCE 2016

7|25|16   |   03:20   |   (0) comments

VeEX's Senior Director of Business Development, Perry Romano, explains how VeEX provides tools to help install, maintain, monitor and manage network infrastructure efficiently and effectively. The portfolio of products on display include the RXT-6000, MTTplus and TX300s.
LRTV Custom TV
Real-Time Telemetry & Analytics for Intelligent SDN Orchestration

7|25|16   |   03:09   |   (0) comments

Packet Design CEO Scott Sherwood discusses how real-time network telemetry and analytics are enabling a new breed of SDN orchestration applications.
From the Founder
The Russo Report: Driving Disruption

7|25|16   |   07:44   |   (2) comments

In the first episode of a four-part series, Light Reading Founder and CEO Steve Saunders and Calix President and CEO Carl Russo drive around town discussing the disruptive mega-changes in the communications industry and where hope lies for service providers to meet the escalating demands of the cloud.
LRTV Custom TV
NetScout: Maximizing Enterprise Cloud for Digital Transformation

7|20|16   |   04:53   |   (0) comments

Light Reading Editor Mitch Wagner talks to NetScout CMO Jim McNiel about maximizing the benefits of enterprise cloud and digital transformation while minimizing potential pitfalls with a proper monitoring and instrumentation strategy.
Women in Comms Introduction Videos
Ciena's VP Offers a Career Crash Course

7|20|16   |   4:14   |   (2) comments

How did Ciena's Vice President of Sales, Angela Finn, carve out her career path? Simple, she tells WiC. She stayed true to her company, customers and principles. She shares her advice for women on how to be authentic and credible, as well as for companies that want to make a real change to their culture and practices.
Upcoming Live Events
September 13-14, 2016, The Curtis Hotel, Denver, CO
November 3, 2016, The Montcalm Marble Arch, London
November 30, 2016, The Westin Times Square, New York City
December 1, 2016, The Westin Times Square, New York, NY
December 6-8, 2016, The Westin Excelsior, Rome
May 16-17, 2017, Austin Convention Center, Austin, TX
All Upcoming Live Events
Hot Topics
Google Fiber Can't Be Called a Failure
Carol Wilson, Editor-at-large, 8/26/2016
FirstNet: A Billion-Dollar Boondoggle?
Dan Jones, Mobile Editor, 8/26/2016
WiCipedia: Should Men Be Included? & Olympians Face Discrimination
Eryn Leavens, Special Features & Copy Editor, 8/26/2016
Google Fiber Downsizing Not Confirmed
Mari Silbey, Senior Editor, Cable/Video, 8/25/2016
How the Padres Hit an IoT Home Run
Mitch Wagner, West Coast Bureau Chief, Light Reading, 8/25/2016
Like Us on Facebook
Twitter Feed
BETWEEN THE CEOs - Executive Interviews
Light Reading CEO Steve Saunders and UXP Systems CEO Gemini Waghmare discuss the strategic importance of digital identity for operators in the midst of transformation.
Join us for an in-depth interview between Steve Saunders of Light Reading and Alexis Black Bjorlin of Intel as they discuss the release of the company's Silicon Photonics platform, its performance, long-term prospects, customer expectations and much more.
Animals with Phones
Live Digital Audio

Bridging the tech skills gap is a major challenge for service providers and suppliers alike today – and the challenge is two-fold when it comes to increasing the number of women in the comms space. Level 3 Communications has made it a priority to overcome both challenges by implementing several unique programs focused on building the right candidates from within – in addition to filling the funnel by supporting STEM and other education programs. During this radio show, you’ll learn about these programs from Mary Beth McGrath, SVP of Global Talent Management at Level 3, and the best ways to bridge your own skills gap so that you are motivated and equipped for change. Plus you’ll have the chance to ask Mary Beth your questions live on the air.