Light Reading

Testing Cisco's Mobile Core, Data Center & Business Services

Light Reading
9/7/2010
50%
50%

Earlier, Light Reading published the first part of the massive independent test of Cisco Systems Inc. (Nasdaq: CSCO)’s next-generation mobile network infrastructure. (See Testing Cisco's Next-Gen Mobile Network and LR & EANTC Test Cisco’s Mobile IP Network.) Even in a one-minute video montage you can get a sense of the sheer size of this project:

This article is the second feature highlighting the results of this enormous test. Before we get to the background and test setup, here's a hyperlinked table of contents for this special feature:



Background
Our testing team of the European Advanced Networking Test Center AG (EANTC) spent four weeks at Cisco's labs, validating the solutions presented to us. A key component we wanted to see in action is the mobile core. This is the logical data center area where the operator positions all the central packet and voice gateways, auxiliary control plane systems required to run the mobile network, plus consumer and business application servers.

At the beginning of the project late last year, we really scratched our heads when Cisco announced their willingness to join our test. How would they provide all the mobile core equipment? Of course, a search for SGSN on Cisco’s Website resulted in zero hits back then. But when Cisco bought the ASR 5000 (acquired from Starent Networks Inc.) it added a single specialized hardware platform that implements the voice and packet gateway functions both for 3G and Long Term Evolution (LTE).

UMTS voice and packet gateways have served their purpose in the industry quite well in the past years. Our test comes at a moment when things are changing rapidly. The major current challenges of mobile operators include:

  • Mobile data growth: Mobile subscribers expect multi- Mbit/s (megabits per second) throughput, through high-speed packet access (HSPA). All this traffic needs to transit the serving gateways and packet gateways. Performance requirements are much higher than before, and a large and growing fraction of subscribers has access to smartphones and other end systems capable of high-speed data. (See Cisco: Video to Drive Mobile Data Explosion.)
  • Migration to LTE, where the mobile core is called Evolved Packet Core (EPC): The drastic changes from 3G to LTE affect base stations, air interfaces, and backhaul networks. The LTE mobile core needs to grow to keep pace with the huge air interface bandwidth extensions, and it needs to support the all-IP radio access network (RAN) by providing suitable application policies, for example to differentiate operator-provided voice over IP and bulk data traffic.
  • Monetization: The mobile core is the key area where decisions are made to prioritize applications associated with revenue and to throttle bulk applications that just take away frequency spectrum and backhaul capacity (such as P2P, file sharing, etc.). The goal for mobile operators is to avoid too much precious spectrum being taken by applications that do not generate revenue.


This requires that vendors have an idea of what applications could generate revenue – certainly not a trivial question, and not to be answered unanimously across all subscriber bases worldwide. Cisco showed us some of its ideas – see the Mobile Smart Home demonstration on Page 12.

Another note on LTE: How far have implementations matured? The industry has been buzzing with success stories in press releases. But outside four city areas serviced by TeliaSonera AB (Nasdaq: TLSN), no LTE network of any scale has started production-grade services yet. Many mobile operators are testing the technology and most operators plan to deploy LTE only after 2012. We checked how well Cisco would be prepared for LTE with their mobile core offerings now. And recall that we tested its LTE backhaul design in the previous testing article. (See Testing Cisco's Next-Gen Mobile Network.)

Test setup
The test scale was phenomenal, even to previous EANTC and Light Reading standards. Our Spirent Communications plc (NYSE: SPM; London: SPT) contacts were surprised when they heard our requirement to fully emulate beyond 1 million mobile handsets for voice and data traffic. They had to bring in eleven of their fastest and largest Landslide mobile network emulators. The Landslides emulated the user equipment (UE) – like the cellphones and mobile data cards – and the data aggregation/transport aspects of the emulated base stations.

Due to emulator limitations, we agreed that Spirent would configure 16 artificially large base stations in this test, each of which emulated 62,500 subscribers. We counted only registered and attached subscribers toward this figure.

In real life, only roughly one-in-five to one-in-ten consumer phones is on a voice call at any time. Today, with still a lot of prepaid, voice-only phones around, probably even fewer subscribers are actively exchanging data traffic. A noticeable fraction of customers with a contract or prepaid card might even switch off their phones. Each of these factors would have blown up the numbers – in an artificial, unrealistic way. Therefore we abstained from any of such statistical “improvements” and counted only real, attached subscribers.

The Landslide emulators were connected – through the network set up in the previous phase – to three ASR 5000’s, taking 3G and LTE roles in turn. They were reconfigured from 3G to LTE after the first set of test cases had been completed. Since we required such a large farm of Landslides with 20x10G and 10xGE ports, we ended up using one of the Nexus 7000 switches to aggregate all the tester ports so we could reach the performance we intended to generate for the SGSN, GGSN, and EPC tests. This choice is reflected in the figure above.

For each subscriber, we emulated a range of application flows such as Voice over Internet Protocol (IP), HTTP, plain Transmission Control Protocol (TCP), and UDP data. All flows were IPv4-based in the Landslide/ASR 5000 tests. Since we required such a large farm of landslides with 20x10G and 10xGE ports, we ended up using one of the Nexus 7000 switches to aggregate all the tester ports so we could reach the performance we intended to generate for the SGSN, GGSN, and EPC tests. This choice is reflected in the figure above.

In addition, we required auxiliary mobile core functions to complete the scenario:

  • The Home Location Registrar (HLR) in the 3G world was provided by an emulator from Developing Solutions, a Texas-based specialist test vendor for mobile core component emulation.
  • The HLR’s equivalent in the LTE world, called Home Subscriber Server (HSS), was provided by Bridgewater Systems Corp. (Toronto: BWC). In addition, to ease and speed up scalability testing, we used the Developing Solutions emulator for the HSS function in parallel as well. All tests involving an HSS were carried out twice – with the emulator and the production system.
  • Finally, a Policy Charging and Rules Function (PCRF), also supplied by Bridgewater, was required to interface with the main packet gateway. The PCRF takes decisions on behalf of the packet gateway – anything that requires looking up per-subscriber rule-based behavior. A PCRF configuration can get quite advanced, and could be a competitive differentiator for a mobile operator. Since this equipment was not the major topic of the test, we kept it as trivially configured as possible. Its only purpose was to keep pace with our performance and scalability tests.

In this huge scenario, we evaluated a total of five test cases and two vendor demonstrations. Let’s see the details.

— Carsten Rossenhövel is Managing Director of the European Advanced Networking Test Center AG (EANTC) , an independent test lab in Berlin. EANTC offers vendor-neutral network test facilities for manufacturers, service providers, and enterprises. Carsten is responsible for the design of test methods and applications. He heads EANTC's manufacturer testing, certification group and interoperability test events. Carsten has over 15 years of experience in data networks and testing. His areas of expertise include Multiprotocol Label Switching (MPLS), Carrier Ethernet, Triple Play, and Mobile Backhaul.



Jambi Ganbar, EANTC, managed the project, executed the IP core and data center tests and co-authored the article.

Jonathan Morin, EANTC, created the test plan, supervised the IP RAN and mobile core tests, co-authored the article, and coordinated the internal documentation.


Page 2: Results: ASR 5000 SGSN Attachment Rate

(15)  | 
Comment  | 
Print  | 
Page 1 / 14 Next >
Newest First  |  Oldest First  |  Threaded View
Page 1 / 2   >   >>
srikrishnak
50%
50%
srikrishnak,
User Rank: Lightning
12/5/2012 | 4:24:27 PM
re: Testing Cisco's Mobile Core, Data Center & Business Services


Great continuation. Used to get much more from LR, so still waiting for PDF :)

DCITDave
50%
50%
DCITDave,
User Rank: Light Beer
12/5/2012 | 4:24:21 PM
re: Testing Cisco's Mobile Core, Data Center & Business Services


We'll have the PDFs available soon. Want to make sure all corrections and copy editing are complete with both reports first. Hang in there.

JeddChen
50%
50%
JeddChen,
User Rank: Light Beer
12/5/2012 | 4:24:21 PM
re: Testing Cisco's Mobile Core, Data Center & Business Services


Informative Reports. waiting for PDF, too.

bigpicture
50%
50%
bigpicture,
User Rank: Light Beer
12/5/2012 | 4:24:17 PM
re: Testing Cisco's Mobile Core, Data Center & Business Services


I have a question about the throughput vs. the DPI tests.  In the throughput test you stated you had 60,000 make / break sessions activating at 1,000 sessions per second.  In the DPI test you stated the rate was "reduced" to 5.000 sessions per second.  


I'm not sure how you "reduced" from 1,000 to 5,000.  Is one of the numbers a typo or am I just confused?


Thanks,


BP

tohhwee72
50%
50%
tohhwee72,
User Rank: Light Beer
12/5/2012 | 4:24:17 PM
re: Testing Cisco's Mobile Core, Data Center & Business Services


Possible to share more detail on the firewall performance, e.g.


1. The packet size used for the test, i.e. large or small packet?


2. Traffic profile, e.g. % of http, % of ftp etc


3. How is the NAT being done? i.e. how many public IP address are used to get 1 mil concurrent session?


4. What was the throughput, CPU load etc?

cross
50%
50%
cross,
User Rank: Light Beer
12/5/2012 | 4:24:16 PM
re: Testing Cisco's Mobile Core, Data Center & Business Services


Hi Bigpicture,


I thought I was confused, but it was only a typo :-)


Thanks for pointing out the issue.  We will fix it.  In short:

<ul>
<li>GGSN test with DPI: 18,000 attachments per second</li>
<li>GGSN test without DPI: 18,000 attachments per second</li>
<li>EPC test: 5,000 attachments per second.</li>
</ul>

Once all sessions were established, the make/break attachment rate was 1,000 new sessions plus 1,000 terminated sessions per second for all three tests (in a constant way, constantly making and breaking over the whole remaining test duration of 15 minutes).


Thanks, Carsten

JeddChen
50%
50%
JeddChen,
User Rank: Light Beer
12/5/2012 | 4:24:09 PM
re: Testing Cisco's Mobile Core, Data Center & Business Services


Emulator is a very important and supplementary means for functionality and performance test. But real networks are quite different and much more complicated and there are a lot of potential and unpredicted factors. That a lot of emulators were used in this test solution has&nbsp; arose the worry mentioned above. so some of the results will be expected to be verified in live networks(trial office).

2skhatri
50%
50%
2skhatri,
User Rank: Light Beer
12/5/2012 | 4:24:04 PM
re: Testing Cisco's Mobile Core, Data Center & Business Services


Are we to surmise that the upper limit for number of simultaneously attached users is around 1 million?&nbsp;

cross
50%
50%
cross,
User Rank: Light Beer
12/5/2012 | 4:24:03 PM
re: Testing Cisco's Mobile Core, Data Center & Business Services


Hi tohhwee72,


The primary focus of the ASR1000 Firewall/NAT test was the scale of the stateful network address translations. We did not mean to test the ASR1000 for throughput performance here.&nbsp; Also, the Avalanche emulator is an application-layer device; it sent HTTP requests and received responses on layer 7 - this was not a packet-layer test.&nbsp; To answer your questions:


1. The HTTP requests were for pretty short URLs so the packet sizes were in the order of 150 Bytes.&nbsp;&nbsp; Responses were sent for mid-size objects of a couple of kilobytes; MTU was set to 1470 bytes so there was an average packet size north of 1,000 bytes.&nbsp;


2. Three quarters of the traffic was HTTP, one quarter FTP.


3. The purpose of this test was to validate business security aspects of NAT.&nbsp; Enterprises typically want to hide their internal IP addresses from the Internet.&nbsp; NAT was therefore configured in a 1:1 scenario.&nbsp; 80,000 IP addresses from the 10.0.0.0/8 network were mapped into another 80,000 IP addresses in the (supposedly public) network of 12.0.0.0/8.


4. CPU load was not monitored. The Spirent Avalanche controller reported downstream throughput of 1.09 Gbit/s and upstream throughput of 0.154 Gbit/s. This was not a throughput test - we focused on stateful NAT mapping scalability.


Thanks Carsten

cross
50%
50%
cross,
User Rank: Light Beer
12/5/2012 | 4:24:02 PM
re: Testing Cisco's Mobile Core, Data Center & Business Services


Hi JeddChen,


Network emulations and trials both have their reason for existence I believe.&nbsp; I disagree with your point that trials are better - they just answer different questions at a different time.


First and foremost, the goal of our test was to provide true, real, independent data of a vendor solution publicly.&nbsp; I have not heard of any serious operator trial where results have been made available publicly to the level of detail of this test.&nbsp; I hope our results will be helpful to gauge Cisco's solution for anybody worldwide.&nbsp; It does not take a site visit or good relationships with the trialling operator or vendor to read our article.


Second, it is dangerous to design trials to answer scalability questions. After all, customers are meant to use the trial as a service to some extent. To get to a level where one million users would simultaneously use LTE data connections, one would need to have at least a subscriber base of 10 million hyperactive data users because they are never going to use the network all at once.&nbsp; Few operators will be adventurous enough - or even able, given their customer base - to answer these scalability questions in a trial. TeliaSonera has not disclosed the number of subscribers in its production grade LTE network (not a trial!) - TeliaSonera has just said it has "thousands of subscribers" on its Swedish LTE network, and a total of around 500,000 mobile broadband subscribers nationwide for LTE and 3G together.


On the other hand, our test was unable to answer typical trial questions such as: How do subscribers perceive the service? What happens in the interaction with base stations when a large number of users are on the move, fast or slow, or do not have perfect coverage? How will charging work?&nbsp; So I definitely see the viability of trials once scalability emulations have been completed so it will be safe to deploy a trial network for real customers.


Apologies for the long post.


Thanks Carsten


&nbsp;

Page 1 / 2   >   >>
Flash Poll
From The Founder
The New IP is actually bigger even than business. Like another hugely important tech that Light Reading is digging into right now, the New IP has the potential to change the world by fundamentally advancing what it is possible for people to achieve with communications.
Que Sera Sarah
Growth of the 5G Ecosystem

3|6|15   |   1:15   |   (1) comment


Use cases and industry collaborations dominated 5G discussions during Mobile World Congress 2015. For what the road to 5G means for operators and their partners, head to the Building America's 5G Ecosystem event in New York on April 14.
LRTV Custom TV
Sonus NaaS IQ Real-Time Demo

3|6|15   |   4:03   |   (0) comments


Compass Networks Chairman and CEO Matt Bross and Ray Dolin, CEO of Sonus Networks, demonstrate their Sonus IQ SDN solution using a live video conference connection.
LRTV Custom TV
LRTV Talks Carrier WiFi & WiFi Calling With Aptilo Networks

3|6|15   |   4:53   |   (0) comments


We stopped by Aptilo Networks, a market leader in WiFi service management and offloading, to discuss the new possibilities with next-generation WiFi calling and why WiFi should be a natural part of any operator strategy.
LRTV Interviews
NGMN Chairman Outlines His 5G Vision

3|6|15   |   5:10   |   (1) comment


Bruno Jacobfeuerborn, chairman of the NGMN Alliance and Deutsche Telekom CTO, shares his thoughts on the challenges, opportunities and costs of 5G.
LRTV Interviews
In the Cloud With Telecom Italia

3|5|15   |   7:10   |   (0) comments


Light Reading CEO Steve Saunders sits down with Telecom Italia's Simone Battiferri at Mobile World Congress to discuss virtualization, agility and the economic advantages of the cloud.
LRTV Huawei Video Resource Center
New Ways of Working

3|5|15   |   4:24   |   (0) comments


At the ICT Leaders Roundtable, hosted jointly by Light Reading and Huawei at the Hotel Renaissance in Barcelona just prior to Mobile World Congress, Hong Kong Telecom's Michael Yue explains how the transformation in its business has changed its customer relationships.
LRTV Huawei Video Resource Center
Bridging the Digital Gap

3|5|15   |   4:03   |   (0) comments


At the ICT Leaders Roundtable, hosted jointly by Light Reading and Huawei at the Hotel Renaissance in Barcelona just prior to Mobile World Congress, Boingo's Dr. Derek Peterson explains how ICT can help telcos bring the physical and virtual worlds closer together.
LRTV Huawei Video Resource Center
Making the Internet of Things Affordable

3|5|15   |   2:42   |   (0) comments


At the ICT Leaders Roundtable, hosted jointly by Light Reading and Huawei at the Hotel Renaissance in Barcelona just prior to Mobile World Congress, Telefonica's Dr. Mike Short explains how the Internet of Things demands a new low-cost approach to connectivity from telcos.
LRTV Huawei Video Resource Center
Evolution, Not Revolution

3|5|15   |   2:00   |   (0) comments


At the ICT Leaders Roundtable, hosted jointly by Light Reading and Huawei at the Hotel Renaissance in Barcelona just prior to Mobile World Congress, Heavy Reading's Patrick Donegan explains why telcos can't be too hasty in their efforts to transform themselves.
LRTV Custom TV
Management & Orchestration Enablement Strategies Required for NFV Commercial Success

3|5|15   |   6:22   |   (0) comments


NFV commercial success rests on successful service orchestration strategies which can span heterogeneous physical, virtual, legacy and next-gen networks. Network data and security integrity are additional key aspects. Nakina provides a suite of orchestratable network integrity applications built on an open, scalable MANO enablement platform.
LRTV Huawei Video Resource Center
The Power of Five Convergences in OceanStor OS

3|4|15   |   6:24   |   (0) comments


OceanStor OS is Huawei's brand-new storage operating system. While inheriting the consistent high stability, reliability and performance from the company's previous storage products, OceanStor OS abounds in new converged storage features. Specifically, the new storage operating system achieves "five convergences" to lift storage convergence to a higher level.
LRTV Huawei Video Resource Center
4K Brings Extreme Video Experience

3|4|15   |   8:10   |   (0) comments


4K video is a hot topic in the video industry. It will certainly bring an extreme video experience to end users. At the same time, however, it will also pose a big challenge to operators. Check out this Huawei 4K experts' discussion about how operators can achieve success in 4K video service.
Upcoming Live Events
March 17, 2015, The Cable Center, Denver, CO
April 14, 2015, The Westin Times Square, New York City, NY
May 12, 2015, Grand Hyatt, Denver, CO
May 13-14, 2015, The Westin Peachtree, Atlanta, GA
June 8, 2015, Chicago, IL
June 9-10, 2015, Chicago, IL
June 9, 2015, Chicago, IL
June 10, 2015, Chicago, IL
All Upcoming Live Events
Infographics
Net neutrality, broadband services and the current outlook on data consumption, as presented by the New Jersey Institute of Technology.
Hot Topics
Internet Pioneers Decry Title II Rules
Carol Wilson, Editor-at-large, 3/2/2015
Wheeler: We'll Enforce Title II 'Case-By-Case'
Sarah Thomas, Editorial Operations Director, 3/3/2015
New CenturyLink CTO in Major Overhaul
Carol Wilson, Editor-at-large, 3/4/2015
Alibaba 'Planting a Flag' in US Cloud Market
Mitch Wagner, West Coast Bureau Chief, Light Reading, 3/4/2015
Few in Number, Big in Data
Sarah Thomas, Editorial Operations Director, 3/2/2015
Like Us on Facebook
Twitter Feed
Webinar Archive
BETWEEN THE CEOs - Executive Interviews
Chattanooga’s EPB publicly owned utility comms company has become a poster child for how to enable a local economy using next-gen networking technology. Steve Saunders, Founder of Light Reading, sits down with Harold DePriest, president and CEO of EPB, to learn how EPB is bringing big time tech to small town America.
Light Reading CEO Steve Saunders talks transformation and virtualization – including Light Reading's independent testing of the vendor's virtualization solutions – with Cisco CEO John Chambers at Mobile World Congress in Barcelona.
Check out Light Reading's interview with Jay Samit, the newly appointed CEO of publicly traded SeaChange International Inc. With a resume that includes Sony, EMI, and Universal, Samit brings a reputation as an entrepreneur and a disruptor to his new role at the video solutions company. Hear what he had to say about the opportunities in video, as well as the outlook for cable, telco, OTT and mobile service providers.
G'day! And welcome to an entirely new feature on Light Reading -- our weekly "CEO-to-CEO" interview.