Light Reading

Virtual Machine Fabric Extender Performance

Light Reading
Series Column
Light Reading
1/29/2012
50%
50%

EXECUTIVE SUMMARY: The Cisco UCS’s Virtual Machine Fabric Extender (VM-FEX) offers consistently increased network performance operations compared to virtual distributed switch installations.


In a standard Local Area Network, various hosts, laptops and PCs typically connect to a Layer 2 switch that aggregates the physical stations before handing them off to a router. Communication between two hosts on the same LAN can be done directly without reaching the router. Similarly, a virtual switching instance passes traffic either to a VM sitting in the same hardware, or pushes it out the physical port. Virtual Switches (such as the Cisco Nexus 1000v or VMware’s vNetwork Distributed Switch) operations are done in software and Virtual Switches (such as the Cisco Nexus 1000v or VMware’s vNetwork Distributed Switch) operations are done in software and therefore take resources away from the virtual machines hosted on the blade. Reducing the amount of resources available to the VMs.

Cisco's Nexus 1000v has a rich set of capabilities such as VLAN aggregation, forwarding policies and security. Cisco, however, found that not all VM installations require these features, and in such cases it makes sense to save the resources taken by the virtual switch and appropriate them to the customer needs.

Cisco claimed that their Virtual Machine Fabric Extender (VM-FEX) in VMDirect mode replaces the switch and shows a significant increase in CPU performance for network intensive applications. VM-FEX, installed on VMWare ESX 5.0, enables all VM traffic to be automatically sent out on the UCS's Virtual Interface Card (VIC). This meant more traffic on the physical blade network interface, but reduced CPU usage, which is typically the VM bottleneck. To verify that the VM-FEX really frees up CPU resources, we ran a series of tests comparing a VM-FEX-enabled UCS blade to a Nexus 1000v virtual switch setup. Both UCS blade installations were identical in all aspects apart from the use of the VM-FEX in one and Nexus 1000v in the other.

We started comparing the performance between the two setups using Ixia’s virtual tools. We installed four Ixia IxNetwork VMs on each of the two UCS blades and sent 3,333 Mbit/s of traffic from each of the first three VMs, toward the fourth for 120 seconds using 1,500-byte frames. In the VM-FEX case we recorded 2.186 percent frame loss, while in the distributed switch environment we recorded 16.19 percent frame loss.

We expected loss in both cases, given the almost 10Gbit/s load we were transmitting in the virtual space. The load was required in order to really keep the CPU busy. We deduced from this initial test result that in the VM-FEX environment less resources were used, which is why the frame loss we recorded was smaller than the loss recorded in the virtual distributed switch setup.

For the next test setup we installed one IxLoad VM on each of the two blades. We configured both IxLoad VMs as HTTP clients that requested traffic from a Web server Cisco configured. The IxLoad emulated clients were configured to try and use as much bandwidth as possible by requesting 10 different objects from 10 URLs repeatedly. The VM-FEX setup reached 9.87 Gbit/s while the distributed switch reached 7.78 Gbit/s. The CPU usage was also significantly higher in the virtual distributed switch setup when compared to the VM-FEX setup.

Using the Ixia test tools we recorded the performance difference we expected. Cisco recommended that we perform a test that relies more heavily on the Storage Area Network (SAN). For this test, Cisco helped us to set up 10 VMs on each of the two setups, and install IOmeter on each virtual machine. IOmeter was configured to read blocks from an iSCSI-based SAN as fast as it possibly could. We manually started each of the twenty IOmeter instances, and after 10 minutes we manually stopped each of them. At the end, we looked at three statistics -- Input/Output Operations per Second, Data Rate, and Average Response Time -- all three averaged across the 10 VMs in each setup. The VM-FEX performance was indeed higher for all three metrics. The data is shown in the graph below:

We were still curious what the difference would be when someone is running a common task on a single VM. We wrote a script to use the open source program mplayer to encode a DVD image file that was stored in the SAN into mpeg (for private use of course). We wrote two versions of the script -- one performed an additional round of encoding. The results of this test run actually showed that the act of fetching blocks off the network-attached DVD were not too resource intensive as the VM-FEX setup required only marginally less time to perform the encoding than the virtual distributed switch setup.

Perhaps the most interesting metric was not the performance, but rather the CPU utilization. How much of the CPU was used for the operation, and how much was left over for other operations and other users? As shown below, the VM-FEX setup used far less of CPU resources in all cases. This was expected, since the CPU was skipping an entire layer of virtual switching, and this was, after all, exactly what Cisco wanted to demonstrate.


Next Page: Virtual Security Gateway
Previous Page: Unified Fabric (UF) – UCS Manager


Back to the Cisco Test Main Page

(0)  | 
Comment  | 
Print  | 
Newest First  |  Oldest First  |  Threaded View        ADD A COMMENT
Flash Poll
From The Founder
Last week I dropped in on "Hotlanta," Georgia to moderate Light Reading's inaugural DroneComm conference – a unique colloquium investigating the potential for drone communications to disrupt the world's telecom ecosystem. As you will see, it was a day of exploration and epiphany...
LRTV Documentaries
Cable Eyeing SDN for Headend, Home Uses

5|26|15   |   05:57   |   (1) comment


CableLabs is looking at virtualizing CMTS and CCAP devices in the headend, as well as in-home devices, says CableLabs' Karthik Sundaresan.
LRTV Documentaries
Verizon's Emmons: SDN Key to Cost-Effective Scaling

5|22|15   |   03:53   |   (0) comments


For Verizon and other network operators to ramp up available bandwidth cost effectively, they need to move to SDN and agree on how to do that.
LRTV Documentaries
Lack of Universal SDN a Challenge

5|21|15   |   04:51   |   (3) comments


Heavy Reading Analyst Sterling Perrin talks about how uncertainty about SDN standards and approaches may be slowing deployment.
LRTV Custom TV
Steve Vogelsang Interview: Carrier SDN

5|20|15   |   05:02   |   (0) comments


Sterling Perrin speaks to Steve Vogelsang, Alcatel-Lucent CTO for IP Routing & Transport business, about the new Carrier SDN-enabling Network Services Platform and the operator challenges it solves.
LRTV Custom TV
Carrier SDN: On-Demand Networks for an On-Demand World

5|20|15   |   20:52   |   (0) comments


Steve Vogelsang, Alcatel-Lucent CTO for IP Routing & Transport business, talks about requirements and benefits of Carrier SDN during the keynote address at the Light Reading Carrier SDN event May 2015.
LRTV Documentaries
The Security Challenge of SDN

5|19|15   |   02:52   |   (0) comments


CenturyLink VP James Feger discusses concerns that virtualization could create new vulnerabilities unless network operators build in safeguards.
LRTV Custom TV
NFV Elasticity – Highly Available VNF Scale-Out Architectures for the Mobile Edge

5|18|15   |   5:50   |   (0) comments


Peter Marek and Paul Stevens from Advantech Networks and Communications Group talk about their NFV Elasticity initiative and the company's latest platforms for deploying virtual network functions at the edge of the network. Packetarium XL and the new Versatile Server Module: 'designed to reach parts of the network that other servers cannot reach.'
LRTV Huawei Video Resource Center
Bay Area Spark Meetup 2015

5|14|15   |   3:54   |   (0) comments


Developed in 2009, Apache Spark is a powerful open source processing engine built around speed, ease of use and sophisticated analytics. This spring, Huawei hosted a meetup for Spark developers and data scientists in Santa Clara, California. Light Reading spoke with organizers and attendees about Huawei's code contributions and long-term commitment to Spark.
LRTV Custom TV
The Transport SDN Buzz

5|12|15   |   06:01   |   (1) comment


Sterling Perrin, senior analyst at Heavy Reading, speaks with Peter Ashwood-Smith of Huawei and Guru Parulkar of ON.Lab about the evolution of transport SDN and the integration of technologies.
LRTV Custom TV
Next-Generation CCAP: Cisco cBR-8 Evolved CCAP

5|5|15   |   04:49   |   (0) comments


John Chapman, Cisco's CTO of Cable Access Business Unit and Cisco Fellow, explained the innovation design of Cisco's cBR-8, the industry's first Evolved CCAP, including DOCSIS 3.1 design from ground-up, distributed CCAP with Remote PHY and path to virtualization. Cisco's cBR-8 Evolved CCAP is the platform that will last through the transitions.
LRTV Custom TV
Meeting the Demands of Bandwidth & Service Group Growth

5|1|15   |   5:35   |   (0) comments


Jorge Salinger, Comcast's Vice President of Access Architecture, explains how DOCSIS 3.1 and multi-service CCAP can meet the demands of the bandwidth and service group growth.
LRTV Custom TV
DOCSIS 3.1: Transforming Cable From Hardware-Defined Network to Software-Defined Network

4|29|15   |   03:48   |   (0) comments


John Chapman, Cisco's CTO of Cable Access Business Unit and Cisco Fellow, explains how DOCSIS 3.1 can transform cable HFC network to a more agile software-defined network.
Upcoming Live Events
June 8, 2015, Chicago, IL
June 9, 2015, Chicago, IL
June 9-10, 2015, Chicago, IL
June 10, 2015, Chicago, IL
September 29-30, 2015, The Westin Grand Müchen, Munich, Germany
October 6, 2015, The Westin Peachtree Plaza, Atlanta, GA
October 6, 2015, Westin Peachtree Plaza, Atlanta, GA
All Upcoming Live Events
Infographics
Procera has gathered facts, stats and customer experience feedback from a survey of 540 users from across the globe.
Hot Topics
10 Alternate Uses for Tablets
Eryn Leavens, Copy Desk Editor, 5/22/2015
Bidding War for TWC Looks Likelier
Alan Breznick, Cable/Video Practice Leader, 5/22/2015
Comcast Targets 6 New Gigabit Markets
Mari Silbey, Senior Editor, Cable/Video, 5/21/2015
Potholes Lurk in Indian Smart City Project
Gagandeep Kaur, Contributing Editor, 5/22/2015
Eurobites: Alcatel-Lucent Trials 400G in Czech Republic
Paul Rainford, Assistant Editor, Europe, 5/26/2015
Like Us on Facebook
Twitter Feed
Webinar Archive
BETWEEN THE CEOs - Executive Interviews
With 200 customers in 60 countries, Stockholm-based Net Insight has carved out a solid leadership position in one of the hottest vertical markets going in comms right now: helping service providers and broadcasters deliver video and other multimedia traffic over IP networks. How has Net Insight managed to achieve this success in the face of immense competition from the industry giants?
My ongoing interview tour of the leading minds of the telecom industry recently took me to Richardson, Texas, where I met with Rod Naphan, CTO and SVP, Solutions, ...
I recently popped down to Texas to chat with CEO Eric L. Pratt about his company, Taqua.
Cats with Phones
Too Fluffy to Talk Click Here
Elmer found that his bountiful fur got in the way of meaningful conversation.