Light Reading

Virtual Machine Fabric Extender Performance

Light Reading
Series Column
Light Reading
1/29/2012
50%
50%

EXECUTIVE SUMMARY: The Cisco UCS’s Virtual Machine Fabric Extender (VM-FEX) offers consistently increased network performance operations compared to virtual distributed switch installations.


In a standard Local Area Network, various hosts, laptops and PCs typically connect to a Layer 2 switch that aggregates the physical stations before handing them off to a router. Communication between two hosts on the same LAN can be done directly without reaching the router. Similarly, a virtual switching instance passes traffic either to a VM sitting in the same hardware, or pushes it out the physical port. Virtual Switches (such as the Cisco Nexus 1000v or VMware’s vNetwork Distributed Switch) operations are done in software and Virtual Switches (such as the Cisco Nexus 1000v or VMware’s vNetwork Distributed Switch) operations are done in software and therefore take resources away from the virtual machines hosted on the blade. Reducing the amount of resources available to the VMs.

Cisco's Nexus 1000v has a rich set of capabilities such as VLAN aggregation, forwarding policies and security. Cisco, however, found that not all VM installations require these features, and in such cases it makes sense to save the resources taken by the virtual switch and appropriate them to the customer needs.

Cisco claimed that their Virtual Machine Fabric Extender (VM-FEX) in VMDirect mode replaces the switch and shows a significant increase in CPU performance for network intensive applications. VM-FEX, installed on VMWare ESX 5.0, enables all VM traffic to be automatically sent out on the UCS's Virtual Interface Card (VIC). This meant more traffic on the physical blade network interface, but reduced CPU usage, which is typically the VM bottleneck. To verify that the VM-FEX really frees up CPU resources, we ran a series of tests comparing a VM-FEX-enabled UCS blade to a Nexus 1000v virtual switch setup. Both UCS blade installations were identical in all aspects apart from the use of the VM-FEX in one and Nexus 1000v in the other.

We started comparing the performance between the two setups using Ixia’s virtual tools. We installed four Ixia IxNetwork VMs on each of the two UCS blades and sent 3,333 Mbit/s of traffic from each of the first three VMs, toward the fourth for 120 seconds using 1,500-byte frames. In the VM-FEX case we recorded 2.186 percent frame loss, while in the distributed switch environment we recorded 16.19 percent frame loss.

We expected loss in both cases, given the almost 10Gbit/s load we were transmitting in the virtual space. The load was required in order to really keep the CPU busy. We deduced from this initial test result that in the VM-FEX environment less resources were used, which is why the frame loss we recorded was smaller than the loss recorded in the virtual distributed switch setup.

For the next test setup we installed one IxLoad VM on each of the two blades. We configured both IxLoad VMs as HTTP clients that requested traffic from a Web server Cisco configured. The IxLoad emulated clients were configured to try and use as much bandwidth as possible by requesting 10 different objects from 10 URLs repeatedly. The VM-FEX setup reached 9.87 Gbit/s while the distributed switch reached 7.78 Gbit/s. The CPU usage was also significantly higher in the virtual distributed switch setup when compared to the VM-FEX setup.

Using the Ixia test tools we recorded the performance difference we expected. Cisco recommended that we perform a test that relies more heavily on the Storage Area Network (SAN). For this test, Cisco helped us to set up 10 VMs on each of the two setups, and install IOmeter on each virtual machine. IOmeter was configured to read blocks from an iSCSI-based SAN as fast as it possibly could. We manually started each of the twenty IOmeter instances, and after 10 minutes we manually stopped each of them. At the end, we looked at three statistics -- Input/Output Operations per Second, Data Rate, and Average Response Time -- all three averaged across the 10 VMs in each setup. The VM-FEX performance was indeed higher for all three metrics. The data is shown in the graph below:

We were still curious what the difference would be when someone is running a common task on a single VM. We wrote a script to use the open source program mplayer to encode a DVD image file that was stored in the SAN into mpeg (for private use of course). We wrote two versions of the script -- one performed an additional round of encoding. The results of this test run actually showed that the act of fetching blocks off the network-attached DVD were not too resource intensive as the VM-FEX setup required only marginally less time to perform the encoding than the virtual distributed switch setup.

Perhaps the most interesting metric was not the performance, but rather the CPU utilization. How much of the CPU was used for the operation, and how much was left over for other operations and other users? As shown below, the VM-FEX setup used far less of CPU resources in all cases. This was expected, since the CPU was skipping an entire layer of virtual switching, and this was, after all, exactly what Cisco wanted to demonstrate.


Next Page: Virtual Security Gateway
Previous Page: Unified Fabric (UF) – UCS Manager


Back to the Cisco Test Main Page

(0)  | 
Comment  | 
Print  | 
Newest First  |  Oldest First  |  Threaded View        ADD A COMMENT
Flash Poll
From The Founder
Ericsson's Hyperscale Datacenter System (HDS) 8000, featuring Intel's Rack Scale Architecture, caused a stir when it was announced at MWC 2015. For more on this revolutionary product, join me on Thursday, April 30 at 12:00 p.m. EST for a Super Webinar event, A New Hardware Paradigm for the Telco Data Center.
LRTV Documentaries
Cox Eyes Cloud-Based Home Networks

4|27|15   |   05:30   |   (0) comments


Cox's Jeff Finkelstein explains how moving services to the cloud will let cable deliver services faster and eliminate constant hardware replacements.
LRTV Documentaries
CableLabs' Clarke Updates Cable Virtualization

4|23|15   |   05:41   |   (1) comment


Former BT exec now leading CableLabs' NFV and SDN efforts explains key role of open source and updates efforts to virtualize the home network.
LRTV Interviews
Ericsson's CTO Talks Transformation: Pt. II

4|23|15   |   08:19   |   (1) comment


In the second installment of an in-depth two-part interview, Ericsson's CTO Ulf Ewaldsson talks to Light Reading CEO and founder Steve Saunders about cultural change, network slicing and technology advances.
LRTV Interviews
Ericsson's CTO Talks Transformation: Pt. I

4|23|15   |   09:27   |   (3) comments


In the first installment of an in-depth two-part interview, Ericsson's CTO Ulf Ewaldsson talks to Light Reading CEO and founder Steve Saunders about the incredible transformation underway in the communications networking industry.
LRTV Documentaries
LTE Paves the Way for the 5G Revolution

4|20|15   |   4:20   |   (0) comments


Håkan Andersson, head of 5G product strategy of the Radio Business Unit at Ericsson, discusses the role of LTE, the US and other industry verticals in building a true 5G ecosystem.
LRTV Documentaries
The 3GPP's Road to 5G Standardization

4|17|15   |   4:43   |   (0) comments


Satoshi Nagata, chairman of the 3GPP's TSG-RAN group and a manager at NTT Docomo, explains the standardization process for 5G, as well as the biggest challenges and opportunities.
LRTV Documentaries
AlcaLu CTO Makes the Case for a New 5G Air Interface

4|16|15   |   3:54   |   (0) comments


Michael Peeters, CTO of wireless at Alcatel-Lucent, explains why 5G will require a new air interface to meet its diverse performance targets.
LRTV Documentaries
AlcaLu + Nokia: The New Uber-Vendor

4|15|15   |   2:42   |   (4) comments


Heavy Reading Senior Analyst Gabriel Brown discusses the technological and competitive opportunities and challenges if a merger between Alcatel-Lucent and Nokia comes to pass.
LRTV Huawei Video Resource Center
Huawei's Data Center Power Play

4|15|15   |   6:22   |   (0) comments


Huawei has developed industry-leading energy efficiency capabilities for its indoor and outdoor data center solutions, explains Dr. Fang Liangzhou, vice president of Huawei's Network Energy product Line.
LRTV Huawei Video Resource Center
Huawei’s Routers, Switches Get the Green Mark

4|15|15   |   2:02   |   (0) comments


TUV Rheinland's Frank Dudley explains how Huawei's routers and switches have been successfully tested by energy efficiency experts and have gained Green Mark Certification.
LRTV Documentaries
A Finn, a Frenchman & a Guy From New Jersey Walk Into a Merger...

4|15|15   |   3:17   |   (0) comments


Stop us if you've heard this one before... Light Reading CEO Founder & CEO Steve Saunders weighs in on the technical and cultural implications of a Nokia and Alcatel-Lucent merger.
LRTV Huawei Video Resource Center
Accounting for Better Solutions

4|10|15   |   02:31   |   (1) comment


Murad Yousuf, CTO at Saudi Arabia's Ministry of Finance (Dept. of Zakat & Income Tax), talks about the benefits of deploying router technology from Huawei.
Upcoming Live Events
May 6, 2015, Georgia World Congress, Atlanta, GA
May 12, 2015, Grand Hyatt, Denver, CO
May 13-14, 2015, The Westin Peachtree, Atlanta, GA
June 8, 2015, Chicago, IL
June 9-10, 2015, Chicago, IL
June 9, 2015, Chicago, IL
June 10, 2015, Chicago, IL
September 29-30, 2015, The Westin Grand Müchen, Munich, Germany
October 6, 2015, Westin Peachtree Plaza, Atlanta, GA
November 11-12, 2015, The Westin Peachtree Plaza, Atlanta, GA
All Upcoming Live Events
Infographics
In its latest survey covering network operators' plans and strategies for ICT transformation, Heavy Reading asked telecom operators worldwide to identify the most important goals and objectives for their ICT transformation initiatives. Heavy Reading also asked operators about the importance of a "digital first" strategy, which enables customers to complete an interaction across different digital channels, such as web and mobile self-service and social media.
Hot Topics
Comcast Formally Ends Its Bid for TWC
Mari Silbey, Independent Technology Editor, 4/24/2015
Comcast Reportedly Dropping $45B TWC Bid
Sarah Thomas, Editorial Operations Director, 4/23/2015
Google's WiFi-First Mobile Service 'Fi' Is Here
Dan Jones, Mobile Editor, 4/22/2015
Amazon Earnings: What to Watch For
Mitch Wagner, West Coast Bureau Chief, Light Reading, 4/23/2015
Adtran Is Developing White Box GPON Tech
Ray Le Maistre, Editor-in-chief, 4/24/2015
Like Us on Facebook
Twitter Feed
Webinar Archive
BETWEEN THE CEOs - Executive Interviews
Many leading communications companies can claim to have undergone significant periods of reinvention during their histories, but none have been through more major ...
Data Center Interconnect, or DCI, is one of the hottest sectors in telecom currently. Since coming back to Light Reading last year, prodigal-son style, I've ...
Cats with Phones
Learning Curve Click Here
Pierre could never remember how to use Excel.
Latest Comment