& cplSiteName &

Virtual Machine Fabric Extender Performance

Light Reading
Series Column
Light Reading
1/29/2012
50%
50%

EXECUTIVE SUMMARY: The Cisco UCS’s Virtual Machine Fabric Extender (VM-FEX) offers consistently increased network performance operations compared to virtual distributed switch installations.


In a standard Local Area Network, various hosts, laptops and PCs typically connect to a Layer 2 switch that aggregates the physical stations before handing them off to a router. Communication between two hosts on the same LAN can be done directly without reaching the router. Similarly, a virtual switching instance passes traffic either to a VM sitting in the same hardware, or pushes it out the physical port. Virtual Switches (such as the Cisco Nexus 1000v or VMware’s vNetwork Distributed Switch) operations are done in software and Virtual Switches (such as the Cisco Nexus 1000v or VMware’s vNetwork Distributed Switch) operations are done in software and therefore take resources away from the virtual machines hosted on the blade. Reducing the amount of resources available to the VMs.

Cisco's Nexus 1000v has a rich set of capabilities such as VLAN aggregation, forwarding policies and security. Cisco, however, found that not all VM installations require these features, and in such cases it makes sense to save the resources taken by the virtual switch and appropriate them to the customer needs.

Cisco claimed that their Virtual Machine Fabric Extender (VM-FEX) in VMDirect mode replaces the switch and shows a significant increase in CPU performance for network intensive applications. VM-FEX, installed on VMWare ESX 5.0, enables all VM traffic to be automatically sent out on the UCS's Virtual Interface Card (VIC). This meant more traffic on the physical blade network interface, but reduced CPU usage, which is typically the VM bottleneck. To verify that the VM-FEX really frees up CPU resources, we ran a series of tests comparing a VM-FEX-enabled UCS blade to a Nexus 1000v virtual switch setup. Both UCS blade installations were identical in all aspects apart from the use of the VM-FEX in one and Nexus 1000v in the other.

We started comparing the performance between the two setups using Ixia’s virtual tools. We installed four Ixia IxNetwork VMs on each of the two UCS blades and sent 3,333 Mbit/s of traffic from each of the first three VMs, toward the fourth for 120 seconds using 1,500-byte frames. In the VM-FEX case we recorded 2.186 percent frame loss, while in the distributed switch environment we recorded 16.19 percent frame loss.

We expected loss in both cases, given the almost 10Gbit/s load we were transmitting in the virtual space. The load was required in order to really keep the CPU busy. We deduced from this initial test result that in the VM-FEX environment less resources were used, which is why the frame loss we recorded was smaller than the loss recorded in the virtual distributed switch setup.

For the next test setup we installed one IxLoad VM on each of the two blades. We configured both IxLoad VMs as HTTP clients that requested traffic from a Web server Cisco configured. The IxLoad emulated clients were configured to try and use as much bandwidth as possible by requesting 10 different objects from 10 URLs repeatedly. The VM-FEX setup reached 9.87 Gbit/s while the distributed switch reached 7.78 Gbit/s. The CPU usage was also significantly higher in the virtual distributed switch setup when compared to the VM-FEX setup.

Using the Ixia test tools we recorded the performance difference we expected. Cisco recommended that we perform a test that relies more heavily on the Storage Area Network (SAN). For this test, Cisco helped us to set up 10 VMs on each of the two setups, and install IOmeter on each virtual machine. IOmeter was configured to read blocks from an iSCSI-based SAN as fast as it possibly could. We manually started each of the twenty IOmeter instances, and after 10 minutes we manually stopped each of them. At the end, we looked at three statistics -- Input/Output Operations per Second, Data Rate, and Average Response Time -- all three averaged across the 10 VMs in each setup. The VM-FEX performance was indeed higher for all three metrics. The data is shown in the graph below:

We were still curious what the difference would be when someone is running a common task on a single VM. We wrote a script to use the open source program mplayer to encode a DVD image file that was stored in the SAN into mpeg (for private use of course). We wrote two versions of the script -- one performed an additional round of encoding. The results of this test run actually showed that the act of fetching blocks off the network-attached DVD were not too resource intensive as the VM-FEX setup required only marginally less time to perform the encoding than the virtual distributed switch setup.

Perhaps the most interesting metric was not the performance, but rather the CPU utilization. How much of the CPU was used for the operation, and how much was left over for other operations and other users? As shown below, the VM-FEX setup used far less of CPU resources in all cases. This was expected, since the CPU was skipping an entire layer of virtual switching, and this was, after all, exactly what Cisco wanted to demonstrate.


Next Page: Virtual Security Gateway
Previous Page: Unified Fabric (UF) – UCS Manager


Back to the Cisco Test Main Page

(0)  | 
Comment  | 
Print  | 
Newest First  |  Oldest First  |  Threaded View        ADD A COMMENT
Educational Resources
sponsor supplied content
Educational Resources Archive
From The Founder
Cisco's Conrad Clemson, recently promoted to head up the company's Service Provider Apps & Platforms developments, talks to Light Reading's Founder and CEO Steve Saunders about how he's bringing cloud video, mobile and virtualization together to empower network operators.
Flash Poll
Live Streaming Video
Charting the CSP's Future
Six different communications service providers join to debate their visions of the future CSP, following a landmark presentation from AT&T on its massive virtualization efforts and a look back on where the telecom industry has been and where it's going from two industry veterans.
LRTV Custom TV
How Intel Is Powering the 5G Era

3|29|17   |     |   (0) comments


Light Reading tours a series of 5G "super demos" so see how Intel envisions the 5G-connected future. We take a look at a prototype connected BMW, a light pole with environmental sensors that provides 5G wireless to a smart home and a fully untethered virtual reality experience.
LRTV Custom TV
Source Photonics CEO Doug Wright Talks About the Future of Source Photonics

3|29|17   |     |   (0) comments


Source Photonics' CEO, Doug Wright, talks to Light Reading about how the company is continuously investing in its operations to meet not only its customers' current technology demands but also to deliver their next-generation technology needs.
LRTV Custom TV
Live Demo: DevOps in Service Chains & 5G Network Slices PoC

3|29|17   |     |   (0) comments


Executives from PoC collaborating companies – Patrick Waldemar, VP and Head of Technology at Telenor Research, John Healy, VP of the Datacenter Network Solutions Group at Intel, Vincent Spinelli, SVP of Global Sales and Marketing at RIFT.io, Mats Eriksson, CEO and co-founder of Arctos Labs, and Mats Nordlund, CEO and co-founder of Netrounds – review ...
LRTV Documentaries
The Year of Fat & Skinny Bundles

3|29|17   |   21:06   |   (0) comments


In this fireside chat, Roku's Andrew Ferrone predicts that 2017 will be the year of multichannel OTT video bundles and spells out other trends in the OTT and pay-TV markets.
LRTV Huawei Video Resource Center
BBWF 2016: Orange Poland's Next-Gen Central Office

3|28|17   |     |   (0) comments


Introduction to Orange Poland's legacy next-generation central office solution.
LRTV Custom TV
Viavi at OFC 2017

3|28|17   |   4:15   |   (0) comments


Light Reading's Editor-in-Chief Craig Matsumoto reports from the Viavi booth at OFC and gets an update on the 400G testing market from Tom Fawcett, VP and GM of LAB & Production. At this year's event, Viavi won three awards from Lightwave magazine and showcased an interoperability demo with Ethernet Alliance and Finisar.
LRTV Custom TV
Connecting the Entire Home With DOCSIS 3.1

3|28|17   |   3:58:   |   (0) comments


Hitron Technologies had the first cable modem certified for DOCSIS 3.1 and already has over 120,000 units in the field. Greg Fisher, CTO of Hitron, provides an update on his company's rollout of new gateways and why he thinks DOCSIS 3.1 will continue to drive value for operators into 2017 and beyond.
LRTV Interviews
Amazon Prime's Hand of God Creator on Producing for OTT

3|28|17   |     |   (1) comment


Ben Watkins is the creator, writer and producer of Hand of God, a series on Amazon Prime. At Light Reading's Cable Next-Gen conference in Denver, he explained the advantages of producing for an OTT platform versus traditional TV.
LRTV Custom TV
How Metrological Keeps Cable Customers on the Couch

3|28|17   |     |   (0) comments


Metrological offers an open source solution that reduces the time it takes cable operators to integrate OTT content into the linear television viewing experience.
LRTV Documentaries
The ABC of OTT

3|28|17   |     |   (0) comments


At Light Reading's Cable Next-Gen conference in Denver, Ben Watkins, creator of Amazon Prime's Hand of God show, explained how producing content for an OTT platform differs from producing content for traditional TV.
Shades of Ray
Why Analytics Is the Tech World's Digital Glue

3|27|17   |   02:20   |   (0) comments


It was obvious at the massive annual CeBIT enterprise tech trade show that the foundation for tech innovation right now is real-time analytics.
LRTV Custom TV
CommScope – Meeting the Demands of Tomorrow's Networks

3|24|17   |     |   (0) comments


Phil Sorksy, Vice President International at CommScope, discusses addressing the challenges faced by service providers today, and as future trends emerge.
Upcoming Live Events
May 15-17, 2017, Austin Convention Center, Austin, TX
May 15, 2017, Austin Convention Center - Austin, TX
June 6, 2017, The Joule Hotel, Dallas, TX
All Upcoming Live Events
Infographics
With the mobile ecosystem becoming increasingly vulnerable to security threats, AdaptiveMobile has laid out some of the key considerations for the wireless community.
Hot Topics
FTTH No Slam Dunk for Cable
Carol Wilson, Editor-at-large, 3/23/2017
Unlocking China's $194B Telecom Market
Robert Clark, 3/27/2017
WiCipedia: Supergirls, No More Excuses & Media Monitoring
Eryn Leavens, Special Features & Copy Editor, 3/24/2017
Welcome to the Wild West of Privacy
Carol Wilson, Editor-at-large, 3/24/2017
Like Us on Facebook
Twitter Feed
BETWEEN THE CEOs - Executive Interviews
TEOCO Founder and CEO Atul Jain talks to Light Reading Founder and CEO Steve Saunders about the challenges around cost control and service monetization in the mobile and IoT sectors.
At MWC 2017, Qualcomm's CTO Matt Grob talks to Light Reading's CEO and Founder Steve Saunders about the progress being made in the development of the technologies and standards that will underpin 5G.
Animals with Phones
Working From Home Doesn't Work for Everyone Click Here
You shouldn't nap on your keyboard, for instance.
Live Digital Audio

Playing it safe can only get you so far. Sometimes the biggest bets have the biggest payouts, and that is true in your career as well. For this radio show, Caroline Chan, general manager of the 5G Infrastructure Division of the Network Platform Group at Intel, will share her own personal story of how she successfully took big bets to build a successful career, as well as offer advice on how you can do the same. We’ll cover everything from how to overcome fear and manage risk, how to be prepared for where technology is going in the future and how to structure your career in a way to ensure you keep progressing. Chan, a seasoned telecom veteran and effective risk taker herself, will also leave plenty of time to answer all your questions live on the air.