Light Reading

Virtual Machine Fabric Extender Performance

Light Reading
Series Column
Light Reading
1/29/2012
50%
50%

EXECUTIVE SUMMARY: The Cisco UCS’s Virtual Machine Fabric Extender (VM-FEX) offers consistently increased network performance operations compared to virtual distributed switch installations.


In a standard Local Area Network, various hosts, laptops and PCs typically connect to a Layer 2 switch that aggregates the physical stations before handing them off to a router. Communication between two hosts on the same LAN can be done directly without reaching the router. Similarly, a virtual switching instance passes traffic either to a VM sitting in the same hardware, or pushes it out the physical port. Virtual Switches (such as the Cisco Nexus 1000v or VMware’s vNetwork Distributed Switch) operations are done in software and Virtual Switches (such as the Cisco Nexus 1000v or VMware’s vNetwork Distributed Switch) operations are done in software and therefore take resources away from the virtual machines hosted on the blade. Reducing the amount of resources available to the VMs.

Cisco's Nexus 1000v has a rich set of capabilities such as VLAN aggregation, forwarding policies and security. Cisco, however, found that not all VM installations require these features, and in such cases it makes sense to save the resources taken by the virtual switch and appropriate them to the customer needs.

Cisco claimed that their Virtual Machine Fabric Extender (VM-FEX) in VMDirect mode replaces the switch and shows a significant increase in CPU performance for network intensive applications. VM-FEX, installed on VMWare ESX 5.0, enables all VM traffic to be automatically sent out on the UCS's Virtual Interface Card (VIC). This meant more traffic on the physical blade network interface, but reduced CPU usage, which is typically the VM bottleneck. To verify that the VM-FEX really frees up CPU resources, we ran a series of tests comparing a VM-FEX-enabled UCS blade to a Nexus 1000v virtual switch setup. Both UCS blade installations were identical in all aspects apart from the use of the VM-FEX in one and Nexus 1000v in the other.

We started comparing the performance between the two setups using Ixia’s virtual tools. We installed four Ixia IxNetwork VMs on each of the two UCS blades and sent 3,333 Mbit/s of traffic from each of the first three VMs, toward the fourth for 120 seconds using 1,500-byte frames. In the VM-FEX case we recorded 2.186 percent frame loss, while in the distributed switch environment we recorded 16.19 percent frame loss.

We expected loss in both cases, given the almost 10Gbit/s load we were transmitting in the virtual space. The load was required in order to really keep the CPU busy. We deduced from this initial test result that in the VM-FEX environment less resources were used, which is why the frame loss we recorded was smaller than the loss recorded in the virtual distributed switch setup.

For the next test setup we installed one IxLoad VM on each of the two blades. We configured both IxLoad VMs as HTTP clients that requested traffic from a Web server Cisco configured. The IxLoad emulated clients were configured to try and use as much bandwidth as possible by requesting 10 different objects from 10 URLs repeatedly. The VM-FEX setup reached 9.87 Gbit/s while the distributed switch reached 7.78 Gbit/s. The CPU usage was also significantly higher in the virtual distributed switch setup when compared to the VM-FEX setup.

Using the Ixia test tools we recorded the performance difference we expected. Cisco recommended that we perform a test that relies more heavily on the Storage Area Network (SAN). For this test, Cisco helped us to set up 10 VMs on each of the two setups, and install IOmeter on each virtual machine. IOmeter was configured to read blocks from an iSCSI-based SAN as fast as it possibly could. We manually started each of the twenty IOmeter instances, and after 10 minutes we manually stopped each of them. At the end, we looked at three statistics -- Input/Output Operations per Second, Data Rate, and Average Response Time -- all three averaged across the 10 VMs in each setup. The VM-FEX performance was indeed higher for all three metrics. The data is shown in the graph below:

We were still curious what the difference would be when someone is running a common task on a single VM. We wrote a script to use the open source program mplayer to encode a DVD image file that was stored in the SAN into mpeg (for private use of course). We wrote two versions of the script -- one performed an additional round of encoding. The results of this test run actually showed that the act of fetching blocks off the network-attached DVD were not too resource intensive as the VM-FEX setup required only marginally less time to perform the encoding than the virtual distributed switch setup.

Perhaps the most interesting metric was not the performance, but rather the CPU utilization. How much of the CPU was used for the operation, and how much was left over for other operations and other users? As shown below, the VM-FEX setup used far less of CPU resources in all cases. This was expected, since the CPU was skipping an entire layer of virtual switching, and this was, after all, exactly what Cisco wanted to demonstrate.


Next Page: Virtual Security Gateway
Previous Page: Unified Fabric (UF) – UCS Manager


Back to the Cisco Test Main Page

(0)  | 
Comment  | 
Print  | 
Newest First  |  Oldest First  |  Threaded View        ADD A COMMENT
Educational Resources
sponsor supplied content
Educational Resources Archive
From The Founder
Against the odds, Huawei is growing its telecoms networking equipment business in the US -- that should be ringing some alarm bells for domestic vendors.
Flash Poll
Live Streaming Video
CLOUD / MANAGED SERVICES: Prepping Ethernet for the Cloud
Moderator: Ray LeMaistre Panelists: Jeremy Bye, Leonard Sheahan
Between the CEOs
Metaswitch's New CEO Martin Lund Discusses His Role

9|2|15   |   11:27   |   (2) comments


Technology industry veteran Martin Lund joins Metaswitch Networks this week as the company's new CEO. In this interview, Lund discusses his new role and the industry's progress with Light Reading CEO Steve Saunders. Lund believes that the industry disruption caused by SDN and NFV is creating opportunities for companies like Metaswitch – network software providers ...
Telecom Innovators Video Showcase
Nominum on Leveraging the Power of DNS to Deliver Superior Subscriber Experiences

9|2|15   |   07:13   |   (0) comments


Nominum CEO Gary Messiana talks about the challenges service providers face in competing for a much more sophisticated customer, a customer that has heightened expectations for more personalized and compelling digital experiences. Providers are focusing their efforts on delivering higher value subscriber services, retaining their existing customers and increasing ...
Between the CEOs
CEO Chat With Jeff Miller, ActiveVideo

8|28|15   |   19:05   |   (0) comments


Jeff Miller, President and CEO of ActiveVideo, talks to Light Reading founder and CEO Steve Saunders about the impact of virtualization on the TV and video distribution market.
LRTV Huawei Video Resource Center
Vodafone: Mobile Money Is About Customer Trust

8|27|15   |   06.36   |   (0) comments


Light Reading spoke with Vodafone's Ian Ravenscroft about the unique responsibilities and opportunities facing operators handling customers' financial transactions over the network.
Telecom Innovators Video Showcase
Palo Alto Networks on Expanding in the Carrier/Service Provider Market

8|26|15   |   07:54   |   (0) comments


Alfred Lee from Palo Alto Networks tells Steve Saunders about their new chassis-based system, the PA-7080, and how it can benefit service providers compared to legacy firewalls.
LRTV Custom TV
Global Services Forum Preview

8|25|15   |   02:36   |   (0) comments


Light Reading's CEO and Founder Steve Saunders talks about Huawei's upcoming Global Services Forum with the help of Heavy Reading's Patrick Donegan and Teresa Mastrangelo.
Telecom Innovators Video Showcase
Infoblox on DNS Threat Index

8|19|15   |   04:39   |   (0) comments


Dilip Pillaipakam from Infoblox talks to Steve Saunders about his company's core network services.
Between the CEOs
CEO Chat With Ihab Tarazi, Equinix

8|14|15   |   20:18   |   (1) comment


Equinix CTO Ihab Tarazi talks to Light Reading founder and CEO Steve Saunders about the dramatic changes in the data center, cloud and interconnect markets and discusses the impact of SDN and NFV in the coming years.
Telecom Innovators Video Showcase
The Netformx Ecosystem

8|14|15   |   09:39   |   (1) comment


Ittai Bareket, CEO of Netformx, talks with Steve Saunders about the Netformx Ecosystem, which employs cutting-edge prescriptive analytics to help solution providers maximize profits.
Telecom Innovators Video Showcase
Versa Networks on Leveraging VNFs

8|12|15   |   07:37   |   (0) comments


Kumar Mehta, founder and CEO of stealth mode startup Versa Networks, talks with Steve Saunders about how providers can best leverage virtualized network functions (VNFs).
LRTV Custom TV
Transforming the Network Through OPNFV

8|5|15   |   7:09   |   (0) comments


Sandra Rivera, VP Data Center Group; GM Network Platforms Group, Intel Corporation, on OPNFV Arno and how the industry is coming together to accelerate the deployment of NFV and transform the network.
LRTV Huawei Video Resource Center
Huawei ONS Product Demo

8|3|15   |   6:01   |   (0) comments


Huawei shows at Open Networking Summit 2015 in Santa Clara how its SDN and NFV solutions embrace openness.
Upcoming Live Events
September 16-17, 2015, The Westin Galleria Dallas, Dallas, TX
September 16, 2015, The Westin Galleria Dallas, Dallas, TX
September 16, 2015, The Westin Galleria Dallas, Dallas, TX
September 29-30, 2015, The Westin Grand Müchen, Munich, Germany
October 14-15, 2015, New Orleans Ernest N. Morial Convention Center, New Orleans, LA
November 5, 2015, Hilton Santa Clara, Santa Clara, CA
November 17, 2015, Santa Clara, California
December 1, 2015, The Westin Times Square, New York City
December 2, 2015, The Westin Times Square, New York City
All Upcoming Live Events
Infographics
Cisco's cloud and virtualization portfolio can increase business agility and innovation by building a more flexible network architecture.
Hot Topics
T-Mobile CEO Plays Data Traffic Cop
Sarah Thomas, Editorial Operations Director, 8/31/2015
CEO Chat With Bill Gates
Steve Saunders, CEO and founder, Light Reading, 8/31/2015
Time to Monetize Cable WiFi
Alan Breznick, Cable/Video Practice Leader, 8/31/2015
Carolina Town Becomes First US 10-Gig City
Mari Silbey, Senior Editor, Cable/Video, 9/3/2015
Eurobites: Anite in OSS Tie-Up With Nokia
Paul Rainford, Assistant Editor, Europe, 9/4/2015
Like Us on Facebook
Twitter Feed
September 22, 2015
Media Begins With “Me”
Webinar Archive
BETWEEN THE CEOs - Executive Interviews
Technology industry veteran Martin Lund joins Metaswitch Networks this week as the company's new CEO. In this interview, Lund discusses his new role and the industry's progress with Light Reading CEO Steve Saunders. Lund believes that the industry disruption caused by SDN and NFV is creating opportunities for companies like Metaswitch – network software providers with the agility to embrace new technologies quickly and the ability to deliver on substantial projects for global network operators.
The scene: Last Saturday, lunchtime, the interior of a shi-shi-foo-foo eatery in Manhattan's SoHo district.
Cats with Phones
It's a New Age... Click Here
When smartphones replace stuffed animals.