Light Reading

Virtual Machine Fabric Extender Performance

Light Reading
Series Column
Light Reading
1/29/2012
50%
50%

EXECUTIVE SUMMARY: The Cisco UCS’s Virtual Machine Fabric Extender (VM-FEX) offers consistently increased network performance operations compared to virtual distributed switch installations.


In a standard Local Area Network, various hosts, laptops and PCs typically connect to a Layer 2 switch that aggregates the physical stations before handing them off to a router. Communication between two hosts on the same LAN can be done directly without reaching the router. Similarly, a virtual switching instance passes traffic either to a VM sitting in the same hardware, or pushes it out the physical port. Virtual Switches (such as the Cisco Nexus 1000v or VMware’s vNetwork Distributed Switch) operations are done in software and Virtual Switches (such as the Cisco Nexus 1000v or VMware’s vNetwork Distributed Switch) operations are done in software and therefore take resources away from the virtual machines hosted on the blade. Reducing the amount of resources available to the VMs.

Cisco's Nexus 1000v has a rich set of capabilities such as VLAN aggregation, forwarding policies and security. Cisco, however, found that not all VM installations require these features, and in such cases it makes sense to save the resources taken by the virtual switch and appropriate them to the customer needs.

Cisco claimed that their Virtual Machine Fabric Extender (VM-FEX) in VMDirect mode replaces the switch and shows a significant increase in CPU performance for network intensive applications. VM-FEX, installed on VMWare ESX 5.0, enables all VM traffic to be automatically sent out on the UCS's Virtual Interface Card (VIC). This meant more traffic on the physical blade network interface, but reduced CPU usage, which is typically the VM bottleneck. To verify that the VM-FEX really frees up CPU resources, we ran a series of tests comparing a VM-FEX-enabled UCS blade to a Nexus 1000v virtual switch setup. Both UCS blade installations were identical in all aspects apart from the use of the VM-FEX in one and Nexus 1000v in the other.

We started comparing the performance between the two setups using Ixia’s virtual tools. We installed four Ixia IxNetwork VMs on each of the two UCS blades and sent 3,333 Mbit/s of traffic from each of the first three VMs, toward the fourth for 120 seconds using 1,500-byte frames. In the VM-FEX case we recorded 2.186 percent frame loss, while in the distributed switch environment we recorded 16.19 percent frame loss.

We expected loss in both cases, given the almost 10Gbit/s load we were transmitting in the virtual space. The load was required in order to really keep the CPU busy. We deduced from this initial test result that in the VM-FEX environment less resources were used, which is why the frame loss we recorded was smaller than the loss recorded in the virtual distributed switch setup.

For the next test setup we installed one IxLoad VM on each of the two blades. We configured both IxLoad VMs as HTTP clients that requested traffic from a Web server Cisco configured. The IxLoad emulated clients were configured to try and use as much bandwidth as possible by requesting 10 different objects from 10 URLs repeatedly. The VM-FEX setup reached 9.87 Gbit/s while the distributed switch reached 7.78 Gbit/s. The CPU usage was also significantly higher in the virtual distributed switch setup when compared to the VM-FEX setup.

Using the Ixia test tools we recorded the performance difference we expected. Cisco recommended that we perform a test that relies more heavily on the Storage Area Network (SAN). For this test, Cisco helped us to set up 10 VMs on each of the two setups, and install IOmeter on each virtual machine. IOmeter was configured to read blocks from an iSCSI-based SAN as fast as it possibly could. We manually started each of the twenty IOmeter instances, and after 10 minutes we manually stopped each of them. At the end, we looked at three statistics -- Input/Output Operations per Second, Data Rate, and Average Response Time -- all three averaged across the 10 VMs in each setup. The VM-FEX performance was indeed higher for all three metrics. The data is shown in the graph below:

We were still curious what the difference would be when someone is running a common task on a single VM. We wrote a script to use the open source program mplayer to encode a DVD image file that was stored in the SAN into mpeg (for private use of course). We wrote two versions of the script -- one performed an additional round of encoding. The results of this test run actually showed that the act of fetching blocks off the network-attached DVD were not too resource intensive as the VM-FEX setup required only marginally less time to perform the encoding than the virtual distributed switch setup.

Perhaps the most interesting metric was not the performance, but rather the CPU utilization. How much of the CPU was used for the operation, and how much was left over for other operations and other users? As shown below, the VM-FEX setup used far less of CPU resources in all cases. This was expected, since the CPU was skipping an entire layer of virtual switching, and this was, after all, exactly what Cisco wanted to demonstrate.


Next Page: Virtual Security Gateway
Previous Page: Unified Fabric (UF) – UCS Manager


Back to the Cisco Test Main Page

(0)  | 
Comment  | 
Print  | 
Newest First  |  Oldest First  |  Threaded View
Flash Poll
From The Founder
Networks of the future will rely on "white box" switches and servers rather than proprietary hardware and that's going to alter the shape of the communications industry. Who says so? John Chambers.
LRTV Huawei Video Resource Center
Huawei Intros Smart Device for eLTE

3|30|15   |   05:25   |   (0) comments


Huawei has developed a secure, location-aware multimedia smartphone for its eLTE trunked radio solution, says Huawei's Norman Frisch.
LRTV Huawei Video Resource Center
Win Video, Win All

3|30|15   |   06:44   |   (0) comments


Video is going to be the next main source of revenue for operators. Operators have big opportunities and advantages to monetize video services. Globally, Huawei has helped more than 70 operators achieve over 30 million video subscribers. Watch this video for more.
LRTV Custom TV
The Benefits of HyperScale Clouds for NFV

3|27|15   |   01:50   |   (0) comments


Hyperscale cloud has been developed by the Internet giants to support the creation and delivery of software-based services at blistering speeds, and at the lowest possible cost. The original ETSI NFV vision was to adopt hyperscale cloud architecture and practices. This vision has become somewhat obscured along the way, due to misunderstandings about the hyperscale ...
LRTV Huawei Video Resource Center
eLTE Rapid Meets the Need for Speed

3|26|15   |   4:45   |   (0) comments


Designed especially for emergency and dedicated ad hoc local mobile communications coverage, Huawei's eLTE Rapid solution can deliver trunked voice, video and data coverage for multiple users over a 6km range and be set up in just 15 minutes, explains Huawei's Norman Frisch.
LRTV Huawei Video Resource Center
On Videos: Challenges & Opportunities

3|26|15   |   5:56   |   (0) comments


Most everything is now connected. And along with 4K and 4G technologies, everyone could be creating and broadcasting video contents. Users are expecting better video experience with any screen, anywhere and anytime. Operators will meet new challenges, but also see some big opportunities.
LRTV Custom TV
JDSU: Delivering Dynamic Networks for a Personalized Experience

3|26|15   |   5:59   |   (0) comments


Light Reading speaks to JDSU at Mobile World Congress 2015 about new solutions in the areas of HetNets, VoLTE, backhaul, virtualization, big data analytics, and real-time intelligence.
LRTV Custom TV
Smarter Service Chaining & New Ways to Benefit From Qosmos Technology

3|25|15   |   03:11   |   (0) comments


David Le Goff, director of strategic and product marketing at Qosmos, explains how the company has added application awareness to subscriber information to make service chaining more efficient and reduce costs for networking and infrastructure. In addition, Qosmos technology, which has been delivered as C libraries, is now also available as a virtual machine, ...
Between the CEOs
Qosmos CEO: The Changing Face of DPI

3|24|15   |   13:53   |   (0) comments


LR CEO and Founder Steve Saunders sits down with the head of Qosmos to talk about the changing state of the art in deep packet inspection technology, including its role in SDN and NFV architectures. Also, how the comms market is becoming more like the automotive industry.
LRTV Huawei Video Resource Center
FC Schalke Scores With Its Agile Stadium

3|24|15   |   6:23   |   (0) comments


Top German soccer club FC Schalke 04 has deployed a new, agile WiFi network from Huawei in its Veltins-Arena stadium and is reaping the benefits in terms of customer satisfaction and business opportunities, explains marketing chief Alexander Jobst.
LRTV Huawei Video Resource Center
Huawei’s Insights on Mobile Video

3|24|15   |   7:51   |   (0) comments


More people than ever are now watching videos on smartphones. Seventy percent of mobile traffic will be video traffic until 2018. In this video, Huawei's exports give their insights on mobile video in terms of business model, network planning and 4G network construction.
LRTV Documentaries
The Rise of Industry 4.0

3|24|15   |   02:26   |   (9) comments


Are you ready for the fourth industrial revolution? It's a big deal for influential operators such as Deutsche Telekom.
LRTV Huawei Video Resource Center
Getting Connected With eLTE

3|23|15   |   06:04   |   (0) comments


Trunked radio communications have entered the 4G LTE world, and with Huawei's eLTE solution, can now deliver a full range of data and video services as well as push-to-talk voice, explains Huawei's Norman Frisch.
Upcoming Live Events
April 14, 2015, The Westin Times Square, New York City, NY
May 5, 2015, Hyatt McCormick Place, Chicago, IL
May 6, 2015, Georgia World Congress, Atlanta, GA
May 12, 2015, Grand Hyatt, Denver, CO
May 13-14, 2015, The Westin Peachtree, Atlanta, GA
June 8, 2015, Chicago, IL
June 9-10, 2015, Chicago, IL
June 9, 2015, Chicago, IL
June 10, 2015, Chicago, IL
September 29-30, 2015, The Westin Grand Müchen, Munich, Germany
All Upcoming Live Events
Hot Topics
AT&T Woos SMBs With Small-Scale WiFi
Sarah Thomas, Editorial Operations Director, 3/26/2015
Just Don't Say IBM Is 'Relaunching' Networking Business
Mitch Wagner, West Coast Bureau Chief, Light Reading, 3/26/2015
TV Everywhere Nears Mainstream Adoption
Mari Silbey, Independent Technology Editor, 3/27/2015
Carriers Are Bright Spot in BlackBerry Q4
Sarah Thomas, Editorial Operations Director, 3/27/2015
Comcast Says TWC Deal Will Close Later
Mari Silbey, Independent Technology Editor, 3/26/2015
Like Us on Facebook
Twitter Feed
Webinar Archive
BETWEEN THE CEOs - Executive Interviews
LR CEO and Founder Steve Saunders sits down with the head of Qosmos to talk about the changing state of the art in deep packet inspection technology, including its role in SDN and NFV architectures.
Chattanooga’s EPB publicly owned utility comms company has become a poster child for how to enable a local economy using next-gen networking technology. Steve Saunders, Founder of Light Reading, sits down with Harold DePriest, president and CEO of EPB, to learn how EPB is bringing big time tech to small town America.