Charlotte's Web: Who's Best Now?Charlotte's Web: Who's Best Now?

Charlotte’s Web Networks Ltd. plans to announce the results of tests on its core router, the Aranea-1, tomorrow, in another effort to prove that it can outperform the big guns in this field -- the 12410 from Cisco Systems Inc. (Nasdaq: CSCO) and the M160 from Juniper Networks Inc. (Nasdaq: JNPR).

The results indicate that the Aranea-1, when equipped with 32 OC48 (2.5 Mbit/s) ports, has excellent performance. It achieves 100 percent of the maximum theoretical data rate when handling three different sizes of packets (40, 512, and 1,500 bytes), according to Mier Communications Inc. (Miercom), the company that conducted the tests.

The Aranea-1 does a good job of policing congested traffic without compromising performance, latency, or jitter, adds Miercom. It also learns 200,000 BGP (border gateway protocol) routes in 45 seconds while forwarding traffic at line rate, it says.

“There’s more to a router company than hardware, but Charlotte’s got exceptional hardware,” concludes Robert Smithers, Miercom’s president.

In its Lab Testing Summary Report, Miercom makes some flattering comparisons between the results of its tests on Charlotte’s Aranea-1 and the results of tests that it performed a few months ago, comparing the Cisco 12410 and Juniper M160.

However, all of this needs to be taken with a pinch of salt, and doesn’t necessarily mean that the Aranea-1 is the better router.

For a kickoff, Charlotte paid Miercom to conduct the tests, and thus was in a position to specify what aspects of its router should be tested and what ought to be glossed over. It was also able to say what results should be published or kept confidential.

Charlotte asked Miercom to repeat the methodology it had used in its earlier Cisco/Juniper comparison and then add in a couple of extra tests “to up the ante” as Smithers puts it.

That, however, muddies the waters, because Cisco also paid Miercom to conduct the comparison with Juniper. Cisco is known to have kept some results confidential, possibly because they didn’t support the conclusions it trumpeted in its press release (see Cisco Touts Router Test Results). Not surprisingly, Juniper declined to participate in the tests, so it’s also possible that its M160 wasn’t configured as well as it might have been.

In the Charlotte test, Miercom repeated “every test [in the Cisco/Juniper comparison] that was publicly available” according to Smithers. All the same, comparing the results of this comparison with tests conducted on Charlotte’s Aranea-1 a couple of months later is dodgy. “The results don’t directly compare,” acknowledges Smithers.

When considering what might be the highest performance router, it's also worth noting that Cisco and Juniper routers support OC192 (10 Mbit/s) ports, and Charlotte's Aranea doesn't.