& cplSiteName &

Mohave Community College Does Disaster Recovery on a Shoestring

Mitch Wagner
9/10/2018
50%
50%

Arizona's Mohave Community College lacks a big student body, big budget, or big IT staff. But it's got a big, sprawling area to cover -- to get from the main campus in Kingman, Arizona, to the furthest campus in Colorado City, requires a four-hour desert drive through three states.

And six months into taking the job as CIO, Mark Van Pelt faced a big crisis: The entire domain went down for 72 hours, nearly shutting down the college. He knew that couldn't happen again, and needed to overhaul the college's disaster recovery (DR) plan, on a community college's shoestring budget.

"Seventy-two hours isn't good enough for a college. We have students who have to turn in homework and do labs online," Van Pelt told Light Reading in an interview at the VMworld customer and partner conference in Las Vegas late last month. "We have working parents and adult students who have to hit the infrastructure remotely."

The outage also took a personal toll on Van Pelt. "Three sleepless nights. Nobody likes that," he says. "I used to do that easier when I was 18. I can't do that anymore."

One of Mohave Community College's five campuses, this one in Bullhead City, Arizona.
One of Mohave Community College's five campuses, this one in Bullhead City, Arizona.

Mohave faced several constraints in updating its DR plan. In addition to the small budget, geographic sprawl, and small IT staff -- just 16 people -- Van Pelt and his team faced a bandwidth constraint. Fiber is unavailable in Mojave County; much of the connectivity comes from low-speed microwave connections.

On the plus side, the campus computing environment is 100% virtualized, other than backup domain controllers. Remote administration is a major reason for the virtualization. Mohave is the fifth largest county in the US by area. The four-hour drive from the main campus in the county seat of Kingman, to Colorado City, goes through Las Vegas, Utah, and Arizona. The nearest campus outside Kingman is an hour away, and Kingman has a remote campus located inside its city limits.

"With that much distance between our campuses, trying to maintain something in, say, Colorado City, manually, would be nightmarish for us," Van Pelt said.

The community college system has five campuses in all, with about 5,000 students.

Van Pelt took over as CIO about two and a half years ago, and the domain went down six months later. DR worked, but required three days: "In 2017, we got a DR test and discovered that 72 hours was the best we can do," Van Pelt said.

Running a secondary server was not an option, as older legacy apps are bound to a particular IP address.

Because Mohave uses VMware for virtualization, VMware NSX was the first place it looked for DR -- and the last too, as it implemented a plan using NSX, VMware's network virtualization and security platform.

"We tend to float toward VMware products first," Josh Walters, Mohave's senior VMware engineer, said. "We support VMware because we haven't had a problem with it."

Mohave used NSX to set up a "ghost network" connecting a backup data center in Kingman, which keeps all 24TB of Mohave's data updated via a gigabit connection. "It's a properly IP'd network that can't be seen by anything else," Van Pelt says.

Setting up the DR architecture was challenging. The campus network needed to be reconfigured properly. The college's network engineer is self-taught, though VMware-certified, and inherited a network from a series of predecessors. "We're a small shop," Van Pelt says. "A lot of times, when you have a small shop, you have configurations that are good enough but not optimized." That had to be corrected.

When the DR architecture was done, Mohave did a DR test in October, breaking the college system's link to Las Vegas to simulate an outage. Recovery time went from 72 hours to 48 minutes.

"When we did it we didn't believe it. So we failed it back over and did it again," Van Pelt said. "It worked for us."

He added, "For a tiny community college, being able to have that kind of resiliency and response is something you don't find."

— Mitch Wagner Follow me on Twitter Visit my LinkedIn profile Visit me on Tumblr Follow me on Facebook Executive Editor, Light Reading

(0)  | 
Comment  | 
Print  | 
Newest First  |  Oldest First  |  Threaded View        ADD A COMMENT
Featured Video
Flash Poll
From The Founder
After almost two decades at Light Reading, it's time for a different optical adventure.
Upcoming Live Events
September 24-26, 2018, Westin Westminster, Denver
October 9, 2018, The Westin Times Square, New York
October 23, 2018, Georgia World Congress Centre, Atlanta, GA
November 6, 2018, London, United Kingdom
November 7-8, 2018, London, United Kingdom
November 8, 2018, The Montcalm by Marble Arch, London
November 15, 2018, The Westin Times Square, New York
December 4-6, 2018, Lisbon, Portugal
March 12-14, 2019, Denver, Colorado
All Upcoming Live Events
Hot Topics
Apple: It's the End of the SIM as We Know It
Iain Morris, International Editor, 9/13/2018
MWCA Day 2 Recap: '5G' Rolls Out & We Roll On
Phil Harvey, US News Editor, 9/14/2018
The Mobile Network Is Becoming a Cloud Service
Phil Harvey, US News Editor, 9/18/2018
MWCA Day 1 Recap: 5G Is Here…?
Phil Harvey, US News Editor, 9/13/2018
So Long, & Good Luck With That
Steve Saunders, Founder, Light Reading, 9/14/2018
Animals with Phones
Live Digital Audio

A CSP's digital transformation involves so much more than technology. Crucial – and often most challenging – is the cultural transformation that goes along with it. As Sigma's Chief Technology Officer, Catherine Michel has extensive experience with technology as she leads the company's entire product portfolio and strategy. But she's also no stranger to merging technology and culture, having taken a company — Tribold — from inception to acquisition (by Sigma in 2013), and she continues to advise service providers on how to drive their own transformations. This impressive female leader and vocal advocate for other women in the industry will join Women in Comms for a live radio show to discuss all things digital transformation, including the cultural transformation that goes along with it.

Like Us on Facebook
Partner Perspectives - content from our sponsors
One Size Doesn't Fit All – Another Look at Automation for 5G
By Stawan Kadepurkar, Business Head & EVP, Hi-Tech, L&T Technology Services
Prepare Now for the 5G Monetization Opportunity
By Yathish Nagavalli, Chief Enterprise Architect, Huawei Software
Huawei Mobile Money: Improving Lives and Accelerating Economic Growth
By Ian Martin Ravenscroft, Vice President of BSS Solutions, Huawei
Dealer Agent Cloud – Empower Your Dealer & Agent to Excel
By Natalie Dorothy Scopelitis, Director of Digital Transformation, Huawei Software
All Partner Perspectives