& cplSiteName &

Big Data Saves T-Mobile Big Bucks

Carol Wilson
6/25/2014
50%
50%

By moving to new Hadoop 2.0-based data storage from data store provider RainStor, T-Mobile has been able to dramatically increase the speed of its data queries, while sharply decreasing the physical size of the storage infrastructure.

As a result of the changes, the mobile operator can now more quickly identify and thus fix network and device problems, improving customer experience and more effectively targeting network upgrade dollars, says Art Popp, principal architect at T-Mobile US Inc.

RainStor Inc. formally announced its Archive Application availability for Hadoop 2.0 yesterday, and is targeting the telecom and banking sectors. RainStor's secret sauce is massive compression that allows much more efficient storage of raw data to use in conducting queries that help telecom operators such as T-Mobile assess where its customers are having problems. (See RainStor Launches Archive on Hadoop 2.0.)

"We store all the customer usage data and keep a log of everywhere you surf, and every destination from which you text something in a huge data store so we can run statistics on it and do very difficult queries, such as determining which handsets are underperforming in rural areas," Popp tells Light Reading.

Storing that volume of data has required a massive physical infrastructure: T-Mobile has been using IBM Corp. (NYSE: IBM) Netezza data warehouse appliances to store 15 billion rows of data a day on 30 racks of physical gear. (Relational database management systems measure stored data in rows). Using its new data storage platform based on Hadoop 2.0, an open-source software framework for Big Data storage and analytics, and the RainStor Archive App, T-Mobile will be able to store half a trillion rows of data at a time on eight racks of equipment.

After running massively parallel computing systems since 2006, T-Mobile was looking for less expensive ways to expand and found that Hadoop-based systems were less than half the cost of the IBM Netezzas, Popp says. The carrier deployed its first Hadoop infrastructure in April of 2013. But looking at the support needed for its LTE launch led Popp's crew to search for data compression options and that let to RainStor.

"We realized that with our current infra we would only be able to [store and analyze] 30-60 days of data and we wanted more if possible," Popp says. After a long proof of concept trial with RainStor, running what he calls the 30 hardest queries against seven billion rows of data, T-Mobile found RainStor ran "twice as fast in every circumstance and sometimes as much as 13 times faster."

All other features aside, Popp says, "a true 2X performance that saves us $2 million in gear -- that was an easy sell."

Being able to analyze customer data quickly saves T-Mobile money in bigger ways by enabling the operator to solve problems without just constantly adding expensive infrastructure to improve coverage, since some problems are not coverage-related.

Popp shared a couple of examples: T-Mobile was able to determine where the popular iPhone 5 handsets were underperforming Androids on its network based on customer data, and then conducted more intensive testing to determine the cause of the problem so it could be fixed. That process can help keep iPhone 5 fans from jumping ship.

His team was also able to identify an area of LTE coverage in which an abnormally high number of dual-mode phones were stuck on 3G.

"We know this annoys the customer and we know they will never call in and tell us," Popp says. "It's a subtle RF engineering thing we have to fix. But we may never know about it. Anytime analytics can reveal some subtlety that is beyond the noise of customer care tickets, that helps us."

Being able to use Big Data in this way translates to T-Mobile's bottom line in multiple ways: The first most obvious one is in customer retention, but the second one is in delaying network investment, even if it's just for a few months or a few quarters.

There was a time when the answer to most problems was to overbuild the infrastructure, Popp says, but those days are over. No matter how much capacity and spectrum is made available today, consumers will consume it quickly by finding new ways of using their smartphones.

As he notes, usage isn't likely to level out until all of the company's almost 50 million customers "can watch Netflix videos for six hours a day" on their mobile devices.

RainStor has specifically developed its compression system for stable data stores such as those from telecom and banking, which are machine-generated and don't change much, says Chief Architect Mark Cusack.

"What we are bringing to bear here is the specialized compression, security, query and data lifecycle management and governance capabilities specific to telco log data," he says.

— Carol Wilson, Editor-at-Large, Light Reading

(8)  | 
Comment  | 
Print  | 
Newest First  |  Oldest First  |  Threaded View        ADD A COMMENT
Ariella
50%
50%
Ariella,
User Rank: Light Sabre
6/26/2014 | 4:57:37 PM
Re: That's Entertainment!
" the TV that judges your reaction and reacts!" I don't know, Carol. It reminds me of a scene in 1984 in which the instructor on the exercise program notices the protagonist is not doing what she says and takes him to task for it. It gets a bit too Big Brotherish to be watched in that way.
Carol Wilson
50%
50%
Carol Wilson,
User Rank: Blogger
6/26/2014 | 9:41:18 AM
Re: That's Entertainment!
Wow, that would be interesting - the TV that judges your reaction and reacts! I'm not sure that's entirely a Big Data issue, but certainly sounds intriguing. 

 
jabailo
50%
50%
jabailo,
User Rank: Light Sabre
6/26/2014 | 1:23:17 AM
That's Entertainment!
In some sense, how many channels do I need.

With a web browser, I have one "channel" and it can be fed many different content streams, that I skip around through.

In the old days of TV, I sit in front of my tube, and with the remote I skip around hoping "something good is on".

Then Netflix improves the experience, clusting a bunch of programs...but I still have to look to find "something good".

Next, it advises me as to what to watch.  And sometimes it succeeds, but often it simply recommends something based on the last thing I watched.   Not a very good system as within any category, there is both excellent, and poor, works.

So, how about a "TV" I turn on and it has all this brainpower and simply does the surfing for me based on this huge data warehouse full of activities, recommendations, comments, ratings.

Wouldn't that be great if I could just park myself in front of the TV and let it entertain me in the best way it knows how, perhaps even judging my reactions in real time!

 
Ariella
50%
50%
Ariella,
User Rank: Light Sabre
6/25/2014 | 3:41:26 PM
Re: big data
@Carol absolutely. It just boggles my mind that the companies do let customers slip away that easily. Both my husband and I contacted Verizon reps before switching. Both confirmed that the best they could do in terms of pricing was to offer a package that cost more than what Cablevision was offering for new customers. So we made the switch, and only after that did they try to say, "why did you leave us?" They had not just one but two chances to keep us as customers, but having half the monopoly on the area makes them too complacent to do so. I was told my my Cablevision technician that his company is no better, as far as that goes. 
Carol Wilson
50%
50%
Carol Wilson,
User Rank: Blogger
6/25/2014 | 3:31:32 PM
Re: big data
That is amazingly short-sighted. I've been fortunate in that we've had three broadband options for a while now and been able to play them against each other fairly regularly, so that we keep our prices down without switching, on the broadband side. 

Video is another animal - content costs are making them all move higher and there doesn't seem to be a good option there, other than doing it all online. 

I think in the mobile space they are used to competing more heartily and have seen the bottom line impact of failing to retain the customers you spend so many marketing dollars trying to attract. 
Ariella
50%
50%
Ariella,
User Rank: Light Sabre
6/25/2014 | 3:13:14 PM
Re: big data
@Carol yes. It always amazes me that some companies just don't care about retaining customers. For example, where I live Verizon and Cablevision are the only 2 options for high speed internet. But each one only offers promotional pricing for new customers. Should you tell one that you got an offer from the rival for a lower rate than they're charging, they will not meet it. They will only stick with their rack rates for existing customers. Consequently, some people just switch from one to the other every 6 months to get the best rates. That's not exactly the way to retain customers or foster feelings of loyalty.
Carol Wilson
50%
50%
Carol Wilson,
User Rank: Blogger
6/25/2014 | 2:15:19 PM
Re: big data
Certainly there is much more that analytics can do for telecom but what struck me about this is the fundamental importance of this stuff to T-Mobile's success as a company. They are spending big bucks to acquire customers and if they can't keep them because of the kind of problems described above, the company will basically be spending its way out of business. 
Ariella
50%
50%
Ariella,
User Rank: Light Sabre
6/25/2014 | 1:06:50 PM
big data
Anything that keeps customers from jumping ship is valuable, and that's just one of the many things that big data can do for businesses. 
Educational Resources
sponsor supplied content
Educational Resources Archive
Light Reading’s Upskill U is a FREE, interactive, online educational resource that delivers must-have education on themes that relate to the overall business transformation taking place in the communications industry.
NEXT COURSE
Wednesday, July 27, 1:00PM EDT
The Changing Face of the Data Center World
Rodney M. Elder, Senior Solutions Architect, Equinix
UPCOMING COURSE SCHEDULE
Wednesday, August 3, 1:00PM EDT
The Central Office Re-Architected as a Data Center
Guru Parulkar, Executive Director, Open Networking Research Center, Open Networking Lab
Wednesday, August 10, 1:00PM EDT
Telcos & Open Source 101
Phil Robb, Senior Technical Director, OpenDaylight
Friday, August 12, 1:00PM EDT
The Role of Open Source in NFV
Jim Fagan, Director, Cloud Practice, Telstra
in association with:
From The Founder
In the first episode of a four-part series, Light Reading Founder and CEO Steve Saunders and Calix President and CEO Carl Russo drive around town discussing the disruptive mega-changes in the communications industry and where hope lies for service providers to meet the escalating demands of the cloud.
Flash Poll
Live Streaming Video
Charting the CSP's Future
Six different communications service providers join to debate their visions of the future CSP, following a landmark presentation from AT&T on its massive virtualization efforts and a look back on where the telecom industry has been and where it's going from two industry veterans.
Telecom Innovators Video Showcase
VeEX Test & Measurement Solutions

7|25|16   |   08:57   |   (0) comments


Cyrille Morelle, president and CEO of VeEX Inc., talks test and measurement with Light Reading's Steve Saunders at BCE 2016. This includes innovative products such as VeSion Cloud-Based platform for network monitoring; MTTplus Modular Test platform for Access, Business, Carrier Ethernet, Transport and Core services; and OPX-BOX+ for Fiber Optics.
LRTV Custom TV
VeEX: Live From BCE 2016

7|25|16   |   03:20   |   (0) comments


VeEX's Senior Director of Business Development, Perry Romano, explains how VeEX provides tools to help install, maintain, monitor and manage network infrastructure efficiently and effectively. The portfolio of products on display include the RXT-6000, MTTplus and TX300s.
LRTV Custom TV
Real-Time Telemetry & Analytics for Intelligent SDN Orchestration

7|25|16   |   03:09   |   (0) comments


Packet Design CEO Scott Sherwood discusses how real-time network telemetry and analytics are enabling a new breed of SDN orchestration applications.
From the Founder
The Russo Report: Driving Disruption

7|25|16   |   07:44   |   (0) comments


In the first episode of a four-part series, Light Reading Founder and CEO Steve Saunders and Calix President and CEO Carl Russo drive around town discussing the disruptive mega-changes in the communications industry and where hope lies for service providers to meet the escalating demands of the cloud.
LRTV Custom TV
NetScout: Maximizing Enterprise Cloud for Digital Transformation

7|20|16   |   04:53   |   (0) comments


Light Reading Editor Mitch Wagner talks to NetScout CMO Jim McNiel about maximizing the benefits of enterprise cloud and digital transformation while minimizing potential pitfalls with a proper monitoring and instrumentation strategy.
Women in Comms Introduction Videos
Ciena's VP Offers a Career Crash Course

7|20|16   |   4:14   |   (2) comments


How did Ciena's Vice President of Sales, Angela Finn, carve out her career path? Simple, she tells WiC. She stayed true to her company, customers and principles. She shares her advice for women on how to be authentic and credible, as well as for companies that want to make a real change to their culture and practices.
LRTV Custom TV
NFV in 2016: Part 2 – Climbing the Virtualization Maturity Curve

7|19|16   |   06:56   |   (0) comments


Many of the initial use case implementations are single-vendor and self-contained. The industry is still climbing the virtualization maturity curve, needing further clarity and stability in the NFV infrastructure (NFVi) and greater availability and choice of virtualized network functions (VNFs). Interoperability between NFVis and VNFs from different vendors ...
Telecom Innovators Video Showcase
Versa Networks' Kumar Mehta on SD-WAN Managed Services

7|19|16   |     |   (0) comments


In Silicon Valley, Steve Saunders sits down with Versa's Kumar Mehta for an interview focused on why service providers are building SD-WAN managed services, and how Versa's telco customers are innovating.
LRTV Custom TV
Juniper Networks & The Evolution of NFV

7|19|16   |   06:01   |   (0) comments


Senior Juniper Networks executives talk to Light Reading Founder & CEO Steve Saunders about NFV developments and the recent independent evaluation by test lab EANTC of Juniper's Cloud CPE solution.
LRTV Interviews
CenturyLink Goes Beyond Managed WiFi

7|19|16   |     |   (0) comments


CenturyLink's managed WiFi allows enterprises, such as retailers and resorts, to track guest WiFi usage in order to help them better communicate with customers.
LRTV Interviews
AT&T Launches Network Functions on Demand

7|17|16   |   05:26   |   (0) comments


Roman Pacewicz, Senior Vice President, Offer Management & Service Integration, AT&T Business Solutions, discusses the operator's launch of its Network Functions on Demand service.
LRTV Interviews
Enterprise Pitch for Ciscosson

7|14|16   |   04:43   |   (0) comments


After seven months of near silence, Cisco and Ericsson executives publicly discussed details on their extensive partnership. Among the tidbits shared by Martin Zander, VP, group strategy programs, Ericsson, and Doug Webster, VP service provider marketing, Cisco: The partnership was initially launched to serve the service provider market, but is already gaining ...
Upcoming Live Events
September 13-14, 2016, The Curtis Hotel, Denver, CO
September 27, 2016, Philadelphia, PA
November 3, 2016, The Montcalm Marble Arch, London
November 30, 2016, The Westin Times Square, New York City
December 6-8, 2016,
May 16-17, 2017, Austin Convention Center, Austin, TX
All Upcoming Live Events
Infographics
Five of the Top 10 most targeted countries in Check Point Software Technologies' global Malware & Threat Index for Q1 2016 are in Africa.
Hot Topics
Verizon Sports Big Plans for Yahoo
Alan Breznick, Cable/Video Practice Leader, Light Reading, 7/26/2016
Kevin Lo's Move to Facebook: Sign of Things to Come?
Patrick Donegan, Chief Analyst, Heavy Reading, 7/20/2016
Verizon's Next With VNFs
Carol Wilson, Editor-at-large, 7/21/2016
Facebook Gets Its Drone On
Ray Le Maistre, Editor-in-chief, 7/22/2016
Ericsson Ejects CEO Vestberg
Ray Le Maistre, Editor-in-chief, 7/25/2016
Like Us on Facebook
Twitter Feed
BETWEEN THE CEOs - Executive Interviews
There's no question that, come 2020, 5G technology will turn the world's conception of what mobile networking is on its head. Within the world of 5G development, Dr. ...
I've enjoyed interviewing many interesting people since I rejoined Light Reading, but William A. "Bill" Owens certainly takes the biscuit, as we say where I come from.
Animals with Phones
Live Digital Audio

Our world has evolved through innovation from the Industrial Revolution of the 1740s to the information age, and it is now entering the Fourth Industrial Revolution, driven by technology. Technology is driving a paradigm shift in the way digital solutions deliver a connected world, changing the way we live, communicate and provide solutions. It can have a powerful impact on how we tackle some of the world’s most pressing problems. In this radio show, Caroline Dowling, President of Communications Infrastructure & Enterprise Computing at Flex, will join Women in Comms Director Sarah Thomas to discuss the impact technology has on society and how it can be a game-changer across the globe; improving lives and creating a smarter world. Dowling, a Cork, Ireland, native and graduate of Harvard Business School's Advanced Management Program, will also discuss her experience managing an international team focused on innovation in an age of high-speed change.