& cplSiteName &

How Data Science Can Boost Network Operations

Kiran Inampudi

Data science techniques have been around for many years and successfully applied in several areas like fraud detection, personalized recommendations, etc. Most recently, these techniques are being leveraged in service provider and telco network operations. The combination of SDN/NFV and data science is becoming a powerful new approach for making networks more reliable and secure.

What is data science?
Data science involves using automated methods to analyze massive amounts of data and to extract knowledge from them. Data science is a broad discipline that includes statistics, computer science, applied mathematics, machine learning/AI and visualization.

One of the common use cases of machine learning is in email spam filters. The algorithms are trained by processing millions of emails that have been pre-categorized as either spam or not. The result is an application that can automatically identify the vast majority of junk email and can also continuously improve and adapt as more examples become available.

Relevance to SP network operations
As SPs adopt SDN/NFV, the underlying network infrastructure has become more complex and distributed. SP operations teams have to deal with the dynamic network with unprecedented change, scale and complexity. In this dynamic SP network environment, it is challenging to predefine and determine what will or could go wrong. Relying on the human correlation processes and manual methods that have been in place for past many decades are no longer effective.

Data science has the potential to transform the way SP network operations are done, including the reduction of manual effort involved in network monitoring, troubleshooting and optimization. However, the trick is how to do it in a way that provides clear business value, embedded into the SP operations workflow, and leveraging expert knowledge combined with the data.

Below is a list (not exhaustive) of emerging use cases of data science with in the context of SP network operations. As the SPs adopt modern technologies and operations practices, more applications will surface.

Reducing alert fatigue
In the new world of SDN/NFV, the number of components that need to be monitored and managed has increased exponentially compared to legacy networks. One of the most significant problems facing SP operations teams today is the overwhelming amount of information from distributed network components that generate logs and alerts.

With minimal prioritization and a high false-positive rate, it impossible for operations teams to focus on what matters. With data science techniques, it is possible to understand the context of the alerts and suppress the ones that are not relevant, resulting in a prioritized list of alerts for SP operations team to review and take action.

Proactive network optimization
Good performance and high availability are the primary goals of SP operations teams. They need to proactively detect, identify and resolve performance crises in their network.

Data science provides a methodology for quickly processing the large quantities of monitoring data generated by the network devices, finding repeating patterns in their behavior and building accurate models of their performance. Anomaly detection methods can be used to automatically spot deviations from normal system behavior that could correspond to network failures. A simple example could be if the number of link errors on a particular network interface in the last ten minutes is three standard deviations higher than on other links in the same network; this could indicate a problem.

Advanced security
Traditional security technologies rely on rules and signatures that only use stale information to find threats. The tactics of adversaries are evolving rapidly, and the number of advanced and unknown threats targeting SP networks continues to increase.

Algorithms can be trained to learn the SP environment and adapt to the threat landscape, making decisions about whether something is malicious, and then providing context for the expert to assist with rapid investigation.

Future of SP operations
Self-driving cars provide important insight into the path that data-driven automation is likely to follow. The general principles used in self-driving cars can be extended into SP network operations domain. Collecting massive amounts of data, allowing algorithms to navigate their way through routine tasks, implementing self-learning systems that can adapt to unpredictable situations. The result is likely to be smart network management software that can perform many SP operations tasks with a high degree of reliability.

Some of the hyper-scale operators (Facebook, LinkedIn, Netflix, etc.) are already using self-healing for some basic operational tasks. In the future, SP operations needs to move towards "management by exception," wherein most common errors and performance degradations are addressed via automated self-healing.

— Kiran Inampui, Global Solutions Management Lead, GSP Services, Cisco Systems Inc. (Nasdaq: CSCO)

(3)  | 
Comment  | 
Print  | 
Newest First  |  Oldest First  |  Threaded View        ADD A COMMENT
User Rank: Light Sabre
10/2/2017 | 9:04:12 AM
Re: Alert fatigue
The more data science can get involved the better. The attacks, and, therefore, the alerts, will keep coming.
User Rank: Light Beer
10/1/2017 | 2:21:35 PM
Are there existing Open source or commercial products that use this approach
Great Article !  We all know about products based on SIEM where the rules need to be explicitly defined for the set of actions to be initiated based on certain triggers.  With the recent advances in data sciene and machine learning it would be of interest to know if there are any ready made solutions or service providers who have taken this approach &  reasied their level of operational maturity to the next level ?
User Rank: Light Sabre
9/30/2017 | 11:36:09 PM
Alert fatigue
Alert fatigue is a very real thing. It's good to see this addressed.
More Blogs from Column
The definition of voice services is widening beyond phone calls, even into IoT. That calls for a more open approach to product development, Ian Maclean of Metaswitch argues.
The shift to cloud is turning unified communications into the next hot service for enterprises as the UCaaS market continues to expand.
Pay-TV providers should focus on four key areas to bring employees and customers along for the ride.
The shift to cloud computing is changing the way business is done. Now, the CFOs and their finance teams are seeing a benefit in cloud as well.
As enterprises spread applications across multiple clouds, they need ways to maintain visibility and control, Ixia's Jeff Harris argues.
Featured Video
From The Founder
Light Reading is spending much of this year digging into the details of how automation technology will impact the comms market, but let's take a moment to also look at how automation is set to overturn the current world order by the middle of the century.
Flash Poll
Upcoming Live Events
November 1, 2017, The Royal Garden Hotel
November 1, 2017, The Montcalm Marble Arch
November 2, 2017, 8 Northumberland Avenue, London, UK
November 2, 2017, 8 Northumberland Avenue London
November 10, 2017, The Westin Times Square, New York, NY
November 16, 2017, ExCel Centre, London
November 30, 2017, The Westin Times Square
May 14-17, 2018, Austin Convention Center
All Upcoming Live Events
With the mobile ecosystem becoming increasingly vulnerable to security threats, AdaptiveMobile has laid out some of the key considerations for the wireless community.
Hot Topics
Is US Lurching Back to Monopoly Status?
Carol Wilson, Editor-at-large, 10/16/2017
'Brutal' Automation & the Looming Workforce Cull
Iain Morris, News Editor, 10/18/2017
Muni Policies Stymie Edge Computing
Carol Wilson, Editor-at-large, 10/17/2017
Pai's FCC Raises Alarms at Competitive Carriers
Carol Wilson, Editor-at-large, 10/16/2017
Worried About Bandwidth for 4K? Here Comes 8K!
Aditya Kishore, Practice Leader, Video Transformation, Telco Transformation, 10/17/2017
Animals with Phones
Selfie Game Strong Click Here
Latest Comment
Live Digital Audio

Understanding the full experience of women in technology requires starting at the collegiate level (or sooner) and studying the technologies women are involved with, company cultures they're part of and personal experiences of individuals.

During this WiC radio show, we will talk with Nicole Engelbert, the director of Research & Analysis for Ovum Technology and a 23-year telecom industry veteran, about her experiences and perspectives on women in tech. Engelbert covers infrastructure, applications and industries for Ovum, but she is also involved in the research firm's higher education team and has helped colleges and universities globally leverage technology as a strategy for improving recruitment, retention and graduation performance.

She will share her unique insight into the collegiate level, where women pursuing engineering and STEM-related degrees is dwindling. Engelbert will also reveal new, original Ovum research on the topics of artificial intelligence, the Internet of Things, security and augmented reality, as well as discuss what each of those technologies might mean for women in our field. As always, we'll also leave plenty of time to answer all your questions live on the air and chat board.

Like Us on Facebook
Twitter Feed
Partner Perspectives - content from our sponsors
The Mobile Broadband Road Ahead
By Kevin Taylor, for Huawei
All Partner Perspectives