Google & Amazon Heat Up Machine Learning Rivalry

Mitch Wagner
12/5/2017

Google and Amazon are stepping up their competition on machine learning, with both companies introducing new video and natural language recognition tools to help customers make sense of piles of undifferentiated moving images and words.

Google (Nasdaq: GOOG) plans on Tuesday to launch general availability of its Cloud Video Intelligence machine learning API to analyze video content, including providing video transcription. And it's adding Content Classification to its Cloud Natural Language platform, to automatically classify content into more than 700 categories

For Cloud Video Intelligence, Google is adding deeper video analysis tools, including shot change detection, content moderation, and detection of 20,000 labels, to identify 180 different types of fruits, including kiwis and jujubes; 229 models of airplanes; 667 car models; and more than 200 types of buildings, including supermarkets and convention centers, according to a post scheduled to go live Tuesday morning by Wei Hua, Google engineering manager for cloud AI Video Solutions, on the Google Cloud Big Data and Machine Learning Blog.

A Google demo shows how a user can search a large library of videos for the keyword "baseball" -- like running a Google search on the web -- and find only videos pertaining to that sport. The result shows which videos have baseball, and when in each video baseball appears.

Cloud Video Intelligence can now automatically transcribe video audio into text. The feature is in private beta in English only, but will expand to new languages.

Hua outlines several customer use cases for the video service. Incentro, which provides IT solutions on Google Cloud Platform for media and publishing customers, uses machine learning to help its customers store and find digital media assets. Cloud Video Intelligence lists details in videos and labels and timestamps where the details can be found. Previous solutions were manual, time-consuming and less complete and accurate than the automated tool, Google says.

Robotix Media uses the Google video tool to optimize social marketing campaigns, analyzing video ad performance.

Google's Content Classification sorts documents and content into more than 700 different categories, including Arts & entertainment, Hobbies & Leisure, Law & Government, News and Health. Hearst Newspapers is using the system to classify more than 3,000 articles daily.

Amazon debuts video, natural language tools
At last week's AWS re:Invent conference, Amazon Web Services Inc. introduced its own machine learning improvements. Amazon Rekognition Video is a follow-up to AWS's Amazon Rekognition service introduced last year, which searches, analyzes and organizes millions of still images. Rekognition Video provides real-time video analytics, detecting objects and scenes, such as a package arriving, or inappropriate video content, celebrity video and person tracking. Using technology called Skeleton Monitoring, Rekognition Video can track people even when they are outside the frame, AWS CEO Andy Jassy said.

Amazon introduced Video Kinesis Video Streams to get video from cameras, phones, satellites, radar and other diverse devices where video lives, into the cloud, Jassy said.

Amazon Transcribe provides long-form speech recognition on a WAV or MP3 audio file, with applications such as call logs, video subtitling, capturing presentations and meetings. The service will be initially available in English and Spanish, with other languages to come. Unlike other automated transcription services, Amazon Transcribe adds punctuation and formatting, rather than producing an undifferentiated stream of text. Amazon Transcribe timestamps every word to align subtitles to video. It supports lower-quality audio, such as phone calls.

In coming months, the transcription service will be able to distinguish between multiple speakers, and users will be able to add custom vocabulary libraries.

The new Amazon Translate service automatically translates text into different languages for realtime translation and batch analytics, with automatic language recognition -- the service will recognize what language a person is speaking.

And the new Amazon Comprehend is a fully managed natural language processing service, which can understand documents such as social networking posts and articles stored in a data lake in AWS's S3 storage service. Hotels.com, an Expedia business unit, is using the AWS service to classify reviews and comments to find out what people like and what they don't like, Jassy said. The service will classify documents to sort them into topics and categories such as sports, politics and business. A healthcare provider can organize documents based on symptoms, Jassy said.

Related posts:

— Mitch Wagner Follow me on Twitter Visit my LinkedIn profile Visit my blog Follow me on Facebook Editor, Enterprise Cloud News

(11)  | 
Comment  | 
Print  | 
Newest First  |  Oldest First  |  Threaded View        ADD A COMMENT
Page 1 / 2   >   >>
priyanka10
priyanka10
8/6/2019 | 6:04:55 AM
Artificial Intelligence
I wonder where this technology will take us. When I listen to the best Bluetooth speakers with FM radio India, I think about artificial intelligence and machine learning all the time.
andrewkhinkle
andrewkhinkle
7/2/2019 | 1:03:54 AM
Re: rivalry
Google AI has improved a lot these days. It has become smarter.!!
guloz
guloz
5/28/2018 | 6:11:31 AM
edu
Google is the main server who is handling all the program of the internet world and amazon is also constrained to get services by Google. Amazon will be crippling on internet if dissertation best essay writing will not for sale on the internet.
Phil_Britt
Phil_Britt
12/27/2017 | 12:42:15 AM
Re: rivalry
You're right that without machine learning it takes a ton of time to go through videos. That's why I hate it when I click on a compelling headline and a video pops up. I can read the information faster. And, if well written, I will get more pertinent detail.
danielcawrey
danielcawrey
12/9/2017 | 10:19:45 PM
Re: rivalry
Machine learning for video is direly needed. Discovery on streaming video platforms is really quite poor. 

If these services can do what is promised, there's certainly a lot of potential. 
mhhfive
mhhfive
12/6/2017 | 7:29:18 PM
Re: rivalry
Haha. Yup. You caught it. I don't have the Force, but I try to make some predictions of the future. Do or do not. There is no try. 
Ariella
Ariella
12/6/2017 | 1:29:44 PM
Re: rivalry
@mhhf1ve Yes, it is. I guessed from your syntax that you were referencing this:

 

mhhfive
mhhfive
12/6/2017 | 1:24:58 PM
Re: rivalry
My prediction for how Machine Learning services will specialize is based on what I think each provider has better training data for. Google has search and related ad data that no one else can touch. Facebook has social relationship data. Amazon has logistical data and consumer ecommerce data. I'm not sure exactly how each set will be used to train machine learning systems, but based on these different data sets -- they're bound to come up with different specialties, even if they target the same areas such as natural language processing. The future is hard to see clearly. Always in motion it is.
Ariella
Ariella
12/6/2017 | 12:35:53 PM
Re: rivalry
@mhhf1ve are you sure it will divide quite that neatly? According to the WSJ, the balance is shifting. See https://www.wsj.com/articles/ad-holding-companies-to-rapidly-increase-spending-with-amazon-1512490021?mod=djemCMOToday:

Amazon only has a small slice of digital ad revenue compared with behemoths like Google and Facebook , FB +1.12% but that imbalance might change in the coming years as the top ad holding companies rapidly boost their spending with the e-commerce giant.

Publicis , PUBGY 0.48% WPP and Omnicom OMC -0.59% plan to increase their ad spending with Amazon to upward of $800 million, collectively, according to multiple agency executives.

This year, WPP will spend around $200 million with Amazon, according to Martin Sorrell, chief executive of the world's largest ad holding company. It's spending on Amazon's ad products and platforms—including search and banner ads, for example—may increase 40% to 50% in 2018, according to another holding company executive familiar with the matter.
 

"We are absolutely leaning into Amazon as an ad partner and think there are big advantages to our clients," said Kelly Clark, CEO of WPP's GroupM.

French holding company Publicis also currently spends about $200 million with Amazon, and plans on boosting that figure around 50% to $300 million in 2018, according to a person familiar with the matter.

Omnicom spends around $100 million with Amazon, according to another source. That number could double next year and continue on that trajectory in the following years, the person said.
mhhfive
mhhfive
12/6/2017 | 9:15:16 AM
Re: rivalry
This rivalry will produce services that have different specialties -- so you'll go to google for language translations that can target ads, but you'll go to Amazon for language translations that can more accurately target sentiments or particular meaning.
Page 1 / 2   >   >>
More Blogs from Wagner’s Ring
We're packing our bags for Dallas, for our cleverly named Network Virtualization and SDN Americas conference, but first we sat down to talk about NV, SDN and our favorite travel snack.
Will Apple's new iPhone 11 grow telco profits? Will Apple TV+ compete in a crowded OTT market? And why does everybody have fabulous hair in an Apple TV+ series where civilization has collapsed because everybody in the world is blind?
After years of defending itself against US spying accusations, Huawei claims the US government is spying on it.
The satellite network operator is looking to the Open Networking Automaton Platform (ONAP) to automate connecting its space-based network with terrestrial operators.
VMware's been shopping this summer, buying three cloud and networking startups that will bolster its telco strategy.
Featured Video
Upcoming Live Events
October 22, 2019, Los Angeles, CA
November 5, 2019, London, England
November 7, 2019, London, UK
November 14, 2019, Maritim Hotel, Berlin
December 3-5, 2019, Vienna, Austria
December 3, 2019, New York, New York
March 16-18, 2020, Embassy Suites, Denver, Colorado
May 18-20, 2020, Irving Convention Center, Dallas, TX
All Upcoming Live Events