3051337-poster-p-1-searching-video-as-test

New Platform Makes Videos As Searchable As Text

New Platform Makes Videos As Searchable As Text

 

To make poorly labeled videos easier to discover, Manhattan-based video analysis startup Dextro is launching a platform that analyzes and tags the contents of publicly available videos, using algorithms to identify common scenes, objects, and speech. Mic, a news site aimed at millennials, has partnered with Dextro and will use the platform, called Sight, Sound & Motion (SSM), to discover newsworthy videos that may otherwise be difficult to find.

"Many of the biggest news stories over the past year had their origin in citizen video, but the sheer volume of user-generated video makes it hard for human eyes to isolate those that are newsworthy," Marcus Moretti, project manager of data at Mic, said in a statement. "Dextro's SSM platform allows us to parse the deluge of video into a stream of relevant, important video that can supplement or generate coverage for Mic."

The SSM platform relies on algorithms that recognize patterns associated with particular activities and events. Dextro founder and CEO David Luan told Fast Company the technology could easily identify videos of the Pope speaking in America this week by detecting scenes of crowds of onlookers, images of Pope Francis himself, and spoken words associated with him.

Read Also:
How Cox Auto Became a Data-driven Organization

"For the first time, for every video, we can pick out not just what’s on screen, but also the sound and motion, and put it into one major model of what’s happening in the video," Luan said. "This takes away all of the need for human-generated metadata, which is incredibly noisy and not that indicative of what the content is."

On Thursday, Dextro published a website that allows visitors to see how the SSM platform analyzes videos recently uploaded to Twitter. The backend of the site, available only to staff at Mic, allows reporters to search for social videos by term, such as "President Obama" or "refugees." (See images in the slideshow above.) Luan said Dextro currently has no plans to expand the SSM dashboard to other news organizations.

In May, Dextro used its video analysis technology to scan and categorize all public Periscope streams in real time. The company's main business is helping clients who own large amounts of video content to index and search their archives, along with educating brands on how they are mentioned in social media videos. With the launch of SSM, the company is for the first time incorporating audio recognition into its video analysis platform.

Read Also:
2014: The Year of Data Disruption


Data Science Congress 2017

5
Jun
2017
Data Science Congress 2017

20% off with code 7wdata_DSC2017

Read Also:
Data science set to transform wireless supply chain

AI Paris

6
Jun
2017
AI Paris

20% off with code AIP17-7WDATA-20

Read Also:
Data science set to transform wireless supply chain

Chief Data Officer Summit San Francisco

7
Jun
2017
Chief Data Officer Summit San Francisco

$200 off with code DATA200

Read Also:
Business analytics services spending to surpass US$100 billion by 2019

Customer Analytics Innovation Summit Chicago

7
Jun
2017
Customer Analytics Innovation Summit Chicago

$200 off with code DATA200

Read Also:
Data science set to transform wireless supply chain

HR & Workforce Analytics Innovation Summit 2017 London

12
Jun
2017
HR & Workforce Analytics Innovation Summit 2017 London

$200 off with code DATA200

Read Also:
Open data could save the NHS hundreds of millions, says top UK scientist

Leave a Reply

Your email address will not be published. Required fields are marked *