Friday, 25 August 2017

Twitch acquired ClipMine

In an announcement about a set of new discovery tools, Amazon-owned video game streaming site Twitch also unveiled that it recently acquired Palo Alto-based video indexing platform ClipMine. The startup’s technology is now being put to use to translate visual information in videos – like objects, text, logos and scenes – into metadata that can help people more easily find the streams they want to watch.
Launched back in 2015, ClipMine had originally introduced a platform designed for crowdsourced tagging and annotations. The idea then was to offer a technology that could sit over top videos on the web – like those on YouTube, Vimeo or DailyMotion – that allowed users to add their own annotations. This, in turn, would help other viewers find the part of the video they wanted to watch, while also helping video publishers learn more about which sections were getting clicked on the most.

The company later pivoted to focus on the e-sports industry, with tools that could extract information from game videos like player names, game type, number of gaming sessions per stream, and more. It also shifted away from the idea of crowdsourcing to take advantage of other technologies, like computer vision and machine learning.

Twitch’s interest in the company’s deep learning-based video indexing platform was due to its ability to analyze video content – like gamer’s streams – to identify what’s taking place in those streams, who’s playing and other variables. It has now put this technology to use with the launch of new stream discovery tools for Blizzard Entertainment’s “Overwatch” and “Hearthstone.” In the directories for those game streams, viewers are able to filter channels by a number of factors, including by hero on “Overwatch” streams, by game mode, player rank, number of wins, and by hero class on “Hearthstone” streams.

No comments: