Voxalead: search inside videos

What is Voxalead?

Voxalead is a technology demonstrator developed by the ExaLabs team that searches inside multimedia content (audio and video).

The demo uses a Speech-to-Text transcription module from LIMSI (IT Laboratory for Mechanics and Engineering Sciences, an entity of CNRS) to transcribe German and French political speeches.

Note: LIMSI can transcript the following languages: French, English, German, Spanish, Arab and Chinese. It is possible to interface with other suppliers to handle other languages or to provide transcriptions.

 

The demo is composed of two parts:

• An interface similar to Exalead.com's video search
• A video player (cf image)

The player displays the transcription of text next to the video. Clicking on a word brings the video directly to this precise time, with search words indicated in bold face (here: Yann Athus-Berthrand).

 

The next version will feature a new player as well as the addition of time coded comments. It will then be possible to index those comments and search within them.

Different parameters influence the quality of the transcription:

• Sound quality (acoustic frequency, ambient noise ...)
• Quality of elocution (ex: a debate is very hard to capture because it is difficult to detect the change in voice and tone. On the opposite side, the speech of a political figure will not pose much difficulty.)
• Type of language used (model based on the dictionary)
• Source of the signal
• Pronunciation (accent, ex. English spoken by a Spanish person)

To address all these parameters, several modules exist and are specialized for example by language, by signal origin etc.

The openness of Exalead's technological platform allows integration with all specialized technology suppliers on the market. The Exalabs team is open to propositions from partners who specialize in these domains. To get in touch with the team, click here.

Try the demo here: http://voxaleadnews.labs.exalead.com/