Google has launched an audio search indexing experiment that allows users to find spoken words inside videos and jump to the portion of the video where the words are spoken.
The Google Audio Indexing (GAUDI), developed by the company's Google Labs project, runs the same internally developed underlying speech technology used in the Elections Video Search Gadget that was rolled by the company out in July. The GAUDI tool will initially be available only for YouTube election videos, though Google said it plans to eventually offer it for use with other videos.
"As more and more video content is being created everyday, Google Audio Indexing tries to make it easier for people to find and consume spoken content from videos on the Web," Google noted in an online FAQ. "We see it as an experimental platform where we can learn what features make the best user experience for people looking for spoken content on the web."
After GAUDI users type a query into a search box, they can refine search results using channel filters, which correspond to one or more YouTube channels. For example, a user could choose videos from the John McCain channel, the Barack Obama channel or from all YouTube political channels.
A search result includes a thumbnail of the video, its title, the time since it was published, the duration and the number of times the query terms are spoken in the video, Google said. Users can click on a result to display the video itself. Mentions of the query terms are shown as yellow markers on the YouTube player timeline. Users can mouse over a yellow marker to read the transcript of the words. Clicking on the marker will play the audio.
The technology also lets users query inside a video, and to share results with other people. Users can send a URL to friends, who can click on it and be redirected to the same page, the same query and the same video from the original search, according to Google.
GAUDI uses speech technology to transform spoken words into text, and then indexes the text using Google's search technology. Google crawls YouTube political channels for new content, and as new videos are uploaded, they are processed and made available to GAUDI for indexing.
Ionut Alex Chin, a blogger at Google Operating System, noted that the GAUDI interface is attractive because it allows users to find all the mentions of their keywords and jump directly to the appropriate sequence in the video.
However, he also noted that the service does have hiccups.
"In the video 'Obama on the 40th Anniversary of the Prague Spring,' Czechoslovakia is incorrectly detected as 'tech also but there,' 'free' is replaced by "forty" and there are many other mistakes," Chin added.