Firefox Plugin Annodex For Searching Audio, Video

loser in front of a computer writes "ZDNet Australia reports that 'Australia's CSIRO research organisation has developed a Firefox plugin named Annodex that allows browsing through time-continuous media such as audio and video in the same way that HTML allows browsing through text.' I've just checked Annodex out and it's very cool. The sample video from the Perl conference is way funny too." The catch is, the media to be searched has to be prepped first.

Of course

[shreevatsa]

The catch is, the media to be searched has to be prepped first.
Isn't that obvious? It's too much to expect it to be able to search video without knowing what it is.

Not likely at currently then

[jokumuu]

If the media has to be specially prepared for this to work, I do not see this taking off currently until the search engine can do the prepping fast and simple from the orginal unprepped media.

MirrorDot

[Agret]

loser in front of a computer writes "ZDNet Australia reports that 'Australia's CSIRO research organisation has developed a Firefox plugin named Annodex [mirrordot.org] ? [google.com] that allows browsing through time-continuous media [mirrordot.org] ? [google.com] such as audio and video in the same way that HTML allows browsing through text.' I've just checked Annodex out and it's very cool. The sample video from the Perl conference is way funny too." The catch is, the media to be searched has to be prepped first [mirrordot.org] ? [google.com] ... Full Slashdot Story [mirrordot.org]

Read more...

[MicroBerto]

Unfortunately, in order to remain loyalty-free, it only supports Ogg Theora. How many of those videos do you see out there? I see none.

A cool application, nonetheless.

Re:Not likely at currently then

[Agret]

How could a computer possibly work out what media is sports or music videos or anime or tv shows or whatever. We need a new format like WMV (It contains XML type things in it) with XML wrapped inside that can be extracted and read that contains proper Genre and Category and such. I think WMV has this but it's not compulsury and doesn't get used often. If these formats were to take off then I could see this happening.

I dunno

[earthbound kid]

Isn't the whole point of time-continuous media to watch it through a continued period of time? Putting hyperlinks into a video just turns your web browser into an improved version of the Sega CD or 3DO. I'll admit this technology has its place, but I wonder how big that place is...

Re:Not likely at currently then

[luvirini]

Yes indeed that is the core of the problem, in order to search something, the search algoritm has to understand the content to be searched.

Currently trying to get a computer to understand something in pictures, even less in motion pictures is very inaccurate and extremly prosessor intensive, unless one uses a really small subset(like fingerprint recognition)

Re:Of course

[jokumuu]

well, to be revolutionary it would require that capability. As it is now, it is simply a toy to play around with and then forget about.

Re:Of course

[bogado]

You understand that to be able to search you must read the content before, right? Google does read all the pages to index them, this is a preprocessing stage. I don't see why this requirement is a impediment. Sure video processing is time consuming, but downloading videos are also time and bandwidth consuming, so in general searching videos is harder, much harder then text.

YAML (Yet Another Markup Language)

[atomic noodle]

Good to see this is open source and works with FireFox, but it's a shame they have to resort to marketing babble and buzzword bingo (see below) to get any media attention for their work. Basically this is YAML (Yet Another Markup Language). They're definitely not the first to do video indexing... search 'VAML', for example.

Project leader Dr Silvia Pfeiffer, says that the applications of Annodex(TM) are many and varied.

"Users are discouraged by the complexity of search for clips within vast online multimedia collections. They are demanding a technology that lets them actively search for content," says Dr Pfeiffer.

"Annodex(TM) and the standards behind it allow them to do just that - it will revolutionise the way we search for time-continuous data. Annodex(TM) also allows video content to be explored using any digitally networked device - including mobile phones, handheld PDAs and digital TV."

Besides entertainment, Annodex(TM) has many other practical applications such as searching medical information, environmental measurements and network load statistics - on demand."

The groundbreaking technology behind Annodex(TM) is known as Continuous Media Markup Language (CMML). CMML does for time-continuous media what HTML does for text. It allows the user to search, access, navigate and query.

Re:Read more...

[phaxkolumbo]

Now, I might be wrong, but chances are that what you got instead of Ogg Theora compressed files were Ogg Media Files [faireal.net] (.ogm).

OGM is a container format for audio/video that supports multiple subtitles (just like you mentioned) and multiple audio tracks. From what I personally know, the video is usually compressed with XviD and the audio with Ogg Vorbis.

(see also Matroska [matroska.org] which does the above, and more)

Re:Read more...

[Buzzard2501]

That would be OGM + Ogg Vobis, not Ogg Theora. OGM is a video and audio container like AVI, while Ogg Theora is a video codec (based on VP3 IIRC)