Extreme video retrieval
- 23 October 2006
- proceedings article
- Published by Association for Computing Machinery (ACM)
- p. 385-394
- https://doi.org/10.1145/1180639.1180721
Abstract
We present an efficient system for video search that maximizes the use of human bandwidth, while at the same time exploiting the machine's ability to learn in real-time from user selected relevant video clips. The system exploits the human capability for rapidly scanning imagery augmenting it with an active learning loop, which attempts to always present the most relevant material based on the current information. Two versions of the human interface were evaluated, one with variable page sizes and manual paging, the other with a fixed page size and automatic paging. Both require absolute attention and focus of the user for optimal performance. In either case, as users search and find relevant results, the system can invisibly re-rank its previous best guesses using a number of knowledge sources, such as image similarity, text similarity, and temporal proximity. Experimental evidence shows a significant improvement using the combined extremes of human and machine power over either approach alone.Keywords
This publication has 13 references indexed in Scilit:
- Efficient Margin-Based Rank Learning Algorithms for Information RetrievalPublished by Springer Nature ,2006
- Retin al: an active learning strategy for image category retrievalPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2005
- Successful approaches in the TREC video retrieval evaluationsPublished by Association for Computing Machinery (ACM) ,2004
- On the detection of semantic concepts at TRECVIDPublished by Association for Computing Machinery (ACM) ,2004
- Active learning using pre-clusteringPublished by Association for Computing Machinery (ACM) ,2004
- Rapid, Serial and Visual: a presentation technique with potentialInformation Visualization, 2002
- Support vector machine active learning for image retrievalPublished by Association for Computing Machinery (ACM) ,2001
- The Elements of Statistical LearningPublished by Springer Nature ,2001
- Multimedia access and retrieval (panel session)Published by Association for Computing Machinery (ACM) ,1999
- A Decision-Theoretic Generalization of On-Line Learning and an Application to BoostingJournal of Computer and System Sciences, 1997