Multiple Bernoulli relevance models for image and video annotation
Top Cited Papers
- 12 November 2004
- proceedings article
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- Vol. 2, 1002-1009
- https://doi.org/10.1109/cvpr.2004.1315274
Abstract
Retrieving images in response to textual queries requires some knowledge of the semantics of the picture. Here, we show how we can do both automatic image annotation and retrieval (using one word queries) from images and videos using a multiple Bernoulli relevance model. The model assumes that a training set of images or videos along with keyword annotations is provided. Multiple keywords are provided for an image and the specific correspondence between a keyword and an image is not provided. Each image is partitioned into a set of rectangular regions and a real-valued feature vector is computed over these regions. The relevance model is a joint probability distribution of the word annotations and the image feature vectors and is computed using the training set. The word probabilities are estimated using a multiple Bernoulli model and the image feature probabilities using a non-parametric kernel density estimate. The model is then used to annotate images in a test set. We show experiments on both images from a standard Corel data set and a set of video key frames from NIST's Video Trec. Comparative experiments show that the model performs better than a model based on estimating word probabilities using the popular multinomial distribution. The results also show that our model significantly outperforms previously reported results on the task of image and video annotation.Keywords
This publication has 8 references indexed in Scilit:
- Rapid object detection using a boosted cascade of simple featuresPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2005
- Object class recognition by unsupervised scale-invariant learningPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2003
- Automatic image annotation and retrieval using cross-media relevance modelsPublished by Association for Computing Machinery (ACM) ,2003
- Modeling annotated dataPublished by Association for Computing Machinery (ACM) ,2003
- A statistical method for 3D object detection applied to faces and carsPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2002
- Normalized cuts and image segmentationPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2000
- 10.1162/153244303322533214Applied Physics Letters, 2000
- Example-based learning for view-based human face detectionPublished by Institute of Electrical and Electronics Engineers (IEEE) ,1998