Searching the web with mobile images for location recognition
- 13 November 2004
- proceedings article
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- Vol. 2, 76-81
- https://doi.org/10.1109/cvpr.2004.1315147
Abstract
In this paper, we describe an approach to recognizing location from mobile devices using image-based web search. We demonstrate the usefulness of common image search metrics applied on images captured with a camera-equipped mobile device to find matching images on the World Wide Web or other general-purpose databases. Searching the entire web can be computationally overwhelming, so we devise a hybrid image-and-keyword searching technique. First, image-search is performed over images and links to their source web pages in a database that indexes only a small fraction of the web. Then, relevant keywords on these web pages are automatically identified and submitted to an existing text-based search engine (e.g. Google) that indexes a much larger portion of the web. Finally, the resulting image set is filtered to retain images close to the original query. It is thus possible to efficiently search hundreds of millions of images that are not only textually related but also visually relevant. We demonstrate our approach on an application allowing users to browse web pages matching the image of a nearby location.Keywords
This publication has 10 references indexed in Scilit:
- Context-based vision system for place and object recognitionPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2003
- Indoor-outdoor image classificationPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2002
- Searching the WebACM Transactions on Internet Technology, 2001
- PicSOM – content-based image retrieval with self-organizing mapsPattern Recognition Letters, 2000
- Multiple evidence combination in image retrievalPublished by Association for Computing Machinery (ACM) ,2000
- Visual contextual awareness in wearable computingPublished by Institute of Electrical and Electronics Engineers (IEEE) ,1998
- ImageRover: a content-based image browser for the World Wide WebPublished by Institute of Electrical and Electronics Engineers (IEEE) ,1997
- Query by image and video content: the QBIC systemComputer, 1995
- The design and use of steerable filtersPublished by Institute of Electrical and Electronics Engineers (IEEE) ,1991
- Term-weighting approaches in automatic text retrievalInformation Processing & Management, 1988