A Fast Similarity Join Algorithm Using Graphics Processing Units
- 1 April 2008
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- Vol. 23 (10636382) , 1111-1120
- https://doi.org/10.1109/icde.2008.4497520
Abstract
A similarity join operation A BOWTIE epsiv B takes two sets of points A, B and a value epsiv isin Ropf, and outputs pairs of points p isin A,q isin B, such that the distance D(p, q) les epsiv. Similarity joins find use in a variety of fields, such as clustering, text mining, and multimedia databases. A novel similarity join algorithm called LSS is presented that executes on a graphics processing unit (GPU), exploiting its parallelism and high data throughput. As GPUs only allow simple data operations such as the sorting and searching of arrays, LSS uses these two operations to cast a similarity join operation as a GPU sort-and-search problem. It first creates, on the fly, a set of space-filling curves on one of its input datasets, using a parallel GPU sort routine. Next, LSS processes each point p of the other dataset in parallel. For each p, it searches an interval of one of the space-filling curves guaranteed to contain all the pairs in which p participates. Using extensive theoretical and experimental analysis, LSS is shown to offer a good balance between time and work efficiency. Experimental results demonstrate that LSS is suitable for similarity joins in large high-dimensional datasets, and that it performs well when compared against two existing prominent similarity join methods.Keywords
This publication has 14 references indexed in Scilit:
- Fast and approximate stream mining of quantiles and frequencies using graphics processorsPublished by Association for Computing Machinery (ACM) ,2005
- Fast computation of database operations using graphics processorsPublished by Association for Computing Machinery (ACM) ,2004
- Hardware acceleration for spatial selections and joinsPublished by Association for Computing Machinery (ACM) ,2003
- High-dimensional similarity joinsIEEE Transactions on Knowledge and Data Engineering, 2002
- GESSPublished by Association for Computing Machinery (ACM) ,2001
- High dimensional similarity joins: algorithms and performance evaluationIEEE Transactions on Knowledge and Data Engineering, 2000
- Approximate nearest neighbor queries revisitedPublished by Association for Computing Machinery (ACM) ,1997
- Space-Filling CurvesPublished by Springer Nature ,1994
- Approximate closest-point queries in high dimensionsInformation Processing Letters, 1993
- An effective way to represent quadtreesCommunications of the ACM, 1982