Sorting large files on a backend multiprocessor
- 1 July 1988
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Computers
- Vol. 37 (7) , 769-778
- https://doi.org/10.1109/12.2222
Abstract
The authors investigate the feasibility and efficiency of a parallel sort-merge algorithm by considering its implementation of the JASMIN prototype, a backend multiprocessor built around a fast packet bus. They describe the design and implementation of a parallel sort utility and present and analyze the results of measurements corresponding to a range of file sizes and processor configurations. The results show that using current, off-the-shelf technology coupled with a streamlined distributed operating system, three- and five-microprocessor configurations, provide a very cost-effective sort of large files. The three-processor configuration sorts a 100-Mb file in 1 hr which compares well to commercial sort packages available on high-performance mainframes. In additional experiments, the authors investigate a model to tune their sort software and scale their results to higher processor and network capabilities.Keywords
This publication has 8 references indexed in Scilit:
- A hardware pipeline algorithm for relational database operationACM SIGARCH Computer Architecture News, 1985
- TheUNIXSystem: Theory and Practice in the Construction of a Working Sort RoutineAT&T Bell Laboratories Technical Journal, 1984
- Overview of the Jasmin database machinePublished by Association for Computing Machinery (ACM) ,1984
- S/NET: A High-Speed Interconnect for Multiple ComputersIEEE Journal on Selected Areas in Communications, 1983
- Duplicate record elimination in large data filesACM Transactions on Database Systems, 1983
- Access path selection in a relational database management systemPublished by Association for Computing Machinery (ACM) ,1979
- Task communication in DEMOSPublished by Association for Computing Machinery (ACM) ,1977
- Parallelism in tape-sortingCommunications of the ACM, 1974