Load balancing for term-distributed parallel retrieval
Loading...
Citations
Scopus:
Altmetric:
Altmetric::
Download
Associated Records
File Licence
Editors
Date
2006-01-01
Source Title
Proceedings of the Twenty Ninth Annual International ACM SIGIR Conference on Research and Development in Information Retrieval
Journal Title
Journal ISSN
Volume Title
Publisher
ACM
Melbourne Authors
Affiliation
Computer Science and Software Engineering
Document Type
Conference Paper
Subject Code
Citation
Moffat, A., Webber, W. & Zobel, J. (2006). Load balancing for term-distributed parallel retrieval. Proceedings of the Twenty Ninth Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, 2006, pp.348-355. ACM. https://doi.org/10.1145/1148170.1148232.
Access Status
This item is currently not available from this repository
Access URL
Open Access URL
Open Access at PMC
Linked Resource URL
NHMRC Grant Code
ARC Grant Code
Description
ACM SIGIR Conference on Research and Development in Information Retrieval
Abstract
Large-scale web and text retrieval systems deal with amounts of data that greatly exceed the capacity of any single machine. To handle the necessary data volumes and query throughput rates, parallel systems are used, in which the document and index data are split across tightly-clustered distributed computing systems. The index data can be distributed either by document or by term. In this paper we examine methods for load balancing in term-distributed parallel architectures, and propose a suite of techniques for reducing net querying costs. In combination, the techniques we describe allow a 30% improvement in query throughput when tested on an eight-node parallel computer system.
Notes
Terms of Use
Keywords
Information Systems