Pipeline and Data Parallel Hybrid Indexing Algorithm for Multi-core Platform
Abstract
The scale and growth rate of today’s text collection bring new challenges for index construction. To tackle this problem, Pipeline and Data Parallel Hybrid Algorithm (PDPH), is proposed to improve the indexing performance for multi-core platform. Compared to existing sequential indexing algorithms, Pipeline and data parallelism are introduced by the PDPH to improve the algorithm flexibility and scale the performance with more cores. Evaluations showed this algorithm can improve index construction speed for multi-core platform.
Origin | Files produced by the author(s) |
---|
Loading...