Improve Throughput of Storage Cluster Interconnected with a TCP/IP Network Using Intelligent Server Grouping - Network and Parallel Computing
Conference Papers Year : 2010

Improve Throughput of Storage Cluster Interconnected with a TCP/IP Network Using Intelligent Server Grouping

Abstract

Cluster-based storage systems connected with TCP/IP networks are expected to achieve a high throughput by striping files across multiple storage servers. However, for the storage system interconnected with the TCP/IP network, several critical issues, like Incast effect and data access interference, invalidate the assumption that higher access parallelism always results in increased I/O throughput. To address this issue, we propose a new file striping strategy, named as storage server grouping (SSG), which changes file striping pattern across the storage servers based on the analysis of file popularity and impact of the number of storage servers on the clients' perceived performance (I/O speedup) to reduce the interference of data accesses to popular files and avoid dramatic reduction of system throughput caused by the Incast effect. Our experimental evaluation shows that SSG can improve I/O throughput by 22.1% on average.
Fichier principal
Vignette du fichier
final-paper.pdf (1.54 Mo) Télécharger le fichier
Origin Files produced by the author(s)
Loading...

Dates and versions

hal-01054971 , version 1 (11-08-2014)

Licence

Identifiers

Cite

Xuechen Zhang, Guiquan Liu, Song Jiang. Improve Throughput of Storage Cluster Interconnected with a TCP/IP Network Using Intelligent Server Grouping. IFIP International Conference on Network and Parallel Computing (NPC), Sep 2010, Zhengzhou, China. pp.373-389, ⟨10.1007/978-3-642-15672-4_31⟩. ⟨hal-01054971⟩
69 View
107 Download

Altmetric

Share

More