I/O Optimizations Based on Workload Characteristics for Parallel File Systems - IFIP - Lecture Notes in Computer Science Access content directly
Conference Papers Year : 2019

I/O Optimizations Based on Workload Characteristics for Parallel File Systems

Abstract

Parallel file systems usually provide a unified storage solution, which fails to meet specific application needs. In this paper, we propose an extended file handle scheme to address this problem. It allows the file systems to specify optimizations for individual file or directory based on workload characteristics. One case study shows that our proposed approach improves the aggregate throughput of large files and small files by up to 5% and 30%, respectively. To further improve the access performance of small files in parallel file systems, we also propose a new metadata-based small file optimization method. The experimental results show that the aggregate throughput of small files can be effectively improved through our method.
Fichier principal
Vignette du fichier
486810_1_En_24_Chapter.pdf (461.43 Ko) Télécharger le fichier
Origin : Files produced by the author(s)

Dates and versions

hal-03770539 , version 1 (06-09-2022)

Licence

Attribution

Identifiers

Cite

Bing Wei, Limin Xiao, Bingyu Zhou, Guangjun Qin, Baicheng Yan, et al.. I/O Optimizations Based on Workload Characteristics for Parallel File Systems. 16th IFIP International Conference on Network and Parallel Computing (NPC), Aug 2019, Hohhot, China. pp.305-310, ⟨10.1007/978-3-030-30709-7_24⟩. ⟨hal-03770539⟩
13 View
20 Download

Altmetric

Share

Gmail Facebook X LinkedIn More