%0 Conference Proceedings
%T ASTracer: An Efficient Tracing Tool for HDFS with Adaptive Sampling
%+ School of Computer Science [Beihang Univ.]
%A Song, Yang
%A Li, Yunchun
%A Wu, Shuhan
%A Yang, Hailong
%A Li, Wei
%Z Part 4: Big Data+Cloud
%< avec comité de lecture
%( Lecture Notes in Computer Science
%B 16th IFIP International Conference on Network and Parallel Computing (NPC)
%C Hohhot, China
%Y Xiaoxin Tang
%Y Quan Chen
%Y Pradip Bose
%Y Weiming Zheng
%Y Jean-Luc Gaudiot
%I Springer International Publishing
%3 Network and Parallel Computing
%V LNCS-11783
%P 107-119
%8 2019-08-23
%D 2019
%R 10.1007/978-3-030-30709-7_9
%K HDFS
%K Distributed tracing tool
%K Adaptive sampling
%Z Computer Science [cs]Conference papers
%X Existing distributed tracing tools such as HTrace use static probabilistic samplers to collect the function call trees for performance analysis, which may fail to capture important but less executed function call trees and thus miss the opportunities for performance optimization. To address the above problem, we propose ASTracer, a new distributed tracing tool with two adaptive samplers. The advantage of adaptive samplers is that they can adjust the sampling rate dynamically, which is able to capture comprehensive function call trees and in the meanwhile maintain the size of trace file acceptable. In addition, we propose an auto-tuning mechanism to search for the optimal parameter settings of the adaptive samplers in ASTracer. The experiment results demonstrate the adaptive samplers are more effective in tracing the function call trees compared to probabilistic sampler. Moreover, we provide several case studies to demonstrate the usage of ASTracer in identifying potential performance bottlenecks.
%G English
%Z TC 10
%Z WG 10.3
%2 https://inria.hal.science/hal-03770561/document
%2 https://inria.hal.science/hal-03770561/file/486810_1_En_9_Chapter.pdf
%L hal-03770561
%U https://inria.hal.science/hal-03770561
%~ IFIP-LNCS
%~ IFIP
%~ IFIP-TC
%~ IFIP-TC10
%~ IFIP-NPC
%~ IFIP-WG10-3
%~ IFIP-LNCS-11783