System Problem Detection by Mining Process Model from Console Logs - Network and Parallel Computing (NPC 2017)
Conference Papers Year : 2017

System Problem Detection by Mining Process Model from Console Logs

Jian Li
  • Function : Author
  • PersonId : 1027964
Jian Cao
  • Function : Author
  • PersonId : 968615

Abstract

Given the explosive growth of large-scale services, manually detecting problems from console logs is infeasible. In the current study, we propose a novel process mining algorithm to discover process model from console logs, and further use the obtained process model to detect anomalies. In brief, the console logs are first parsed into events, and the events from one single session are further grouped to event sequences. Then, a process model is mined from the event sequences to describe the main system behaviors. At last, we use the process model to detect anomalous log information. Experiments on Hadoop File System log dataset show that this approach can detect anomalies from log messages with high accuracy and few false positives. Compared with previously proposed automatic anomaly detection methods, our approach can provide intuitive and meaningful explanations to human operators as well as identify real problems accurately. Furthermore, the process model is easy to understand.
Fichier principal
Vignette du fichier
457609_1_En_16_Chapter.pdf (190.39 Ko) Télécharger le fichier
Origin Files produced by the author(s)
Loading...

Dates and versions

hal-01705438 , version 1 (09-02-2018)

Licence

Identifiers

Cite

Jian Li, Jian Cao. System Problem Detection by Mining Process Model from Console Logs. 14th IFIP International Conference on Network and Parallel Computing (NPC), Oct 2017, Hefei, China. pp.140-144, ⟨10.1007/978-3-319-68210-5_16⟩. ⟨hal-01705438⟩
119 View
99 Download

Altmetric

Share

More