Work

Guidelines for assessing the accuracy of log message template identification techniques

Year: 2022
Type: conference-paper
Abstract: Log message template identification aims to convert raw logs containing free-formed log messages into structured logs to be processed by automated log-based analysis, such as anomaly detection and model inference. While many techniques have been proposed in the literature, only two recent studies provide a comprehensive evaluation and comparison of the techniques using an established benchmark composed of real-world logs. Nevertheless, we argue that both studies have the following issues: (1) they used different accuracy metrics without comparison between them, (2) some ground-truth (oracle) templates are incorrect, and (3) the accuracy evaluation results do not provide any information regarding incorrectly identified templates.
Language: English
Open Access status: hybrid
OpenAlex ID: W4284692184
FWCI: 14.23
Cites: 25
Cited by: 124
Related to: 9