TD-interpreter: enhancing the understanding of timing diagrams with visual-language learning
Year: 2026
Type: article
Abstract: We introduce TD-Interpreter, a specialised machine learning (ML) workflow that assists engineers in understanding complex timing diagrams (TDs), originating from a third party, during their design and verification process. The outcome of this workflow is a visual question-answer environment which allows engineers to input a set of TDs and ask design and verification queries regarding these TDs. To address limited training data availability, we developed a synthetic data generation pipeline that aligns visual information with its textual interpretation. We then implemented TD-Interpreter using a lightweight 7B Multimodal Large Language Model (MLLM), guided by both supervised fine-tuning (SFT) and reinforcement learning (RL). We also developed extensive TD-reasoning benchmarks from simple retrieval tasks to complex reasoning problems in the real world. Our experimental results show that TD-Interpreter substantially outperformed both the untuned base model, and commercial MLLMs (GPT-5.2), on the evaluated benchmarks, demonstrating the effectiveness of the proposed workflow.
Source: Computing
Authors: Jie He, Vincent Theo Willem Kenbeek, Zhantao Yang, Meixun Qu, Ezio Bartocci, Dejan Ničković, Radu Grosu
Language: English
Subfield: Computer Vision and Pattern Recognition
Field: Computer Science
Domain: Physical Sciences
Open Access status: hybrid
Estimated APC paid: $3,290
OpenAlex ID: W4414877016
FWCI:
Cites:
Cited by:
Related to: