Work

A Concept for Integrating an LLM-Based Natural Language Interface for Visualizations Grammars

Year: 2025

Type: conference-paper

Abstract: In this paper, we propose a natural language interface visualization framework leveraging visualization grammar to balance the flexibility and stability of generated visualizations. Our system employs a JSON schema for visualization specification and an instruction prompt with semantically distinct sections for task context, visualizations, datasets, and control mechanisms. This design enables robust state management, live prompt adjustments, ensures clarity, consistency, and reusability in visualization generation.

DOI: 10.1145/3701716.3717812

Authors: Adrian Jobst, Daniel Atzberger, Mariia Tytarenko, Willy Scheibel, Jürgen Döllner, Tobias Schreck

Institutions: Hasso Plattner Institute, University of Potsdam, Graz University of Technology

Language: English

Topic: Data Visualization and Analytics

Subfield: Computer Vision and Pattern Recognition

Field: Computer Science

Domain: Physical Sciences

Open Access status: gold

Funders: Bundesministerium für Wirtschaft und Klimaschutz, Austrian Science Fund

Awards: Human-Centered Adaptive Approaches for Health Information, G7935752510

OpenAlex ID: W4410636958

FWCI: 2.57

Cites: 11

Cited by: 3

Related to: 10