Open Data and Open LVLMs: How to Explore Scientific Collections Differently
Year: 2025
Type: article
Abstract: We exemplify how multimodal agentic chatbots based on Large-Vision-Language-Models (LVLMs) can be leveraged as a tool for interactive and engaging exploration of scientific collections from diverse dicsiplines. Thereby, we demonstrate a potential beyond digital showcases. Specifically, with our tool we aim to make interesting scientific artifacts, often hidden behind complex search interfaces, more accessible and engaging, for non-experts and the general public.In bringing together the vast amount of openly available scientific collections with open source LVLMs, we showcase how open science leverages hidden potentials in academic institutions. Our contribution focuses on the perspective of scientific collection of data as data, which not only serves the research community but also the interested public. By using more explorative layers for data linkage and retrieval through application of state-of-the-art Artificial Intelligence technology, we open up new and more accessible entry points for the data and its underlying relationsSearch via conventional portals requires some expertise in the field. Enhancing it with an interactive chat interface, which can answer questions about the scientific collection portal in general, their collections, and single objects within, opens up an intuitive approach for all kinds of users of the collection portal.
Authors: Vogel, Iris, Schneider, Florian, Ahmadi, Narges Baba, Ahmadi, Niloufar Baba, Biemann, Chris, Semmann, Martin
Institution: Universität Hamburg
Language: English
Subfield: Information Systems
Field: Computer Science
Domain: Physical Sciences
Open Access status: green
OpenAlex ID: W7083684199
FWCI:
Cites:
Cited by:
Related to: