Metacurate-ML: Conceptual Comparison
Year: 2024
Type: article
Abstract: Questions from the CLOSER DDI-Lifecycle repository will be used to assist in training a model that is capable of using questions and response domains from the metadata extraction workstream to create conceptually equivalent items from which data variables can be concorded. Approaches such as fine-tuned large language model (LLM)-based relevance scores model and vector retrieval-LLM reordering will be presented. The session will present initial results in question concept tagging that feed into the conceptual comparison task, addressing challenges of long-tail distribution of the data, model memorisation and human annotation bias in the dataset. Higher-level machine learning (ML) limitations of identifying indeterminate tags and the notion of probability in model outputs will be explored.
Authors: Li, Wing Yan, De, Suparna, Wang, Zeqiang, Lungley, Deirdre, Bradshaw, Paul, Johnson, Jon
Institutions: University of Surrey, University of Essex
Language: English
Topic: Topic Modeling
Subfield: Artificial Intelligence
Field: Computer Science
Domain: Physical Sciences
Open Access status: green
Awards: G6972678495, G7483196170
OpenAlex ID: W6930923224
FWCI:
Cites:
Cited by:
Related to: