Year: 2026
Type: conference-paper
Abstract: Text embeddings have become an essential part of a variety of language applications.However, methods for interpreting, exploring and reversing embedding spaces are limited, reducing transparency and precluding potentially valuable generative use cases.In this work, we develop an open-source, domain-agnostic framework for aligning Large Language Models to embedding spaces using the recently reported Embedding Language Model (ELM) method.We demonstrate our framework by training models to recover, summarize, and compare clinical trial abstracts from embeddings alone.In addition to inverting embeddings back to text more reliably than existing methods, our models can decode novel, interpolated embeddings into new clinical trial abstracts that human experts cannot distinguish from real ones.We further show that these generated abstracts are responsive to moving embeddings along concept vectors for age and sex of study subjects.Our public ELM implementation and experimental results will aid the alignment of Large Language Models to embedding spaces in the biomedical domain and beyond.
Institution: Yale University
Language: English
Topic: Topic Modeling
Subfield: Artificial Intelligence
Field: Computer Science
Domain: Physical Sciences
Open Access status: gold
OpenAlex ID: W7166858149