Fine-tuning and retrieval augmentation for crystallography and cryo-EM question answering using a community-derived corpus
Year: 2026
Type: preprint
Abstract: Structural biology mailing lists such as CCP4, CCP-EM, Phenix and COOT contain decades of expert answers to practical problems, but an answer is difficult to find even when it has been given before. A question-and-answer corpus was built from 103,600 messages across the four mailing lists, and threads were classified as questions. The answers were confirmed by the asker’s reply or by the agreement of several participants, identified by three LLM models. This gave 4,320 curated question-and-answer pairs, which were used for fine-tuning and retrieval augmentation for six LLM models, two sizes each from the Mistral, Llama and Qwen families. The LLM models were evaluated under eight conditions: base and fine-tuned, each without retrieval and with retrieval from the software documentation, from the mailing-list corpus, and from both. The base models with mailing-list retrieval were preferred by the LLM judges over the base models alone, the fine-tuned models, and even the base models with retrieval from the software documentation. The data sets and the fine-tuned models are publicly available.
Source: Research Square
Author: Emad Alharbi
Institution: University of Tabuk
Language: English
Topic: Topic Modeling
Subfield: Artificial Intelligence
Field: Computer Science
Domain: Physical Sciences
Open Access status: green
Funder: University of Tabuk
OpenAlex ID: W7236849433
