Work

AI Chatbot for Cancer Patient Support: Development and Evaluation Using Llama 3.1, Mistral 7B, and PHI 3B

Year: 2025

Type: book-chapter

Abstract: This study develops and evaluates a question-answering (Q&A) system for breast cancer patients using generative AI technologies. We compared the performance of three language models-Llama 3.1, Mistral 7B and Phi 3.5. The goal is to integrate this system into a patient-facing application, providing personalised, interactive support based on reliable sources such as Cancer Research UK. However, findings indicate that misinformation remains a significant concern. Medical chatbots utilising retrieval augmented generation (RAG) providing clinical information require significant refinement before being suitable for clinical use.

Source: Studies in health technology and informatics

DOI: 10.3233/shti250494

Authors: Samuel McInerney, Tamsin Nash, Rebecca Lee, Matúš Falis, Franz Gruber, Arlene Casey

Institutions: University of Edinburgh, NHS Greater Glasgow and Clyde

Language: English

Topic: Artificial Intelligence in Healthcare and Education

Subfield: Health Informatics

Field: Medicine

Domain: Health Sciences

SDG: Good health and well-being

Open Access status: hybrid

OpenAlex ID: W4410418976

FWCI: 11.58

Cites:

Cited by: 7

Related to: 10