Work

Google’s new AI Chatbot produces fake health-related evidence-then self-corrects

Year: 2024
Type: article
Abstract: Recent articles have pointed out the potential benefits, limits and risks that may occur from use of AI Chatbots, including substantial inaccuracies [1,2].Such inaccuracies, or downright fake information, have been described as "hallucinations," and even this term has been criticized and reimagined as "confabulations" [3].After recently receiving a notification from Google about their new GPT-4 chatbot application, Gemini (http://gemini.google.com/),I thought I'd give it a whirl in the general area of evidence-based medicine and health outcomes and policy.As a starter question, "I need help with information about outcomes of a specific surgical procedure," Gemini responded that all of the following might be helpful resources: PubMed, Cochrane Library, NIH, ClinicalTrials.gov,and professional societies.So far, so good, a great answer to get one started on a search of the best available evidence.Then, I asked a much more specific question, "What is the outcome of thoracic outlet surgery for workers' compensation cases?"After reasonably stating that the outcome can vary depending on the individual case, the severity of the condition, and the type of surgery performed, Gemini stated that "Studies have shown that thoracic outlet surgery can be effective in improving symptoms and increasing function in workers who have been diagnosed with thoracic outlet syndrome."Gemini supported this conclusion by citing two studies.First, "A 2019 study published in the journal "Spine" found that thoracic outlet surgery was associated with a significant improvement in symptoms and function in workers with thoracic outlet syndrome.The study found that 85% of workers who underwent surgery reported an improvement in their symptoms, and 70% reported a return to work."Second, "Another study, published in the journal" The American Journal of Industrial Medicine" in 2018, found that thoracic outlet surgery was associated with a significant reduction in pain and an improvement in function in workers with thoracic outlet syndrome.The study found that 80% of workers who underwent surgery reported a reduction in pain, and 75% reported an improvement in function."I followed up with, "The studies you cited do not seem to exist.Can you explain that?"And Gemini responded, "I apologize for the mistake.I am still under development and learning to perform many kinds of tasks, including finding and citing academic studies.Upon further research, I cannot find any studies that specifically examine the outcomes of thoracic outlet surgery for workers compensation cases."And, "However, I did find a few studies that examined the outcomes of thoracic outlet surgery in general.These studies found that thoracic outlet surgery can be effective in improving symptoms and increasing function in patients with
Language: English
Field: Medicine
Open Access status: gold
Estimated APC paid: $2,926
OpenAlex ID: W4402747736
FWCI: 0.094
Cites: 6
Cited by: 1
Related to: 10