Work

AI-Powered Conversational Interfaces in Higher Education: An Experimental Comparison of Chatbots and Traditional Websites for Information Seeking

Year: 2026
Type: article
Study design: Clinical Trial
Abstract: As artificial intelligence (AI) continues to reshape higher education, traditional web-based methods of providing interested parties with academic and institutional information are increasingly being challenged. The current study provides empirical evidence surrounding young adult perceptions, information-seeking efficiency, and objective task performance when using AI-powered chatbots compared to traditional university websites. Guided by the Technology Readiness and Acceptance Model (TRAM), 299 participants were randomly assigned to complete information-seeking tasks using a traditional university website or an AI-powered chatbot. Following random assignment, participants using the AI-powered chatbot reported significantly greater perceived ease of use (p < 0.001), perceived usefulness (p < 0.001), and more favorable attitudes toward the technology (p < 0.001) than participants using the traditional website. Beyond these perceptual differences, participants using the chatbot completed the information-seeking tasks in approximately 38% less time and demonstrated overall task accuracy of 95.6%, compared with 78.5% for website participants, an increase of 17.1 percentage points. AI-powered conversational interfaces appear capable of improving not only perceptions of the information-seeking experience, but also the speed and accuracy with which institutional information can be located. Thus, higher education institutions are advised to consider conversational AI as a complementary support infrastructure while continuing to systematically evaluate both user perceptions and objective performance outcomes.
Language: English
Subfield: Marketing
Open Access status: gold
Estimated APC paid: $2,172
OpenAlex ID: W7235194863
FWCI:
Cites: 41
Cited by:
Related to: 10