Work

Seeing us through machines: designing and building conversational AI to understand humans

Year: 2023
Type: dissertation
Abstract: Understanding humans at scale is essential for addressing some of the consequential challenges in human society.By gaining insights into why people act as they do, we can design informed interventions that have a positive societal impact, including improving public health, developing a sustainable economy, or advancing fair education.However, the complexity of human behavior necessitates novel and sophisticated tools and methods to capture cultural, social, environmental, and individual characteristics that heavily influence our behaviors.Further, understanding ethical concerns surrounding informed consent, privacy, and data collection requires interdisciplinary expertise and is essential to study human behavior responsibly.In this dissertation, we take up this challenge by exploring the use of Artificial Intelligence (AI) in the context of behavioral science studies, designing and building effective conversational AIs for information collection and informed consent.This thesis starts by focusing on surveys, one of the most widely-used research methods in behavioral research.We studied conversational AIs to address today's survey research challenges: survey fatigue, inflexible survey structure, and lack of personalization.In an AIdriven conversational survey, a conversational agent asks questions, interprets a participant's responses, and probes answers whenever needed.We first studied an AI-driven conversational survey's response quality and participant engagement by comparing it with form-based surveys.After establishing the promise, We improved a conversational survey by equipping the AI agent with active listening skills through a human-in-the-loop framework.We further built a novel knowledge-driven language model to generate informative follow-up questions on the fly.We then looked at the ethical practices in behavioral science research, informed consent procedure, in online studies.Due to the lack of a researcher's presence and guidance, online participants often failed to make informed participation decisions, putting them at unaware risks.In this study, we re-introduced interactivity to online informed consent using conversational AI.Our agent guided participants through the consent form step-by-step and answered their questions.Compared to the form-based interaction, we found the AI-powered chatbot improved consent form reading, promoted participants' feelings of agency, closed the power gap between the participant and the researcher, and ultimately benefited the study quality.We ended this thesis with a series of empirical studies about how people interact with such conversational AIs.Drawing from the rich use of voice assistants, we considered
Author: Xiao, Ziang
Language: English
Open Access status: green
OpenAlex ID: W7220822970
Cites: 327
Cited by: 3
Related to: 10