Work

RV4Chatbot: Are Chatbots Allowed to Dream of Electric Sheep?

Year: 2024

Type: article

Abstract: Chatbots have become integral to various application domains, including those with safety-critical considerations. As a result, there is a pressing need for methods that ensure chatbots consistently adhere to expected, safe behaviours. In this paper, we introduce RV4Chatbot, a Runtime Verification framework designed to monitor deviations in chatbot behaviour. We formalise expected behaviours as interaction protocols between the user and the chatbot. We present the RV4Chatbot design and describe two implementations that instantiate it: RV4Rasa, for monitoring chatbots created with the Rasa framework, and RV4Dialogflow, for monitoring Dialogflow chatbots. Additionally, we detail experiments conducted in a factory automation scenario using both RV4Rasa and RV4Dialogflow.

Source: Electronic Proceedings in Theoretical Computer Science

DOI: 10.4204/eptcs.411.5

Authors: Andrea Gatti, Viviana Mascardi, Angelo Ferrando

Institutions: University of Modena and Reggio Emilia, University of Genoa

Language: English

Topic: Formal Methods in Verification

Subfield: Computational Theory and Mathematics

Field: Computer Science

Domain: Physical Sciences

Open Access status: diamond

OpenAlex ID: W4404541871

FWCI: 0.389

Cites: 34

Cited by: 2

Related to: 10