Presentation
Effect of AI Benevolence on Humans' Trust and Use of an AI Assistant in a Video Game
DescriptionAs artificial intelligence (AI) systems become increasingly integrated into daily life—from virtual assistants to healthcare technologies—public trust remains a major obstacle for adoption. Previous studies have primarily focused on how the ability and integrity (transparency) of AI affect people’s trust and usage intention. However, few studies have explored the role of benevolence.
This study investigates how the perceived benevolence of AI assistants influences users’ trust and willingness to interact with them. Through an interactive video game, participants interacted with either a benevolent AI assistant (prioritizing user safety and well-being) or a non-benevolent AI assistant (prioritizing its own goals). The AI assistant communicated with the subjects by using text boxes. After completing the task, participants completed a questionnaire that included topics about trust, perceived benevolence, and willingness to use. The results from two experiments showed that the benevolent AI assistant significantly enhanced perceived trust and increased users’ willingness to cooperate with the AI assistant in future interactions.
This research highlights the need for AI to align with users’ social and moral expectations—especially in emotionally sensitive or high-risk domains such as education, disaster responses, and healthcare—thereby contributing to the advancement of human-AI interaction and teaming.
This study investigates how the perceived benevolence of AI assistants influences users’ trust and willingness to interact with them. Through an interactive video game, participants interacted with either a benevolent AI assistant (prioritizing user safety and well-being) or a non-benevolent AI assistant (prioritizing its own goals). The AI assistant communicated with the subjects by using text boxes. After completing the task, participants completed a questionnaire that included topics about trust, perceived benevolence, and willingness to use. The results from two experiments showed that the benevolent AI assistant significantly enhanced perceived trust and increased users’ willingness to cooperate with the AI assistant in future interactions.
This research highlights the need for AI to align with users’ social and moral expectations—especially in emotionally sensitive or high-risk domains such as education, disaster responses, and healthcare—thereby contributing to the advancement of human-AI interaction and teaming.
Event Type
Lecture
TimeTuesday, October 14th11:30am - 11:50am CDT
LocationGrand B
Human AI Robot Teaming (AI)