2504.16883

Total: 1

#1 Enhancing Critical Thinking with AI: A Tailored Warning System for RAG Models [PDF1] [Copy] [Kimi1] [REL]

Authors: Xuyang Zhu, Sejoon Chang, Andrew Kuik

Retrieval-Augmented Generation (RAG) systems offer a powerful approach to enhancing large language model (LLM) outputs by incorporating fact-checked, contextually relevant information. However, fairness and reliability concerns persist, as hallucinations can emerge at both the retrieval and generation stages, affecting users' reasoning and decision-making. Our research explores how tailored warning messages -- whose content depends on the specific context of hallucination -- shape user reasoning and actions in an educational quiz setting. Preliminary findings suggest that while warnings improve accuracy and awareness of high-level hallucinations, they may also introduce cognitive friction, leading to confusion and diminished trust in the system. By examining these interactions, this work contributes to the broader goal of AI-augmented reasoning: developing systems that actively support human reflection, critical thinking, and informed decision-making rather than passive information consumption.

Subject: Human-Computer Interaction

Publish: 2025-04-23 17:00:25 UTC