2507.18523

Total: 1

#1 The Moral Gap of Large Language Models [PDF1] [Copy] [Kimi3] [REL]

Authors: Maciej Skorski, Alina Landowska

Moral foundation detection is crucial for analyzing social discourse and developing ethically-aligned AI systems. While large language models excel across diverse tasks, their performance on specialized moral reasoning remains unclear. This study provides the first comprehensive comparison between state-of-the-art LLMs and fine-tuned transformers across Twitter and Reddit datasets using ROC, PR, and DET curve analysis. Results reveal substantial performance gaps, with LLMs exhibiting high false negative rates and systematic under-detection of moral content despite prompt engineering efforts. These findings demonstrate that task-specific fine-tuning remains superior to prompting for moral reasoning applications.

Subjects: Computation and Language , Computers and Society , Human-Computer Interaction , Machine Learning

Publish: 2025-07-24 15:49:06 UTC