2511.16688

Total: 1

#1 Prompt-Based Value Steering of Large Language Models [PDF1] [Copy] [Kimi1] [REL]

Authors: Giulio Antonio Abbo, Tony Belpaeme

Large language models are increasingly used in applications where alignment with human values is critical. While model fine-tuning is often employed to ensure safe responses, this technique is static and does not lend itself to everyday situations involving dynamic values and preferences. In this paper, we present a practical, reproducible, and model-agnostic procedure to evaluate whether a prompt candidate can effectively steer generated text toward specific human values, formalising a scoring method to quantify the presence and gain of target values in generated responses. We apply our method to a variant of the Wizard-Vicuna language model, using Schwartz's theory of basic human values and a structured evaluation through a dialogue dataset. With this setup, we compare a baseline prompt to one explicitly conditioned on values, and show that value steering is possible even without altering the model or dynamically optimising prompts.

Subjects: Computation and Language , Artificial Intelligence

Publish: 2025-11-14 14:45:41 UTC