# Reason-Guided Human Reward Modeling for Preference-Based Reinforcement Learning

- Source: arXiv cs.RO
- Published: 2026-10-19T04:00:00.000Z
- RoboHot: https://robohot.news/en/items/wpzoz10ipkyuckuts283xmaax
- Original: https://arxiv.org/abs/2610.23550

## Summary

This paper proposes a reason-guided preference-based reinforcement learning (PbRL) framework that learns a human reward model from trajectory-level feedback, introducing reason tags that explain why a behavior is preferred in addition to preference labels. Compared with preference-only reward learning, this method provides additional supervision for learning human-aligned rewards and improves the interpretability of the policy. The learned human reward is combined with the environment reward for policy optimization, enabling the agent to improve task performance while producing more interpretable behavior that better matches human preferences and aligns with human intent.