# Preference-PCA Pluralistic Learning (P3L): Steerable Pluralistic Policy Alignment from Anonymous Crowd Feedback

- Source: arXiv cs.RO
- Published: 2026-10-21T04:00:00.000Z
- RoboHot: https://robohot.news/en/items/bc3gwu4nei1r2ep7diloized7
- Original: https://arxiv.org/abs/2610.26914

## Summary

The P3L (Preference-PCA Pluralistic Learning) framework jointly learns trajectory embeddings and a shared basis of preference directions via PCA decomposition from anonymous, heterogeneous crowd feedback, enabling personalized reward learning and downstream policy optimization without requiring annotator identities. In experiments across multiple embodied control tasks, P3L supports steerable personal alignment, generalizes beyond the offline dataset to out-of-distribution new users, and achieves competitive reinforcement learning and test performance while substantially reducing computational cost and supporting variable adaptation query budgets.