DecompR: A Method for Reducing Weighting Noise in Multi-Stakeholder LLM Alignment

Multi-stakeholder tasks require one output to satisfy users with conflicting preferences. Holistic LLM judges conflate utility estimation and utility aggregation, yielding unstable implicit weights. We show empirically and theoretically that this aggregat