Do You Need a Frontier Model as a Citation Verifier? Benchmarking Rubric LLMs for Deep-Research Source Attribution
arXiv:2607.08700v1 Announce Type: new Abstract: Reinforcement learning increasingly relies on an LLM judge to score each rubric criterion, and that judge acts as the reward model during training…
Read the full articleYou might also wanna read
Systematic evaluation of 21 LLM-as-a-Judge models reveals reliability flaws and position bias across 541,000 judgments
LLM-as-a-Judge has become the dominant evaluation paradigm for language models, but judge validation in practice relies on exact-match agree
arxiv.org·17d agoSystematic evaluation of 21 LLM-as-a-Judge models reveals reliability flaws and position bias across 541,000 judgments
LLM-as-a-Judge has become the dominant evaluation paradigm for language models, but judge validation in practice relies on exact-match agree
arxiv.org·17d ago
LLM-as-a-Verifier: A probabilistic verification framework for scaling LLM correctness assessment
Scaling pre-training, post-training, and test-time compute have become the central paradigms for improving the capabilities of LLMs. In this
arxiv.org·2d agoLLM-as-a-Verifier: A probabilistic verification framework for scaling LLM correctness assessment
Scaling pre-training, post-training, and test-time compute have become the central paradigms for improving the capabilities of LLMs. In this
arxiv.org·2d ago
LLM Rerankers Can Self-Assess Ranking Quality Through Self-Consistency and Supervised Calibration Methods
Retrieval effectiveness varies substantially across queries, making it important to estimate ranking quality before relevance judgments are
arxiv.org·1mo ago
QUBRIC: A Framework for Co-Designing Queries and Rubrics to Extend Reinforcement Learning Beyond Verifiable Rewards
Rubric-based RL is a promising route for extending reinforcement learning beyond verifiable rewards, yet existing methods optimize rubrics w
arxiv.org·1mo ago
New benchmark reveals AI models often cite wrong sources even when answers are correct
Leading AI models like GPT and Gemini routinely cite text passages in document analyses that don't actually support their answers. Even when
the-decoder.com·1mo ago
LiveBrowseComp reveals LLM search agents rely on memorized knowledge, not genuine web searching
Are LLM-based search agents genuinely searching, or using the web to verify what they already know? We study this question on BrowseComp wit
arxiv.org·1mo ago
Comments
Sign in to join the conversation.
No comments yet. Be the first.