Validity of LLMs as data annotators: AMALIA on authority
arXiv:2607.08731v1 Announce Type: new Abstract: A national language model offers a linguistic community its own instrument for measuring what its citizens say and value. Portugal's AMALIA, a publicly…
Read the full articleYou might also wanna read
Systematic evaluation of 21 LLM-as-a-Judge models reveals reliability flaws and position bias across 541,000 judgments
LLM-as-a-Judge has become the dominant evaluation paradigm for language models, but judge validation in practice relies on exact-match agree
arxiv.org·17d agoSystematic evaluation of 21 LLM-as-a-Judge models reveals reliability flaws and position bias across 541,000 judgments
LLM-as-a-Judge has become the dominant evaluation paradigm for language models, but judge validation in practice relies on exact-match agree
arxiv.org·17d ago
Researchers argue anthropomorphic LLM attributes are non-unique using Age of Empires II neural network
Much research has been carried out on large language models (LLMs) and LLM-powered agentic workflows. However, many works within the field s
arxiv.org·16d agoResearchers argue anthropomorphic LLM attributes are non-unique using Age of Empires II neural network
Much research has been carried out on large language models (LLMs) and LLM-powered agentic workflows. However, many works within the field s
arxiv.org·16d ago
Research: LLMs Encode Human-Labeled Problem Difficulty Better Than Model-Derived Difficulty
Large language models exhibit a puzzling inconsistency: they solve complex problems yet frequently fail on seemingly simpler ones. We invest
arxiv.org·8mo ago
Comparing 11 LLMs on a LangGraph Code Reorganization Task: American vs. Chinese Models
Weekly Tracker Feed by Korridzy.
wtf.korridzy.com·7d ago
Separating Problem Solving from Code Generation: Evaluating LLMs on Competitive Programming Through Natural-Language Editorials
Large Language Models (LLMs) increasingly succeed on competitive programming problems, yet existing evaluations conflate algorithmic reasoni
arxiv.org·3d ago
New Benchmark Evaluates LLM Understanding of Persian Taarof Cultural Norms
Large language models (LLMs) struggle to navigate culturally specific communication norms, limiting their effectiveness in global contexts.
arxiv.org·9mo ago
Comments
Sign in to join the conversation.
No comments yet. Be the first.