New ASL Benchmark Reveals Sign Language AI Models Overlook Facial and Body Cues
Models of sign language have historically lagged behind those for spoken language (text and speech). Recent work has greatly improved their performance on tasks like sign language translation and…
Read the full articleYou might also wanna read
BabyVision Benchmark Reveals MLLMs Fail at Basic Visual Tasks That 3-Year-Olds Can Solve
While humans develop core visual skills long before acquiring language, contemporary Multimodal LLMs (MLLMs) still rely heavily on linguisti
arxiv.org·24d ago
Comparing 11 LLMs on a LangGraph Code Reorganization Task: American vs. Chinese Models
Weekly Tracker Feed by Korridzy.
wtf.korridzy.com·15d ago
New Benchmark Reveals High Rates of Outcome-Driven Constraint Violations in Autonomous AI Agents
As autonomous AI agents are increasingly deployed in high-stakes environments, ensuring their safety and alignment with human values has bec
arxiv.org·5mo ago
Signspell: Open-source Python package for real-time ASL fingerspelling recognition from webcam
Signspell is an open-source Python package that recognises the American Sign Language fingerspelling alphabet live from your webcam. It work
Product Hunt·23d ago
DatBench: A New Framework for More Faithful and Efficient Vision-Language Model Evaluation
Empirical evaluation serves as the primary compass guiding research progress in foundation models. Despite a large body of work focused on t
arxiv.org·6mo ago
ProgramBench: New Benchmark Reveals Language Models Struggle to Build Complete Software Projects From Scratch
Turning ideas into full software projects from scratch has become a popular use case for language models. Agents are being deployed to seed,
arXiv.org·2mo ago
Comments
Sign in to join the conversation.
No comments yet. Be the first.