All Topics
All Topics
Technology
Technology
Design
Design
Programming
Programming
Science
Science
News
News
Gaming
Gaming
Entertainment
Entertainment
Business
Business
Finance
Finance
Sports
Sports
Health
Health
Food
Food
Travel
Travel
Art
Art
Music
Music
Books
Books
Education
Education
Politics
Politics
Personal
Personal
No algorithm. No AI slop. No ads. Just RSS. Pro-human. Indie writers. Real journalism. Open web. Chronological. Hand toasted.

AI systems achieve 50% pass rate in standard three-party Turing test, study finds

By

Benjamin K. Bergen

4d ago· 44 min readenInsight

Summary

This paper demonstrates that three current AI systems (when suitably prompted) achieve a pass rate of at least 50% in a standard three-party Turing test, meaning participants were no better than chance at distinguishing humans from machines. The study evaluated four systems including ELIZA and GPT-based models, providing insight into what cues people use to differentiate humans from machines. The results imply current AI systems can effectively imitate human behavior in this classic test of machine intelligence.

Key quotes

· 5 pulled
The Turing test asks whether a machine can imitate human behavior so well that another human cannot reliably tell the difference.
It is not only the oldest and most discussed test of AI but can also provide insight into what cues people use to distinguish humans from machines.
This paper demonstrates that—when suitably prompted—three current AI systems achieve a pass rate of at least 50% in a standard Turing test.
Participants were no better (and in some cases worse) than chance at selecting between a human and a machine.
The results imply current AI systems can effectively imitate human behavior in this classic test of machine intelligence.
Snippet from the RSS feed
The Turing test has been widely discussed as a test of machine intelligence, but it also provides a measure of how humans distinguish other humans from machines. We evaluated 4 systems (ELIZA, GPT-...

You might also wanna read