Stanford Law Study Finds Professors Prefer AI-Generated Answers Over Peer Responses in Legal Education
By
Stanford Law School
Hot, fresh, and worth queueing round the block for.
Summary
A Stanford Law School study led by Professor Julian Nyarko found that law professors overwhelmingly prefer AI-generated answers to student questions over responses written by their fellow instructors. In a blind evaluation of nearly 3,000 anonymized comparisons involving 16 law professors across U.S. law schools, the study tested whether large language models could serve as effective tutors for contract law courses. The findings suggest potential significant changes in how legal education is delivered.
Key quotes
· 3 pulledA groundbreaking study led by Stanford Law School Professor Julian Nyarko reveals that law professors overwhelmingly prefer AI-generated answers to student questions over responses written by their fellow instructors
The study, titled 'Law Professors Prefer AI Over Peer Answers,' was conducted with 16 law professors across U.S. law schools and tested whether large language models could serve as effective tutors for contract law courses
In a blind evaluation of nearly 3,000 anonymized comparisons
You might also wanna read
Study Finds AI Outperforms Law Professors on Complex Contract Law Questions
A blind experiment tested AI tutors against 16 law professors on contract law questions that required reasoning and synthesis rather than ro
forbes.com·1d agoStudy Finds AI Outperforms Law Professors on Complex Contract Law Questions
A blind experiment tested AI tutors against 16 law professors on contract law questions that required reasoning and synthesis rather than ro
forbes.com·1d ago
AI Tutors Outperform Law Professors in Blind Study on Contract Law Reasoning
A blind experiment tested AI tutors against 16 law professors on contract law questions that required reasoning and synthesis rather than ro
forbes.com·15h ago
Commentary: Why AI chatbots cannot replace human lawyers for legal advice
Lawyer Mark Yeo examines the risks of relying on AI chatbots for legal advice, highlighting concerns about accuracy, confidentiality, and th
channelnewsasia.com·3d ago
UC Berkeley Law School bans AI use for student assignments and coursework
UC Berkeley's law school has banned students from using AI tools for assignments, brainstorming, outlining, and even grammar correction. The
semafor.com·7d ago
Bridging the AI divide between faculty and students in higher education
A professor recounts her journey from banning generative AI in her classroom to realizing that students and faculty are operating on fundame
timeshighereducation.com·1d ago
5 Tips for Redesigning Assignments in the Age of Agentic AI
The article argues that higher education's default response to agentic AI tools (like Einstein, built on Claude Code and Codex) that can aut
insidehighered.com·5d ago