Critique of Anthropic's A/B Testing on Claude Code for Paying Users
By
ramoz
2mo ago· 3 min readenOpinion
65/100
Toasty
Bagelometer↗
Crackles when you bite it. Shows the baker did the work.
Score65TypeopinionSentimentnegative
Summary
The article expresses frustration with Anthropic's A/B testing of Claude Code features on paying users, arguing that such testing degrades workflows and should not be applied to professional tools without user consent. The author acknowledges revising the post for fairness but maintains that silent A/B testing on paid services is inappropriate and treats professional tools like consumer apps.
Key quotes
· 4 pulledAnthropic is running A/B tests on Claude Code that actively degrade my workflow. I wish I could opt out.
I don't think A/B testing is inherently wrong. I don't think Anthropic is doing this to intent
Anthropic is silently A/B testing Claude Code's plan mode on paying users. This isn't a consumer app. Stop treating it like one.
Experiencing my own workflow degrade over the past week was frustrating, and this post was written in that frustration.
Anthropic is silently A/B testing Claude Code's plan mode on paying users. This isn't a consumer app. Stop treating it like one.
