All Topics
All Topics
Technology
Technology
AI
AI
Business
Business
Entertainment
Entertainment
News
News
Programming
Programming
Science
Science
Design
Design
Environment
Environment
Finance
Finance
Crypto
Crypto
Politics
Politics
Sports
Sports
Education
Education
Gaming
Gaming
Art
Art
Music
Music
Health
Health
Security
Security
Books
Books
Food
Food
Travel
Travel
Personal
Personal
Bluesky
Twitter

[Linkpost] “AI should be a good citizen, not just a good assistant” by Forethought, Tom_Davidson, William_MacAskill

3mo agoen

Source

EA Forum[Linkpost] “AI should be a good citizen, not just a good assistant” by Forethought, Tom_Davidson, William_MacAskilleffectivealtruism.org
Snippet from the RSS feed
This is a link post. Introduction Consider a lorry driver who sees a car crash and pulls over to help, even though it’ll delay his journey. Or a delivery driver who notices that an elderly resident hasn’t collected their post in days, and knocks to check they’re okay. Or a social media company employee who notices how their platform is used for online bullying, and brings it up with leadership, even though that's not part of their job description. This kind of proactive prosocial behaviour is admirable in humans. Should we want it in AI too? Often, people have answered “no”. Many advocate for making AI “corrigible” or “steerable”. In its purest form, this makes AI a mere vessel for the will of the user. But we think AI should proactively take actions that benefit society more broadly. As AI systems become more autonomous and integrated into economic and political processes, the cumulative effect of their behavioural tendencies will shape society's trajectory. AI systems that notice opportunities to benefit society and proactively act on them could matter enormously. Below, we consider two main objections: Firstly, supposedly prosocial drives might function as a means for AI companies to impose their own [...] --- Outline: (00:15) Introduction (02:06) What do we mean by proactive prosocial drives? (02:53) Why do we think AI should have proactive prosocial drives? (05:07) Other benefits of proactive prosocial drives (05:51) Doesnt this give AI companies too much influence? (07:44) Wont this make AI more likely to seek power? (13:00) Wont this make it harder to interpret evidence of egregious misalignment? (15:16) Best of both worlds: deploy proactive prosocial AI externally and corrigible AI internally (16:31) What do current AI character documents say about proactive prosocial drives? (17:53) Conclusion (19:02) Appendices (19:05) Appendix A: Initially make non-prosocial AI, then pivot to add proactive prosocial drives (21:39) Appendix B: Prosocial drives might make a sociopathic persona less likely (23:42) Appendix C: Prosocial drives might make AI a better alignment researcher (24:42) Appendix D: What license does Claudes Constitution give for proactive prosocial drives? (25:33) A. User benefit (26:14) B. Refusals (27:09) C. Proactive prosocial drives (28:07) Summary (28:23) Appendix E: What does OpenAIs model spec say about proactive prosocial drives? (28:56) A. Proactive behaviour that is explicitly user-centred (29:41) B. Proactively preventing imminent harm (30:14) C. Weak normative defaults and the flourishing of humanity (31:14) D. Explicit limits on proactive prosocial drives (32:55) Summary --- First published: March 30th, 2026 Source: Linkpost URL: --- Narrated by TYPE III AUDIO .

You might also wanna read

Comments

Sign in to join the conversation.

No comments yet. Be the first.