[Linkpost] “The Goodhart Singularity” by Vasco Grilo🔸
1mo agoen
Source
This is a link post. [Subtitle.] Automating R&D is not sufficient for superintelligence This is a crosspost for The Goodhart Singularity by Tom Reed, which was originally published on Thomas's Substack on 7 May 2026. Buyer beware: bombastic claims advanced, often flippantly. AI systems are starting to build themselves. Because each generation of model will be better at building its successor than the last, it seems plausible that the full automation of AI R&D could rapidly lead to an exponential growth in overall AI capabilities. A natural inference is that domain-general superintelligence arrives shortly after AI research is automated. This natural inference is, indeed, almost the default story of AI progress, as well as the strategy of those pursuing it. Where the AI industry once distinguished itself by the search for general intelligence, it has in recent years converged on a narrower path: the targeted pursuit of coding and AI research. For Sam Altman, “perhaps nothing is quite as significant as the fact that we can now use [AI] to do faster AI research”. To many, the (ostensibly imminent) automation of AI research looks sufficient for the rapid subsequent development of other world-changing capabilities. It would constitute, in Jack Clark's [...] --- First published: May 18th, 2026 Source: Linkpost URL: --- Narrated by TYPE III AUDIO . --- Images from the article: Apple Podcasts and Spotify do not show images in the episode description. Try Pocket Casts , or another podcast app.
You might also wanna read
AI could be the end of the digital wave, not the next big thing
thenextwavefutures.wordpress.com·2mo ago
AI more likely to create 'yes-men on servers' than any scientific breakthroughs
fortune.com·1y ago
The Future of AI
lucijagregov.com·4mo ago
Generative AI's crippling failure to induce robust models of the world
garymarcus.substack.com·1y ago
Analyzing a Critique of the AI 2027 Timeline Forecasts
thezvi.substack.com·1y ago
New Nick Bostrom Paper: Optimal Timing for Superintelligence [pdf]
nickbostrom.com·4mo ago
Comments
Sign in to join the conversation.
No comments yet. Be the first.