Publishers like Time and The Economist are rebuilding websites for AI agent readability
By
Sara Guaglione
Summary
Publishers like Time, The Economist, and other major news outlets are re-engineering their websites to be readable by AI agents, preparing for an "agentic web" where AI bots make decisions on behalf of users. Rather than just blocking AI crawlers, these publishers are creating parallel, agent-readable versions of their sites, implementing stricter crawl controls, and developing new web standards to remain discoverable in AI-powered search. Time is converting its webpages from HTML to formats optimized for AI consumption, signaling a strategic shift from defense to adaptation in the publisher-AI relationship.
Source
Key quotes
· 3 pulledAs AI bots flood their sites, publishers are no longer just trying to keep them out – they're starting to re-engineer content for them.
In doing so, publishers are preparing for an agentic web – a future in which AI agents make decisions and perform tasks on behalf of users.
Time, The Economist and another major news publishers are already experimenting with parallel, agent-readable versions of their sites, stricter controls on which bots can crawl them and, in some cases, entirely new web standards.
You might also wanna read
The Economist experiments with agent-readable content for AI-driven discovery
The Economist is experimenting with a "two-track internet" strategy, creating content specifically structured for AI agents and answer engin
The Shift from Web Pages to AI Components in Information Access
The article argues that traditional web pages are becoming obsolete as AI-powered components and applications provide more immediate, person
Why optimizing content for AI agents is a necessary interface problem
The article argues that content should be optimized for AI agents, just as it is optimized for human readers. It pushes back against critici

AI-First Content Management: Rethinking CMS vs Markdown for Agentic Applications
The article explores whether traditional Content Management Systems (CMS) like WordPress are still necessary in an AI-first world where agen
SEEN: A Four-Layer Framework for AI Visibility in the Post-SEO Era
This article introduces SEEN, a four-layer framework designed to help brands and content creators optimize their online presence for AI syst
Reuters and Time Join Publishers Blocking AI Crawlers by Default, Pushing for Licensing Deals
Reuters and Time have joined a growing number of publishers defaulting to blocking AI crawlers, using allowlists instead of blocklists to co
searchenginejournal.com·25d ago
Comments
Sign in to join the conversation.
No comments yet. Be the first.