All Topics
All Topics
Technology
Technology
AI
AI
Business
Business
Entertainment
Entertainment
News
News
Programming
Programming
Security
Security
Science
Science
Design
Design
Environment
Environment
Finance
Finance
Crypto
Crypto
Politics
Politics
Sports
Sports
Education
Education
Gaming
Gaming
Art
Art
Music
Music
Health
Health
Books
Books
Food
Food
Travel
Travel
Personal
Personal
Bluesky
Twitter

Radar - Content Type Dimension for AI Bots in Cloudflare Radar

4mo ago

Source

CloudflareRadar - Content Type Dimension for AI Bots in Cloudflare Radarcloudflare.com
Snippet from the RSS feed
Radar now includes content type insights for AI bot and crawler traffic. The new content_type dimension and filter shows the distribution of content types returned to AI crawlers, grouped by MIME type category. The content type dimension and filter are available via the following API endpoints: /ai/bots/summary/content_type /ai/bots/timeseries_groups/content_type Content type categories: HTML - Web pages ( text/html ) Images - All image formats ( image/* ) JSON - JSON data and API responses ( application/json , *+json ) JavaScript - Scripts ( application/javascript , text/javascript ) CSS - Stylesheets ( text/css ) Plain Text - Unformatted text ( text/plain ) Fonts - Web fonts ( font/* , application/font-* ) XML - XML documents and feeds ( text/xml , application/xml , application/rss+xml , application/atom+xml ) YAML - Configuration files ( text/yaml , application/yaml ) Video - Video content and streaming ( video/* , application/ogg , *mpegurl ) Audio - Audio content ( audio/* ) Markdown - Markdown documents ( text/markdown ) Documents - PDFs, Office documents, ePub, CSV ( application/pdf , application/msword , text/csv ) Binary - Executables, archives, WebAssembly ( application/octet-stream , application/zip , application/wasm ) Serialization - Binary API formats ( application/protobuf , application/grpc , application/msgpack ) Other - All other content types Additionally, individual bot information pages now display content type distribution for AI crawlers that exist in both the Verified Bots and AI Bots datasets. Check out the AI Insights page to explore the data.

You might also wanna read

Cloudflare Radar enables AI agents to become direct customers with automated account setup

Cloudflare Radar announces that AI agents can now become Cloudflare customers directly, creating accounts, starting paid subscriptions, regi

radar.cloudflare.com·10mo ago

Cloudflare expands AI bot management tools with granular traffic controls for all customers

Cloudflare is celebrating the second "Content Independence Day" by expanding AI traffic management options for all website owners. Building

blog.cloudflare.com·1d ago

Cloudflare expands AI bot management tools with granular traffic controls for all customers

Cloudflare is celebrating the second "Content Independence Day" by expanding AI traffic management options for all website owners. Building

Cloudflare·1d ago

Cloudflare Radar: Internet Traffic Data and Trends in the Russian Federation

This article presents traffic data and network insights for the Russian Federation from Cloudflare Radar. It includes metrics on traffic vol

radar.cloudflare.com·3mo ago

Cloudflare Introduces Content Signals Policy for Enhanced Web Content Control

Cloudflare is launching a new Content Signals Policy that enhances robots.txt functionality to give website operators more control over how

blog.cloudflare.com·9mo ago

AI Web Crawlers Account for 30% of Global Web Traffic According to Cloudflare Data

AI web crawlers are consuming a significant portion of global web traffic, with Cloudflare reporting 30% of traffic coming from bots and Fas

theregister.com·10mo ago

Bots now consume 57% of web traffic as AI crawlers dominate online publishing

Cloudflare data reveals bots now account for 57.4% of all web traffic, with AI training crawlers alone responsible for 50.6% of the total. T

ppc.land·24d ago

Comments

Sign in to join the conversation.

No comments yet. Be the first.