Amazonbot to respect robots.txt starting June 15, 2026
By
xena
Crackles when you bite it. Shows the baker did the work.
Summary
Amazon announced that starting June 15, 2026, its crawler (Amazonbot) will respect robots.txt directives, moving away from any proprietary management system. The author expresses gratitude for this change, noting it provides a viable business model for them.
Key quotes
· 3 pulledWe are writing to inform you that starting Monday, June 15, 2026, crawl preferences for Amazonbot will be managed solely through the industry-standard directives.
This gives you direct, ongoing
Thanks for giving me a viable business model Amazon!
You might also wanna read
Satya Nadella dismantles Microsoft's decades-old senior leadership team structure
Satya Nadella has quietly dismantled Microsoft's decades-old Senior Leadership Team (SLT) structure. The SLT, which consisted of powerful ex
thenextweb.com·37m ago
Nvidia selects Unitree's humanoid robot for first publicly available robotics system; Chinese startup eyes IPO
Nvidia has selected Chinese startup Unitree as the robotics platform for its first publicly available humanoid robotics system. The system c
cnbc.com·37m ago
LG Electronics stock quadruples in 2024 after Nvidia physical AI meeting announcement and new car display tech
LG Electronics shares have quadrupled this year, driven by two key catalysts: the unveiling of Android Automotive-based car display technolo
thenextweb.com·37m ago
TechForce Robotics Deploys LIM-E Lab Robot at Oncotelic Therapeutics, Entering Pharmaceutical Automation Market
TechForce Robotics (formerly Nightfood Holdings) has entered the pharmaceutical automation market with its first deployment of the LIM-E aut
financialpost.com·45m ago
Nvidia launches DGX Station for Windows: a deskside AI supercomputer for 1 trillion-parameter models
Nvidia has announced the DGX Station for Windows, a deskside AI supercomputer capable of handling 1 trillion-parameter AI models. The compac
siliconangle.com·46m agoNvidia launches DGX Station for Windows: a deskside AI supercomputer for 1 trillion-parameter models
Nvidia has announced the DGX Station for Windows, a deskside AI supercomputer capable of handling 1 trillion-parameter AI models. The compac
siliconangle.com·46m ago