Developer Battles AWS-Based Bot Sending 2 Billion Monthly Requests
By
lgats
Recycled flavour. You've tasted this bagel before.
Summary
A developer is experiencing massive bot traffic from AWS Singapore, with a crawler identified as 'Mozilla/5.0 (compatible; crawler)' sending over 700 requests per second (approximately 2 billion requests per month) to their domain. Despite multiple complaints to AWS, the company has refused to take action, stating the activity doesn't require intervention. The developer has successfully mitigated the impact using CloudFlare's WAF rules and 444 responses to reduce outbound traffic.
Key quotes
· 4 pulledI have been struggling with a bot– 'Mozilla/5.0 (compatible; crawler)' coming from AWS Singapore – and sending an absurd number of requests to my domain
averaging over 700 requests/second for several months now
Thankfully, CloudFlare is able to handle the traffic with a simple WAF rule and 444 response to reduce the outbound traffic
We have engaged with our customer, and based on this engagement have determined that the reported activity does not require further action from AWS at this time
You might also wanna read
Why local configuration verification is critical before cloud deployment in DevOps pipelines
The article discusses the importance of verifying configuration shifts locally before deploying to cloud clusters, using the example of a co
dev.to·3d ago
Understanding WebAuthn credential protection policy and discoverable credentials
This article explains the WebAuthn credential protection policy, specifically how developers can use the `residentKey` option to control whe
InstaVM: Hardware-Isolated Cloud Infrastructure for AI Agents with Sub-200ms MicroVMs
InstaVM is a cloud infrastructure platform designed specifically for AI agents, providing them with isolated, fast-booting virtual machines
Product Hunt·12d ago
Using OR-Tools CP-SAT to Optimize Cloud Infrastructure Maintenance Scheduling at Akamai
The article discusses using Google's OR-Tools CP-SAT solver to optimize maintenance scheduling in Akamai's cloud infrastructure. It addresse
atalaykutlay.com·18d ago
K3k: Rancher's Tool for Running Isolated Kubernetes Clusters Inside Kubernetes
K3k is an open-source tool from Rancher that enables users to create and manage isolated K3s (lightweight Kubernetes) clusters within an exi
github.com·1mo ago
Loopsy: Control Terminal AI Agents Remotely from Your Phone via Cloudflare Relay
Loopsy is a self-hosted tool that lets you control terminal-based AI coding agents (like Claude Code, Cursor, Codex) from your phone. It wor
github.com·1mo ago