The FeedBagel Blog
Notes from the kitchen. Things we're baking, things we've burnt, things that turned out crispy.
Who was scraping FeedBagel at 1,000 requests a minute?
For a week the site kept falling over under 1,000+ requests a minute, and almost none of them came from people. Where the traffic came from, why a small site gets crawled this hard, and the four layers that stopped it.
Read post →How FeedBagel decides what counts as a story
What turns 54 articles into one story card, how a story earns its place on a topic page, and the work making grouped pages load instantly.
Read post →Folders: collect articles, get an RSS feed, and pipe them anywhere
Save articles into folders. Each folder gets its own RSS feed, and you can subscribe a webhook to a folder so new additions are delivered to your own app.
Read post →FeedBagel now discovers publishers on its own
A new feed-discovery feature finds other sites covering the same story, checks their RSS feeds, and adds the working ones to the rotation automatically.
Read post →