All Topics
All Topics
Technology
Technology
Design
Design
Programming
Programming
Science
Science
News
News
Gaming
Gaming
Entertainment
Entertainment
Business
Business
Finance
Finance
Sports
Sports
Health
Health
Food
Food
Travel
Travel
Art
Art
Music
Music
Books
Books
Education
Education
Politics
Politics
Personal
Personal
No algorithm. No AI slop. No ads. Just RSS. Pro-human. Indie writers. Real journalism. Open web. Chronological. Hand toasted.

Developer scrapes 241 UK council planning portals, collects 2.6 million planning decisions

By

mebkorea

1mo ago· 2 min readenInsight

Summary

A developer spent four months scraping 241 UK council planning portals, collecting 2.6 million planning decisions across England, Scotland, and Wales. The article highlights the paradox that while UK planning data is technically public, it's fragmented across 400+ different council portals with varying systems (Idox being most common), outdated technology (some running ASP.NET from 2004), and inconsistent schemas, making access extremely difficult in practice.

Key quotes

· 4 pulled
UK planning data is technically public. In practice it's locked behind 400+ different council portals
some still running bespoke ASP.NET that looks like it dates from 2004
I've spent four months scraping them. I'm now at 241 councils and 2.6 million decisions across England, Scotland and Wales
In theory this makes things easy. In practice every council has conf
Snippet from the RSS feed
I've been scraping 241 UK council planning portals – 2.6M decisions so far

You might also wanna read