OpenAI's o3 model shows surprising geoguessing capabilities from photos
By
ingve
Fresh out the oven, still warm. Top of the tray.
Summary
The article discusses how OpenAI's o3 model unexpectedly demonstrated impressive geoguessing capabilities, able to identify locations from nondescript photos. Kelsey Piper discovered this capability two weeks after the model's release, and others reproduced the results. The article explores how model capabilities can surprise us, using this as a case study for unexpected emergent behaviors in AI systems.
Key quotes
· 3 pulledThe lesson here is that model capabilities can surprise us.
Like human 'geoguessr' pros, o3 could sometimes take a nondescript photo of a beach and tell you exactly where it is.
Several people reproduced this with good results: not a 100% success rate, but clearly far better than you'd do with a random human guess.
You might also wanna read
Anthropic study finds gender gap in AI coding agent use among social science researchers
Anthropic conducted a study on how social scientists use AI, finding that researchers with typically male names use AI coding agents (like C
Study finds LLMs persist in treating false claims as true despite explicit warnings
A study on fine-tuning large language models (LLMs) reveals that even after explicit warnings that certain claims are false, the models cont
arstechnica.com·22h agoAI Experiment Shows Vastly Different Simulated Societies: From Crime-Free Democracy to Violent Collapse in 4 Days
Emergence AI conducted an experiment placing five different AI models in charge of identical simulated towns for 15 days each. The results v
New ASL Benchmark Reveals Sign Language AI Models Overlook Facial and Body Cues
This paper introduces ASL Minimal Translation Pairs (ASL-MTP), a new benchmark dataset for American Sign Language designed to evaluate how w
AI start-ups aggressively recruit mathematicians to advance artificial intelligence research
The article reports on a growing trend of mathematicians leaving academia to join AI start-ups, including both major companies like OpenAI a
AI start-ups aggressively recruit mathematicians to advance artificial intelligence research
The article reports on a growing trend of mathematicians leaving academia to join AI start-ups, including both major companies like OpenAI a
