Reinforcement Learning Environment for LLMs in Cancer Diagnosis from Pathology Slides
By
dchu17
The kind of bagel that ruins lesser bagels for you.
Summary
A developer from Aluna (YC S24) presents a reinforcement learning environment for large language models focused on cancer diagnosis. The environment allows frontier LLMs to navigate digitized pathology slides by zooming and panning to identify relevant regions for diagnosis. The project demonstrates how LLMs can be trained to perform medical diagnostic tasks using interactive tools, with videos showing the LLM performing diagnosis on pathology slides. The work involves collaboration with diagnostic labs to build datasets and evaluations for oncology tasks.
Key quotes
· 3 pulledHey HN, this is David from Aluna (YC S24). We work with diagnostic labs to build datasets and evals for oncology tasks.
I wanted to share a simple RL environment I built that gave frontier LLMs a set of tools that lets it zoom and pan across a digitized pathology slide to find the relevant regions to make a diagnosis.
Here are some videos of the LLM performing diagnosis on a few slides.
You might also wanna read
MIRA Vision: AI-Powered Pathology Analysis Platform Using Synthetic Data
MIRA vision is an AI-powered pathology analysis platform that uses synthetic data to improve medical diagnostics. The platform aims to enhan
Transforming Medical Data into Reasoning Traces for Improved LLM Clinical Performance
The article discusses how the value of data has shifted in the age of LLMs, arguing that simply having proprietary data is no longer suffici
Sully.ai Launches Consensus: Ensemble AI System for Clinical Diagnosis
Sully.ai introduces Consensus, a medical AI system that uses an ensemble of specialized LLM agents to mimic clinical triage and decision-mak
OpenAI launches Rosalind Biodefense to provide trusted AI access for biodefense and pandemic preparedness
OpenAI has launched Rosalind Biodefense, an initiative expanding trusted access to GPT-Rosalind—a specialized AI model—for vetted developers
CQC outlines regulatory approach to artificial intelligence in health and social care
The Care Quality Commission (CQC), England's independent regulator of health and social care, outlines its role, expectations, and plans reg

Monash Event to Focus on Practical, High-Impact Health AI Beyond the Hype
This article promotes a Monash University event focused on moving health AI beyond hype toward practical, real-world impact. The event bring
