80TB of astronomy data made accessible: Multimodal Universe crossmatching now works on a laptop
The Multimodal Universe (MMU) is a massive dataset pooling 80TB+ of data from over 30 astronomical surveys. Its key feature is crossmatching — linking observations of the same celestial object across different surveys. Previously, this required downloading large data chunks to local disk. The author and collaborators from the UniverseTBD and Hugging Science Discord communities converted the MMU to the parquet-based HATS format, enabling crossmatching using the LSDB and Hugging Face ecosystems directly from a laptop without needing a computing cluster.
Key quotes
The Multimodal Universe (MMU) pools together 80TB plus of data from over 30 astronomical surveys into one place.
Crossmatching (linking observations of the same object across surveys) is its killer feature, but until now it required downloading hefty chunks of data to local disk.
We got tired of needing a cluster just to run a crossmatch, so we gathered in the UniverseTBD and Hugging Science Discord servers to fix that.
We've converted the MMU to the parquet-based HATS format so that you can use the LSDB and Hugging Face ecosystems to...
From the article
You might also wanna read
Astronomers build a one-stop universe data hub
AstroGrid: A Browser-Based Real-Time 3D Universe Explorer
AstroGrid is a browser-based, real-time 3D universe exploration tool that lets users fly from Earth's surface to the edge of the observable
Product Hunt·2mo agoMM1: The Advanced 30B Parameters Multimodal LLM from Apple
Astronomers spot an extremely rare galaxy mega-merger
Meta Launches Muse Spark: A Multimodal AI Model for Everyday Users and Developers
Meta has launched Muse Spark, its 23rd product launch, which is a multimodal AI model designed for both everyday users and developers. The A
Product Hunt·1y ago
Meta Launches Muse Spark: A Multimodal AI Model for Everyday Users and Developers
Meta has launched Muse Spark, its 23rd product launch, which is a multimodal AI model designed for both everyday users and developers. The A
Product Hunt·1y ago
Comments
Sign in to join the conversation.
No comments yet. Be the first.