20x Faster Training Data Reads with Alluxio and Ray Data: A Cross-Region Benchmark

MegaTrain: Full Precision Training of 100B+ Parameter Large Language Models on a Single GPU

Authors: Zhengqing Yuan, Hanchi Sun, Lichao Sun, Yanfang Ye

Introducing the Together AI Batch API: Process Thousands of LLM Requests at 50% Lower Cost

Modular: Modular Platform 25.5: Introducing Large Scale Batch Inference

Modular Platform 25.5: Introducing Large Scale Batch Inference

Scikit-Learn Pipelines: Build & Optimize ML Workflows

Chain preprocessing and model training steps into one Scikit-Learn pipeline, tune hyperparameters with GridSearchCV, prevent data leakage

MegaTrain: System for Training 100B+ Parameter LLMs on Single GPU Using CPU Memory

We present MegaTrain, a memory-centric system that efficiently trains 100B+ parameter large language models at full precision on a single GP

Serving MiniMax-M3 for efficient inference: Unlocking 1M-Token Context and Multimodality Without Regrets

How Together served MiniMax-M3 efficiently with KV-block-major sparse attention, paged MSA decode, optimized index scoring, and a Rust-based