UltraX: Refining Pre-Training Data at Scale with Adaptive Programmatic Editing
arXiv:2607.08646v1 Announce Type: new Abstract: As available training data approaches its physical limit, gains from Scaling Laws have begun to diminish. Consequently, improving Large Language Models…
Read the full articleYou might also wanna read
MegaTrain: Full Precision Training of 100B+ Parameter Large Language Models on a Single GPU
Authors: Zhengqing Yuan, Hanchi Sun, Lichao Sun, Yanfang Ye
Study reveals why in-context learning fails on complex specification-heavy tasks and how fine-tuning can help
In-context learning (ICL) has become the default method for using large language models (LLMs), making the exploration of its limitations an
arxiv.org·19d agoLarge language model training with 90% cost-cut fine-tuning
Master LLM training in 2026 with practical strategies for data curation, architecture selection, and 90% cost reduction through fine-tuning
Context Tuning: Efficient LLM Adaptation via Direct Memory Representation Optimization
Context Tuning directly optimizes an LLM's memory representation for efficient adaptation without updating model weights.
agenticlearning.ai·1d ago
RegMix-D: A Dynamic Data Mixing Method for LLM Pretraining Using Proxy Training Trajectories
Data mixture selection is critical for Large Language Model pretraining. Existing methods such as RegMix select a single static mixture by f
arxiv.org·8d ago
PromptEmbedder: A Dual-LLM Framework for Efficient, Architecture-Agnostic Text Embedding
Large Language Models (LLMs) have demonstrated remarkable efficacy in text embedding, yet current adaptation methods like LoRA face signific
arxiv.org·1mo ago
Comments
Sign in to join the conversation.
No comments yet. Be the first.