Introduction to Self-Adapting Language Models (SEAL)
The article introduces Self-Adapting Large Language Models (SEAL), a framework that enables models to self-adapt by generating their own finetuning data and update directives. SEAL allows models to produce self-edits in response to new inputs, restructuring information, specifying optimization parameters, and invoking tools for updates. It uses reinforcement
arxiv.org11mo ago
