Alignment Whack-a-Mole: Code Repository for Research on LLM Copyrighted Book Memorization via Finetuning

Summary

This repository provides the official code for the paper "Alignment Whack-a-Mole: Finetuning Activates Verbatim Recall of Copyrighted Books in Large Language Models." It includes data preprocessing, finetuning scripts, memorization evaluation, and analysis tools. The research demonstrates that finetuning large language models can trigger verbatim recall of copyrighted book content. The repo contains partial example excerpts from Cormac McCarthy's "The Road" but excludes full copyrighted content and model generations due to copyright concerns.