Antislop: Identifying and Eliminating Repetitive Patterns in LLMs
The paper introduces "Antislop," a method to detect and remove repetitive text patterns in large language models (LLMs). It identifies common failure modes where models generate loops or stale repetitions, and proposes interventions to eliminate this behavior during generation.