Memorization Sinks: Isolating Memorization during LLM Training
arXiv:2507.09937v2 Announce Type: replace-cross Abstract: Large language models are susceptible to memorizing repeated sequences, posing privacy and copyright concerns. A popular mitigation strategy is to remove memorized information from specific neurons post-hoc. However, such approaches have shown limited success so…
