Calibrating and Rotating: A Unified Framework for Weight Conditioning in PEFT
arXiv:2511.00051v1 Announce Type: new Abstract: Parameter-Efficient Fine-Tuning (PEFT) methods are crucial for adapting large pre-trained models. Among these, LoRA is considered a foundational approach. Building on this, the influential DoRA method enhances performance by decomposing weight updates into magnitude and…
