Navigating by Old Maps: The Pitfalls of Static Mechanistic Localization in LLM Post-Training
The "Locate-then-Update" paradigm has become a predominant approach in the post-training of large language models (LLMs), identifying critical components via mechanistic …
hang-chen-jiaying-zhu-hongyang-chen-hongxu-liu-xinyu-yang-wenya-wang