Work

ReasonAny: Incorporating Reasoning Capability to Any Model via Simple and Effective Model Merging

Year: 2026
Type: conference-paper
Abstract: Large Reasoning Models (LRMs) with long chain-of-thought reasoning have recently achieved remarkable success.Yet, equipping domain-specialized models with such reasoning capabilities, referred to as "Reasoning + X", remains a significant challenge.While model merging offers a promising training-free solution, existing methods often suffer from a destructive performance collapse: existing methods tend to both weaken reasoning depth and compromise domain-specific utility.Interestingly, we identify a counter-intuitive phenomenon underlying this failure: reasoning ability predominantly resides in parameter regions with low gradient sensitivity, contrary to the common assumption that domain capabilities correspond to high-magnitude parameters.Motivated by this insight, we propose ReasonAny, a novel merging framework that resolves the reasoning-domain performance collapse through Contrastive Gradient Identification.Experiments across safety, biomedicine, and finance domains show that ReasonAny effectively synthesizes "Reasoning + X" capabilities, significantly outperforming state-of-theart baselines while retaining robust reasoning performance.
Language: English
Open Access status: hybrid
OpenAlex ID: W7166812912
FWCI:
Cites:
Cited by:
Related to: 10