Year: 2026
Type: article
Abstract: Training‐free image editing with MMDiT‐based flow models typically preserves source content by injecting source features into the target generation branch. However, achieving high‐quality text‐guided editing remains challenging because different editing tasks require different balances between content preservation and modification. To address this, we propose Function‐Aware Regional Injection (FARI), a framework that analyzes the functional roles across MMDiT transformer blocks to determine where and how to inject source features. Through analysis, we identify four key functional components: (1) spatial anchoring blocks that preserve object positions and layout, (2) pre‐activation blocks where editing‐related semantic changes begin to emerge, (3) semantic blocks where editing‐related semantic changes develop into explicit content modifications, and (4) late refinement blocks that consolidate visual information into a coherent final output. Based on these insights, FARI applies selective feature transfer in the anchoring and refinement blocks, while incorporating all source features in the pre‐activation and semantic blocks to support larger content changes. This design enables interpretable control over preservation‐modification trade‐offs and provides editing policies tailored to different edit instructions (e.g., changing object, adjusting color). Experiments on a newly curated benchmark and PIE‐Bench demonstrate that FARI achieves favorable trade‐offs across all five edit instruction types by balancing preservation and editability, rather than relying on a single globally optimal injection policy.
Source: Computer Graphics Forum
DOI: 10.1111/cgf.70614
Authors: Siyuan Xing, Xiao‐Ming Fu
Institution: University of Science and Technology of China
Language: English
Subfield: Computer Vision and Pattern Recognition
Field: Computer Science
Domain: Physical Sciences
Keywords: diffusion models, spatial anchoring
Open Access status: bronze
Awards: G4598185674, G8672304353
OpenAlex ID: W7226001925
