Work

Multimodal Large Language Models for Multi-Subject In-Context Image Generation

Year: 2026
Type: conference-paper
Abstract: Recent advances in text-to-image (T2I) generation have enabled visually coherent image synthesis from descriptions, but generating images containing multiple given subjects remains challenging.As the number of reference identities increases, existing methods often suffer from subject missing and semantic drift.To address this problem, we propose MU-SIC, the first MLLM specifically designed for MUlti-Subject In-Context image generation.To overcome the data scarcity, we introduce an automatic and scalable data generation pipeline that eliminates the need for manual annotation.Furthermore, we enhance the model's understanding of multi-subject semantic relationships through a vision chain-of-thought (CoT) mechanism, guiding step-by-step reasoning from subject images to semantics and generation.To mitigate identity entanglement and manage visual complexity, we develop a novel semantics-driven spatial layout planning method and demonstrate its test-time scalability.By incorporating complex subject images during training, we improve the model's capacity for chained reasoning.In addition, we curate MSIC, a new benchmark tailored for multi-subject in-context generation.Experimental results demonstrate that MUSIC significantly surpasses other methods in both multiand single-subject scenarios.
Institution: University of Macau
Language: English
Open Access status: hybrid
OpenAlex ID: W7166841363
FWCI:
Cites:
Cited by:
Related to: 10