Year: 2025
Type: article
Abstract: Polycode texts, which combine verbal and non-verbal elements, are increasingly prevalent in modern communication. This study investigates the cognitive models underlying the comprehension of polycode texts, aiming to elucidate the mental processes involved in integrating multiple semiotic systems. Using a mixed-methods approach, we conducted experiments with 120 participants (Mage = 28.5, SD = 4.2) to assess their comprehension of various polycode texts. Eye-tracking data and think-aloud protocols were collected and analyzed using both quantitative and qualitative methods. Results indicate that successful polycode text comprehension involves a complex interplay of visual attention, verbal processing, and cognitive integration. A novel "Integrated Polycode Comprehension Model" (IPCM) is proposed, synthesizing elements from dual coding theory and cognitive load theory. The IPCM suggests that comprehension is optimized when verbal and non-verbal elements are semantically congruent and spatially proximate. Furthermore, individual differences in cognitive styles significantly influenced comprehension patterns. These findings have important implications for the design of educational materials, user interfaces, and multimodal communication strategies. Future research directions and practical applications are discussed.
Author: Odilova Kamola Takhirovna
Institution: Uzbek State University of World Languages
Language: English
Subfield: Experimental and Cognitive Psychology
Field: Psychology
Domain: Social Sciences
SDG: Quality education
Open Access status: diamond
OpenAlex ID: W4409509053