Product
Help
Pricing
About
Jobs
Log in
Get started
Keyword
Add to collection
modality interaction
Description:
The ways different modalities influence or combine with one another in multimodal learning, communication, or artificial-intelligence systems.
Related topics:
Multimodal Machine Learning Applications (16%),
Emotion and Mood Recognition (9%),
Sentiment Analysis and Opinion Mining (9%)
OpenAlex ID:
keywords/modality-interaction
DeepInteraction: 3D Object Detection Via Modality Interaction
2022
·
Zeyu Yang
, Jiaqi Chen
, et al.
·
neural information processing systems
·
304
PDF
The effects of stimulus sequence on event related potentials: A comparison of visual and auditory sequences
1977
·
Kenneth Squires
, Silvia Petuchowski
, et al.
·
Perception & Psychophysics
·
155
PDF
Audiovisual Fusion: Challenges and New Approaches
2015
·
Aggelos K. Katsaggelos
, Sara Bahaadini
, et al.
·
Proceedings of the IEEE
·
150
HGMF: Heterogeneous Graph-based Fusion for Multimodal Data with Incompleteness
2020
·
Jiayi Chen
, Aidong Zhang
·
ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD)
·
146
Investigating Audio, Video, and Text Fusion Methods for End-to-End Automatic Personality Prediction
2018
·
Onno Kampman
, Elham J. Barezi
, et al.
·
Proceedings of the conference - Association for Computational Linguistics. Meeting
·
127
PDF
When CLIP meets cross-modal hashing retrieval: A new strong baseline
2023
·
Xinyu Xia
, Guohua Dong
, et al.
·
Information Fusion
·
103
Unsupervised Cross-Modal Hashing With Modality-Interaction
2023
·
Rong-Cheng Tu
, Jie Jiang
, et al.
·
IEEE Transactions on Circuits and Systems for Video Technology
·
99
Releasing the Constraints on Aphasia Therapy: The Positive Impact of Gesture and Multimodality Treatments
2013
·
Miranda L. Rose
·
American Journal of Speech-Language Pathology
·
83
Visual and Auditory Stores in Short-term Memory
1966
·
Bennet B. Murdock
·
Quarterly Journal of Experimental Psychology
·
77
Recent Advances of Multimodal Continual Learning: A Comprehensive Survey
2026
·
Dianzhi Yu
, Xinni Zhang
, et al.
·
IEEE Transactions on Neural Networks and Learning Systems
·
64
PDF
Identifying Children with Specific Reading Disabilities From Listening and Reading Discrepancy Scores
1990
·
Carl Spring
, Lisa French
·
Journal of Learning Disabilities
·
59
Adaptive Modality Distillation for Separable Multimodal Sentiment Analysis
2021
·
Wei Peng
, Xiaopeng Hong
, et al.
·
IEEE Intelligent Systems
·
56
Backdooring Multimodal Learning
2024
·
Xingshuo Han
, Yutong Wu
, et al.
·
IEEE Symposium on Security and Privacy (S&P)
·
54
Modality interactions alter the shape of acoustic mate preference functions in gray treefrogs
2015
·
Michael S. Reichert
, Gerlinde Höbel
·
Evolution
·
54
Mimicking the Brain’s Cognition of Sarcasm From Multidisciplines for Twitter Sarcasm Detection
2021
·
Fanglong Yao
, Xian Sun
, et al.
·
IEEE Transactions on Neural Networks and Learning Systems
·
52
Decouple Before Interact: Multi-Modal Prompt Learning for Continual Visual Question Answering
2023
·
Zi Qian
, Xin Wang
, et al.
·
IEEE/CVF International Conference on Computer Vision (ICCV)
·
50
Where Does the Performance Improvement Come From? A Reproducibility Concern about Image-Text Retrieval
2022
·
Jun Rao
, Fei Wang
, et al.
·
International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR)
·
47
PDF
Perception of Speech Pattern Contrasts from Auditory Presentation of Voice Fundamental Frequency
1988
·
Arthur Boothroyd
·
Ear and Hearing
·
45
Multi-modal medical Transformers: A meta-analysis for medical image segmentation in oncology
2023
·
Gustavo Andrade-Miranda
, Vincent Jaouen
, et al.
·
Computerized Medical Imaging and Graphics
·
43
PDF
Unified Single-Stage Transformer Network for Efficient RGB-T Tracking
2024
·
Jianqiang Xia
, Dianxi Shi
, et al.
·
International Joint Conference on Artificial Intelligence
·
40
PDF
Camera–Radar Fusion with Modality Interaction and Radar Gaussian Expansion for 3D Object Detection
2024
·
Xiang Liu
, Zhenglin Li
, et al.
·
Cyborg and Bionic Systems
·
40
PDF
Cross-Modal Control of Attention Shifts
1998
·
Lawrence M Ward
, John J McDonald,
, et al.
·
Oxford University Press eBooks
·
37
Sentiment analysis of social media comments based on multimodal attention fusion network
2024
·
Ziyu Liu
, Tao Yang
, et al.
·
Applied Soft Computing
·
35
On Self-Supervised Multimodal Representation Learning: An Application To Alzheimer’s Disease
2021
·
Alex Fedorov
, Lei Wu
, et al.
·
IEEE International Symposium on Biomedical Imaging (ISBI)
·
33
PDF
Rethinking Missing Modality Learning from a Decoding Perspective
2023
·
Tao Jin
, Xize Cheng
, et al.
·
ACM International Conference on Multimedia (ACM MM)
·
24
PDF
Show more works
View as search
Works count:
139
Citation count:
2,462
Year
Topic
Type