Product
Help
Pricing
About
Jobs
Log in
Get started
Keyword
Add to collection
InstructBLIP
Description:
An instruction-tuned vision-language model that follows text prompts to interpret images and answer questions about them.
Primary topic:
Multimodal Machine Learning Applications (65%)
Related topics:
Multimodal Machine Learning Applications (65%),
Adversarial Robustness in Machine Learning (20%)
OpenAlex ID:
keywords/instructblip
InstructBLIP: Towards General-purpose Vision-Language Models with Instruction Tuning
2023
·
Dai, Wenliang
, Li, Junnan
, et al.
·
arXiv (Cornell University)
·
2,296
PDF
InstructBLIP: Towards General-purpose Vision-Language Models with Instruction Tuning
2023
·
Wenliang Dai
, Junnan Li
, et al.
·
neural information processing systems
·
1,383
Detecting and Preventing Hallucinations in Large Vision Language Models
2024
·
Anisha Gunjal
, Jihan Yin
, et al.
·
Proceedings of the AAAI Conference on Artificial Intelligence
·
577
PDF
LVLM-EHub: A Comprehensive Evaluation Benchmark for Large Vision-Language Models
2024
·
Peng Xu
, Wenqi Shao
, et al.
·
IEEE Transactions on Pattern Analysis and Machine Intelligence
·
402
BLIVA: A Simple Multimodal LLM for Better Handling of Text-Rich Visual Questions
2024
·
Wenbo Hu
, Yifan Xu
, et al.
·
Proceedings of the AAAI Conference on Artificial Intelligence
·
275
PDF
DOCCI: Descriptions of Connected and Contrasting Images
2024
·
Yasumasa Onoe
, Sunayana Rane
, et al.
·
Lecture notes in computer science
·
164
PDF
Mixture of Cluster-Conditional LoRA Experts for Vision-Language Instruction Tuning
2026
·
Yunhao Gou
, Zhili Liu
, et al.
·
IEEE Transactions on Image Processing
·
143
PDF
An Image Is Worth 1000 Lies: Adversarial Transferability across Prompts on Vision-Language Models
2024
·
Luo, Haochen
, Gu, Jindong
, et al.
·
International Conference on Learning Representations
·
135
PDF
Model Tailor: Mitigating Catastrophic Forgetting in Multi-modal Large Language Models
2024
·
Zhu, Didi
, Sun, Zhongyi
, et al.
·
arXiv (Cornell University)
·
105
PDF
EmoVIT: Revolutionizing Emotion Insights with Visual Instruction Tuning
2024
·
Hongxia Xie
, Chu-Jun Peng
, et al.
·
IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings
·
97
PDF
Test-Time Backdoor Attacks on Multimodal Large Language Models
2024
·
Lu, Dong
, Pang, Tianyu
, et al.
·
arXiv (Cornell University)
·
93
PDF
AntifakePrompt: Prompt-Tuned Vision-Language Models are Fake Image Detectors
2023
·
Chang, You-Ming
, Yeh, Chen
, et al.
·
arXiv (Cornell University)
·
91
PDF
Vision-Language Model for Generating Textual Descriptions From Clinical Images: Model Development and Validation Study
2024
·
Jia Ji
, Yongshuai Hou
, et al.
·
JMIR Formative Research
·
64
PDF
Vision-LLMs Can Fool Themselves with Self-Generated Typographic Attacks
2024
·
Qraitem, Maan
, Tasnim, Nazia
, et al.
·
arXiv (Cornell University)
·
59
PDF
Selective “Selective Prediction”: Reducing Unnecessary Abstention in Vision-Language Reasoning
2024
·
Tejas Srinivasan
, Jack Hessel
, et al.
·
Findings of the Association for Computational Linguistics: ACL (Findings of ACL)
·
59
PDF
Ideator: Jailbreaking and Benchmarking Large Vision-Language Models Using Themselves
2025
·
Ruofan Wang
, Juncheng Li
, et al.
·
IEEE/CVF International Conference on Computer Vision (ICCV)
·
58
PDF
Finer: Investigating and Enhancing Fine-Grained Visual Concept Recognition in Large Vision Language Models
2024
·
Jeonghwan Kim
, Heng Ji
·
Conference on Empirical Methods in Natural Language Processing (EMNLP)
·
41
Align Is Not Enough: Multimodal Universal Jailbreak Attack Against Multimodal Large Language Models
2025
·
Youze Wang
, Wenbo Hu
, et al.
·
IEEE Transactions on Circuits and Systems for Video Technology
·
38
PDF
A Multi-Modal Foundation Model to Assist People with Blindness and Low Vision in Environmental Interaction
2024
·
Yu Hao
, Fan Yang
, et al.
·
Journal of Imaging
·
34
PDF
Uncertainty in Visual Generative AI
2024
·
Kara Combs
, Adam Moyer
, et al.
·
Algorithms
·
24
PDF
Towards Efficient Visual-Language Alignment of the Q-Former for Visual Reasoning Tasks
2024
·
Sungkyung Kim
, Adam Lee
, et al.
·
Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP)
·
22
PDF
GeReA: Question-Aware Prompt Captions for Knowledge-based Visual Question Answering
2024
·
Ma, Ziyu
, Li, Shutao
, et al.
·
arXiv (Cornell University)
·
19
PDF
V-SEAM: Visual Semantic Editing and Attention Modulating for Causal Interpretability of Vision-Language Models
2025
·
Qidong Wang
, Junjie Hu
, et al.
·
Conference on Empirical Methods in Natural Language Processing (EMNLP)
·
17
Question-Instructed Visual Descriptions for Zero-Shot Video Question Answering
2024
·
Romero, David
, Solorio, Thamar
·
arXiv (Cornell University)
·
17
PDF
Mitigating Image Captioning Hallucinations in Vision-Language Models
2025
·
Fei Zhao
, Chengcui Zhang
, et al.
·
IEEE International Conference on Multimedia Information Processing and Retrieval (MIPR)
·
13
PDF
Show more works
View as search
Works count:
96
Citation count:
6,816
Year
Topic
Type