Product
Help
Pricing
About
Jobs
Log in
Get started
Keyword
Add to collection
graphical user interface interaction
Description:
The ways users or software agents perceive and act on controls and content in graphical interfaces.
Related topics:
User Authentication and Security Systems (8%),
Interactive and Immersive Displays (7%)
OpenAlex ID:
keywords/graphical-user-interface-interaction
User identification and authentication using multi-modal behavioral biometrics
2014
·
Kyle O. Bailey
, James S. Okolica
, et al.
·
Computers & Security
·
193
Agent S2: A Compositional Generalist-Specialist Framework for Computer Use Agents
2025
·
Agashe, Saaket
, Wong, Kyle
, et al.
·
arXiv (Cornell University)
·
184
PDF
GUI Agents with Foundation Models: A Comprehensive Survey
2024
·
Wang, Shuai
, Liu, Weiwen
, et al.
·
arXiv (Cornell University)
·
166
PDF
ScreenAgent: A Vision Language Model-driven Computer Control Agent
2024
·
Runliang Niu
, Jindong Li
, et al.
·
International Joint Conference on Artificial Intelligence
·
148
PDF
GTA1: GUI Test-time Scaling Agent
2025
·
Yang, Yan
, Li, Dongxu
, et al.
·
International Conference on Learning Representations
·
120
VisualAgentBench: Towards Large Multimodal Models as Visual Foundation Agents
2024
·
Liu, Xiao
, Zhang, Tianjie
, et al.
·
International Conference on Learning Representations
·
117
JustSpeak: enabling universal voice control on Android
2014
·
Yu Zhong
, T. V. Raman
, et al.
·
International Web for All Conference (W4A)
·
89
Mouse Dynamics Behavioral Biometrics: A Survey
2024
·
Simon Khan
, Charles Devlen
, et al.
·
ACM Computing Surveys
·
82
PDF
OS Agents: A Survey on MLLM-Based Agents for General Computing Devices Use
2024
·
Xueyu Hu
, Tao Xiong
, et al.
·
Preprints.org
·
79
Enhancing Visual Grounding for GUI Agents via Self-Evolutionary Reinforcement Learning
2025
·
Yuan, Xinbin
, Zhang, Jian
, et al.
·
arXiv (Cornell University)
·
78
PDF
MobileAgentBench: An Efficient and User-Friendly Benchmark for Mobile LLM Agents
2024
·
Wang, Luyuan
, Deng, Yongyu
, et al.
·
arXiv (Cornell University)
·
78
PDF
CoAct-1: Computer-using Multi-Agent System with Coding Actions
2025
·
Song, Linxin
, Dai, Yutong
, et al.
·
International Conference on Learning Representations
·
70
Programming by example: visual generalization in programming by example
2000
·
Robert St. Amant
, Henry Lieberman
, et al.
·
Communications of the ACM
·
49
PDF
CUA-Skill: Develop Skills for Computer Using Agent
2026
·
Chen, Tianyi
, Li, Yinheng
, et al.
·
arXiv (Cornell University)
·
46
PDF
Robotic Process Automation Through Advance Process Analysis Model
2020
·
Devansh Hiren Timbadia
, Parin Jigishu Shah
, et al.
·
International Conference on Inventive Computation Technologies (ICICT)
·
45
OSCAR: Operating System Control via State-Aware Reasoning and Re-Planning
2024
·
Wang, Xiaoqiang
, Liu, Bang
·
International Conference on Learning Representations
·
38
VisualHaptics: generating haptic sensation using only visual cues
2008
·
Keita Watanabe
, Michiaki Yasumura
·
International Conference on Advances in Computer Entertainment Technology (ACE)
·
32
AdaptAgent: Adapting Multimodal Web Agents with Few-Shot Learning from Human Demonstrations
2025
·
Gaurav Verma
, Rachneet Kaur
, et al.
·
Proceedings of the conference - Association for Computational Linguistics. Meeting
·
30
PDF
The SmARtphone Controller: Leveraging Smartphones as Input and Output Modality for Improved Interaction within Mobile Augmented Reality Environments
2021
·
Pascal Knierim
, Dimitri Hein
, et al.
·
i-com
·
29
An automatic Drag-and-Drop assistive program developed to assistive people with developmental disabilities to improve Drag-and-Drop efficiency
2009
·
Ching-Hsiang Shih
, Hsun-Chin Huang
, et al.
·
Research in Developmental Disabilities
·
26
GUI-Robust: A Comprehensive Dataset for Testing GUI Agent Robustness in Real-World Anomalies
2026
·
Jingqi Yang
, Zhilong Song
, et al.
·
ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD)
·
19
Measuring User Perception for Detecting Unexpected Access to Sensitive Resource in Mobile Apps
2021
·
Trung Tin Nguyen
, Duc Cuong Nguyen
, et al.
·
ACM Asia Conference on Computer and Communications Security (ASIA CCS)
·
18
ClickAgent: Enhancing UI Location Capabilities of Autonomous Agents
2025
·
Jakub Hoscilowicz
, Artur Janicki
·
Annual Meeting of the Special Interest Group on Discourse and Dialogue
·
17
PDF
GUI Usage Analysis for Masquerade Detection
2007
·
Eric S Imsand
, John A Hamilton
·
IEEE SMC Information Assurance Workshop (IAW)
·
17
wUbi-Pen: Sensory Feedback Stylus Interacting with Graphical User Interface
2012
·
Ki-Uk Kyung
, Jun-Young Lee
, et al.
·
PRESENCE Virtual and Augmented Reality
·
15
Show more works
View as search
Works count:
115
Citation count:
2,028
Year
Topic
Type