GUI-Agents-Paper-List

🥈Silver

A curated list of papers on GUI agents, including datasets, benchmarks, models, and frameworks. Operations teams use it to research and implement GUI agent technologies. Connects to Python workflows and supports Claude agents.

641330Updated Today

Intermediate30min to implementautomation

Saves ~30 min per use

Quick InstallView Source

git clone https://github.com/OSU-NLP-Group/GUI-Agents-Paper-List.git

Works with:

Claude

Overview

About This Skill

https://github.com/your-repo-link

Use Cases

Quickly find relevant research papers on specific topics related to GUI agents.

Access categorized resources to streamline the development of GUI agent applications.

Stay updated on the latest benchmarks and models for evaluating GUI agents.

Explore datasets that can be used for training and testing GUI agents.

Setup & Installation

Quick Install

No install command available. Check the GitHub repository for manual installation instructions.

Alternative Install (Git Clone)

git clone https://github.com/OSU-NLP-Group/GUI-Agents-Paper-List

Requirements

Claude Code or compatible AI agent
Works with: Claude

Quick Start Guide

Install the Skill

Copy the install command above and run it in your terminal.

Open Your AI Agent

Launch Claude Code, Cursor, or your preferred AI coding agent.

Try It Out

Use the prompt template or examples below to test the skill.

Customize

Adapt the skill to your specific use case and workflow.

Usage Examples

Prompt Template

Create a comprehensive list of research papers focused on GUI agents. Include papers from the last 5 years, covering topics like automated GUI testing, visual interface agents, and interactive AI for graphical user interfaces. Ensure the list is organized by publication year and includes a brief summary of each paper's key contributions. Focus on papers relevant to [COMPANY]'s work in [INDUSTRY] and any specific [DATA] requirements.

Example Output

# GUI Agents Research Papers (2019-2024)

## 2024
- **Title**: Advances in Visual Interface Agents for Accessibility
  - **Summary**: This paper explores the use of AI-driven GUI agents to enhance accessibility features in modern applications. It introduces a novel framework for automating screen reader interactions and adaptive UI adjustments.

## 2023
- **Title**: Automated GUI Testing with Reinforcement Learning
  - **Summary**: The authors present a reinforcement learning approach to automate GUI testing, significantly reducing the need for manual test case creation. The method demonstrates improved coverage and defect detection rates.

## 2022
- **Title**: Interactive AI for Graphical User Interfaces
  - **Summary**: This study investigates the integration of conversational AI with GUI elements, enabling users to interact with interfaces through natural language commands. The research includes a comparative analysis of different NLP models for this purpose.