AI agent for UI automation that understands mobile and web interfaces. Enables natural-language test automation for QA teams. Integrates with Robot Framework for test execution and reporting.
git clone https://github.com/aidriventesting/Agent.gitRobot Framework Agent transforms plain-English instructions into automated UI interactions and visual checks across web and mobile platforms. It integrates with Robot Framework's test execution model, allowing QA teams to write human-readable test steps like 'click on login button' and 'verify homepage is displayed' without manual tool scripting. The Agent uses vision-based UI parsing and LLM-driven element detection to locate and interact with interface components. Supported LLM providers include OpenAI, Anthropic Claude, and Google Gemini. Currently in alpha maturity, it demonstrates experimental approaches to AI-assisted test automation.
Install with `pip install robotframework-agent` (add `[mobile]` for Appium support). Configure the Agent library in Robot Framework settings with your LLM provider (OpenAI default, or `llm_client=anthropic` for Claude). Write test cases using `Agent.Do` for actions, `Agent.Check` for assertions, and `Agent.Ask` for UI queries in natural language.
Write mobile app test scenarios in natural language without coding Appium logic
Convert manual QA test steps into executable Robot Framework tests
Verify UI states visually across responsive web and mobile designs
Automate repetitive form input and navigation workflows
No install command available. Check the GitHub repository for manual installation instructions.
git clone https://github.com/aidriventesting/AgentCopy the install command above and run it in your terminal.
Launch Claude Code, Cursor, or your preferred AI coding agent.
Use the prompt template or examples below to test the skill.
Adapt the skill to your specific use case and workflow.
Create a UI automation test for [COMPANY] in the [INDUSTRY] sector. The test should verify that users can successfully [ACTION] on the [PLATFORM] (web or mobile) using the following steps: [STEPS]. Include assertions to validate the expected outcomes. Format the test for Robot Framework integration.
# UI Automation Test for E-Commerce Checkout Process ## Test Case: Successful Product Purchase **Steps:** 1. Navigate to the homepage 2. Search for 'wireless headphones' 3. Select the first product in the search results 4. Add the product to cart 5. Proceed to checkout 6. Enter shipping information 7. Complete payment **Assertions:** - Verify product is added to cart successfully - Confirm order confirmation page is displayed - Validate order number is generated **Test Data:** - Product: Wireless Headphones - Quantity: 1 - Shipping Address: 123 Tech Lane, San Francisco, CA - Payment Method: Credit Card (Visa) **Expected Result:** Order confirmation with tracking number
Create and collaborate on interactive animations with powerful, user-friendly tools.
Automate your browser workflows effortlessly
Get more done every day with Microsoft Teams – powered by AI
Automate your spreadsheet tasks with AI power
Agentic AI Workflow platform
Connected workspace for docs, wikis, and projects
Take a free 3-minute scan and get personalized AI skill recommendations.
Take free scan