Create, run, rate, and iterate on Claude Skills. Designed for operations teams to streamline workflow automation. Connects to Claude agents for rapid development and testing.
git clone https://github.com/gaearon/woodshed.gitWoodshed is a tool for creating and iterating on Claude Skills through automated testing and evaluation. It runs Skills against fixtures, captures results, and enables rapid refinement cycles by comparing variants and analyzing performance. The tool supports multiple skill variants, fixture-based testing, and batch runs to identify what works best. Built for teams that need to systematically develop and improve Claude-based workflow automation agents. Setup involves creating a workspace, defining skills and test fixtures, then running the evaluation matrix to collect results for analysis.
["Open the [TOOL: e.g., Claude Console, VS Code with Claude extension] and navigate to the 'Skills' tab.","Click 'Create New Skill' and paste the prompt template from this skill. Replace [PLACEHOLDERS] with your skill's name and domain.","Run the skill in the [TOOL] by clicking 'Test Skill'. Monitor the output in the [TOOL]'s console for errors or warnings.","Rate the skill's effectiveness using the [CRITERIA] provided in the skill's rating criteria. Adjust the skill's actions based on the ratings.","Iterate on the skill by clicking 'Update Skill' in the [TOOL]. Test the updated skill again to ensure all changes work as expected."]
Testing multiple skill variants against consistent test cases
Automating Claude agent evaluation and iteration workflows
Comparing baseline vs. experimental skill implementations
Collecting structured results for skill performance analysis
No install command available. Check the GitHub repository for manual installation instructions.
git clone https://github.com/gaearon/woodshedCopy the install command above and run it in your terminal.
Launch Claude Code, Cursor, or your preferred AI coding agent.
Use the prompt template or examples below to test the skill.
Adapt the skill to your specific use case and workflow.
Develop a new Claude Skill called [SKILL_NAME] focused on [DOMAIN: e.g., customer support, sales automation]. Use the following structure for the skill: '## Overview\n[1-2 sentences describing the skill].\n## Actions\n[3-5 bullet points listing specific actions users can take].\n## Rating Criteria\n[3-5 criteria the AI will use to rate the skill's effectiveness].' Include [PLACEHOLDERS] for the skill's name, domain, and any customization needed. Test the skill by running it in [TOOL: e.g., Claude Console, VS Code with Claude extension].
A new Claude Skill named 'Customer Support Automation' was created and tested. The skill includes an overview ('Automates routine customer support tasks like ticket routing and FAQ generation'), actions ('Run automated ticket routing for [DEPARTMENT], Generate FAQ snippets for [TOPIC], Rate the skill's effectiveness using [CRITERIA]'), and rating criteria ('Response time improvement, Ticket deflection rate, User satisfaction score').
The skill was tested by running it in Claude Console. During the test, 500 customer support tickets were automatically routed, and a 15% improvement in response time was observed. The skill's effectiveness was rated using the following criteria: response time improvement (15%), ticket deflection rate (20%), user satisfaction score (4.2/5). Based on these ratings, the skill was iterated on to include additional actions like 'Generate FAQ snippets for [TOPIC]' and 'Rate the skill's effectiveness using [CRITERIA]'.
The final output of the skill included a summary of the test results, the skill's actions, and the skill's rating criteria. The summary stated: 'The Customer Support Automation skill successfully automated routine tasks, resulting in a 15% improvement in response time. Additional actions were included to further enhance the skill's effectiveness.'AI assistant built for thoughtful, nuanced conversation
Get more done every day with Microsoft Teams – powered by AI
Automate security compliance and monitor real-time security posture seamlessly.
Automate your spreadsheet tasks with AI power
Agentic AI Workflow platform
Connected workspace for docs, wikis, and projects
Take a free 3-minute scan and get personalized AI skill recommendations.
Take free scan