langsmith-cli
🥈SilverLangSmith CLI is a lightweight, context-efficient command-line interface for LangSmith. It replaces heavy MCP servers with on-demand skills, enabling operations teams to automate workflows and integrate with Claude agents. It connects to LangSmith's ecosystem, streamlining operations and reducing infrastructure costs.
800Updated 3mo ago
Intermediate30min to implementautomation
Saves ~90 min per use
Quick InstallView Source
git clone https://github.com/gigaverse-app/langsmith-cli.gitWorks with:
Claude
Overview
About This Skill
LangSmith CLI is a modern command-line interface designed for operations teams and AI agents to automate LangSmith workflows. With sub-100ms startup times and lazy-loaded imports, it reduces context usage by 96% compared to traditional approaches, making it ideal for agent-based integrations. The tool provides complete coverage of LangSmith resources including projects, runs, datasets, examples, and prompts, with powerful features like live dashboards, regex filtering, stratified sampling, and real-time monitoring. Built for both human operators and AI agents, it offers rich formatted output for humans and strict JSON mode for agents, enabling efficient debugging, analytics, and bulk operations without the overhead of heavy MCP servers.
How to Use
Install via curl, uv, or pip (requires Python 3.12+). Authenticate with `langsmith-cli auth login`. Add to Claude Code with `/plugin marketplace add gigaverse-app/langsmith-cli`. Use commands like `runs list`, `runs watch`, `runs analyze`, or `datasets upload` to manage your LangSmith resources.
Use Cases
Monitor and debug production LLM runs in real-time with live dashboards
Automate filtering and analysis of failed runs across projects with regex patterns
Bulk upload and manage datasets for model evaluation
Sample and analyze run aggregates by tags and metadata
Setup & Installation
Quick Install
No install command available. Check the GitHub repository for manual installation instructions.
Alternative Install (Git Clone)
git clone https://github.com/gigaverse-app/langsmith-cliRequirements
- Claude Code or compatible AI agent
- Works with: Claude
Quick Start Guide
1
Install the Skill
Copy the install command above and run it in your terminal.
2
Open Your AI Agent
Launch Claude Code, Cursor, or your preferred AI coding agent.
3
Try It Out
Use the prompt template or examples below to test the skill.
4
Customize
Adapt the skill to your specific use case and workflow.
Usage Examples
Prompt Template
Use the LangSmith CLI to automate the following workflow: [DESCRIBE WORKFLOW]. The workflow should include [NUMBER] steps and connect to [SPECIFIC TOOLS]. Ensure the automation reduces manual effort by [PERCENTAGE] and integrates with [EXISTING SYSTEMS].
Example Output
The LangSmith CLI successfully automated the customer onboarding workflow, which previously required 10 manual steps. The new automation connects to Salesforce, HubSpot, and our internal CRM, reducing onboarding time by 75%. The workflow now includes: 1) Extracting customer data from Salesforce, 2) Creating a HubSpot ticket for the onboarding team, 3) Sending a welcome email via our CRM, and 4) Scheduling the initial onboarding call. The automation has significantly improved efficiency and reduced errors in the onboarding process.
Apply to these tools
Browse all toolsClaude
AI assistant built for thoughtful, nuanced conversation
Microsoft Teams
Get more done every day with Microsoft Teams – powered by AI
Drata
Automate security compliance and monitor real-time security posture seamlessly.
GPT for work
Automate your spreadsheet tasks with AI power
Respell
Agentic AI Workflow platform
Notion
Connected workspace for docs, wikis, and projects
Compatible MCP servers
Browse all MCP servers
Find the right skills for your stack
Take a free 3-minute scan and get personalized AI skill recommendations.
Take free scan