llm-evaluation
๐ฏSkillfrom wshobson/agents
|A production-ready plugin system with 112 AI agents, 146 skills, 16 workflow orchestrators, and 79 development tools organized into 73 focused plugins for Claude Code.
Overview
A Claude Code skill from the wshobson/agents plugin marketplace that provides specialized knowledge for evaluating and benchmarking large language models. It is part of a comprehensive system of 112 specialized AI agents and 146 agent skills organized into 73 focused plugins, optimized for minimal token usage.
Key Features
- AI/ML Domain Expertise - Backed by a specialized agent with deep knowledge in LLM evaluation methodologies, benchmarking, and quality assessment
- Granular Plugin Design - Loads only LLM evaluation-related components, keeping context focused on model assessment
- Progressive Disclosure - Evaluation knowledge activates only when needed, maintaining efficient context management
- Composable with AI Skills - Designed to work alongside other data/AI and machine learning plugins for comprehensive ML workflows
- Production-Ready Evaluation Patterns - Provides tested patterns for prompt evaluation, model comparison, and quality metrics
Who is this for?
This skill is designed for AI/ML engineers and researchers who need structured guidance on evaluating large language model performance and quality. It is particularly useful for teams selecting between models, building evaluation harnesses, or establishing quality benchmarks for their LLM-powered applications.
Same repository
wshobson/agents(268 items)
Installation
npx vibeindex add wshobson/agents --skill llm-evaluationnpx skills add wshobson/agents --skill llm-evaluation~/.claude/skills/llm-evaluation/SKILL.mdSKILL.md
More from this repository10
Comprehensive Claude Code plugin collection with 112 AI agents, 146 skills, and 73 focused plugins covering full-stack development, security, infrastructure, and multi-agent orchestration.
A specialized agent skill for advanced TypeScript type system patterns, part of the wshobson/agents plugin marketplace with 146 skills across 73 plugins for Claude Code.
Agent skill for Node.js backend development patterns including API design, architecture, and microservices, part of the wshobson/agents collection with 73 focused plugins and 146 skills for Claude Code.
Claude Code plugin for AI-powered framework migration workflows, coordinating specialized agents to plan and execute transitions between technology stacks as part of the wshobson/agents marketplace.
A Claude Code plugin for payment system integration covering Stripe, PayPal, and billing platforms with checkout flows, subscription management, and webhook handling in the wshobson/agents ecosystem.
A Claude Code plugin bundling core development tools and agents for everyday tasks like debugging and code generation, part of the wshobson/agents marketplace with 73 focused plugins.
Claude Code plugin for observability and monitoring including logging, metrics, distributed tracing, and alerting, part of the wshobson/agents marketplace with 73 focused plugins.
A Claude Code plugin providing specialized AI agents for deployment strategy planning and execution, covering blue-green deployments, canary releases, rolling updates, and zero-downtime patterns.
A Claude Code plugin for rapid API project scaffolding, part of the wshobson/agents marketplace with 73 focused plugins, 112 specialized agents, and 146 agent skills.
Claude Code plugin for JVM language development including Java, Kotlin, and Scala with specialized agents for idiomatic patterns, build tools, and runtime optimization in the wshobson/agents marketplace.