hermes-skilleval
by Raidriar7170
Verification-gated skill routing and self-improvement harness for agent skills
What It Does
Implements a verification-gated skill routing and self-improvement harness for Hermes-style agent skills. Routes candidate skills through reranking and verification gates before execution, then collects outcomes to drive iterative skill refinement. Focuses on gating risky or low-quality skill calls and producing measurable signal for skill-level improvement. Includes Evaluation-Driven Development (EDDOps) practices to drive continuous improvement.
The Value Proposition
When to Use
Researchers and engineering teams validating and iterating Hermes-style agent skills who need gated execution and continuous evaluation of skill reliability. Consider aligning with the Model Context Protocol (MCP) Pattern for consistent context handling during evaluation and routing.
Applications
- Gate candidate skills before execution to prevent low-quality or risky behavior
- Continuously evaluate and rerank skills to build a reputation-like track record
- Collect structured outcomes for automated skill self-improvement and CI release-gates