evaluator

from philoserf/claude-code-setup

Comprehensive Claude Code configuration with agents, skills, hooks, and automation

9 stars0 forksUpdated Jan 23, 2026
npx skills add https://github.com/philoserf/claude-code-setup --skill evaluator

SKILL.md

Reference Files

Detailed evaluation guidance:


Focus Areas

  • YAML Frontmatter Validation - Required fields, syntax correctness, field values
  • Markdown Structure - Organization, readability, formatting consistency
  • Tool Permissions - Appropriateness of allowed-tools, security implications
  • Description Quality - Clarity, completeness, trigger phrase coverage
  • File Organization - Naming conventions, directory placement, reference structure
  • Progressive Disclosure - Context economy, reference file usage
  • Integration Patterns - Compatibility with existing customizations, settings.json health

Approach

When evaluating a Claude Code customization, this skill follows a systematic process:

  1. Read and parse the target file(s) to extract structure and content
  2. Validate YAML frontmatter for required fields and correct syntax
  3. Apply type-specific validation criteria (agent/skill/command/hook/output-style)
  4. Assess context economy and progressive disclosure usage
  5. Verify tool permissions match actual tool usage
  6. Check integration with settings.json and other customizations
  7. Generate structured report with specific findings and recommendations
  8. Prioritize issues by severity (correctness > clarity > effectiveness)

Detailed criteria, process steps, and examples are available in the reference files above.

Tools Used

This skill uses read-only tools for analysis:

  • Read - Examine file contents
  • Grep - Search for patterns across files
  • Glob - Find files by pattern
  • Bash - Execute read-only commands (ls, cat, head, tail, git log, etc.)

No files are modified during evaluation. Reports can be saved to ~/.claude/logs/evaluations/ by the invoking command or skill.

Repository Stats

Stars9
Forks0
LicenseMIT License