agent-platform-eval-flywheel

Measures and improves the quality of AI models and agents on Google Cloud using the Eval Quality Flywheel methodology. Use when generating synthetic user scenarios, evaluating an agent or model, building an eval dataset, picking or writing evaluation metrics, analyzing failures, comparing results before and after a fix, or when guidance is needed on Agent Platform eval methodology — including dataset schema, LLM-as-judge scoring, and common failure causes. For fine-tuning, use agent-platform-tun

Install

KitScout test notes

Not tested by KitScout yet. When our harness runs it, pros, cons and the tasks we tried appear here, with the date and evidence.

Similar tools

• ask-matt 323,485 ★
  Ask which skill or flow fits your situation. A router over the skills in this repo.
• chief-of-staff 323,485 ★
  Pursue a long-running goal in a single session by co-ordinating subagents.
• claude-handoff 323,485 ★
  Hand the current conversation off to a fresh background agent that picks up the work immediately.
• grill-me 323,485 ★
  A relentless interview to sharpen a plan or design.
• grilling 323,485 ★
  Grill the user relentlessly about a plan, decision, or idea. Use when the user wants to stress-test their thin