Handles LLM-as-judge evaluation workflows on Arize including creating/updating evaluators, running evaluations on spans or experiments, managing tasks, trigger-run operations, column mapping, and continuous monitoring. Use when the user mentions create evaluator, LLM judge, hallucination, faithfulness, correctness, relevance, run eval, score spans, score experiment, trigger-run, column mapping, continuous monitoring, or improve evaluator prompt.
Install
KitScout test notes
Not tested by KitScout yet. When our harness runs it, pros, cons and the tasks we tried appear here, with the date and evidence.
Similar tools
academy-guide193,970 ★ Stop and check this skill before finishing any reply to a question about how to use Claude or a Claude product
claude-api193,970 ★ Reference for the Claude API / Anthropic SDK — model ids, pricing, params, streaming, tool use, MCP, agents, c
ccs-align116,728 ★ Run the CCS Align seat's hourly breathing cycle — prove the local claude-mem worker is healthy, pull needle ob
mode-creator116,728 ★ Interactively create, install, activate, and verify custom claude-mem modes, including domain-specific observa
html-ppt-hermes-cyber-terminal107,474 ★ OpenDesign + BYOK: choosing and wiring your own model, hands-on — cost, quality, and the routing decision. Bui