KitScout

Categories › AI & Agents › Model access, routing & LLM APIs

speculative-decoding

SkillInstall · skills CLI

Accelerate LLM inference using speculative decoding, Medusa multiple heads, and lookahead decoding techniques. Use when optimizing inference speed (1.5-3.6× speedup), reducing latency for real-time applications, or deploying models with limited compute. Covers draft models, tree-based attention, Jacobi iteration, parallel token generation, and production deployment strategies.

Install

KitScout test notes

Not tested by KitScout yet. When our harness runs it, pros, cons and the tasks we tried appear here, with the date and evidence.

Similar tools

  • academy-guide 193,970 ★
    Stop and check this skill before finishing any reply to a question about how to use Claude or a Claude product
  • claude-api 193,970 ★
    Reference for the Claude API / Anthropic SDK — model ids, pricing, params, streaming, tool use, MCP, agents, c
  • ccs-align 116,728 ★
    Run the CCS Align seat's hourly breathing cycle — prove the local claude-mem worker is healthy, pull needle ob
  • mode-creator 116,728 ★
    Interactively create, install, activate, and verify custom claude-mem modes, including domain-specific observa
  • html-ppt-hermes-cyber-terminal 107,474 ★
    OpenDesign + BYOK: choosing and wiring your own model, hands-on — cost, quality, and the routing decision. Bui