KitScout

Categories › Cloud & DevOps › Monitoring, logs & incidents

gke-ai-troubleshooting-tpu-vbar-oom

SkillInstall · skills CLI

Diagnoses and prevents vbar_control_agent segfaults, out-of-memory (OOM) errors, and TPU device initialization failures on TPU v6e nodes in GKE caused by race conditions during TPU device resets or high-frequency metrics polling. Use when troubleshooting vbar_control_agent crashes, memory cgroup OOMs in serial console logs, tpu-device-plugin metrics checksum corruption errors, or custom TPU metrics collection conflicts on GKE TPU v6e nodes. Don't use for general non-TPU container OOM troubleshoo

Install

KitScout test notes

Not tested by KitScout yet. When our harness runs it, pros, cons and the tasks we tried appear here, with the date and evidence.

Similar tools

  • observability-and-instrumentation 117,009 ★
    Instruments code so production behavior is visible and diagnosable. Use when adding logging, metrics, tracing,
  • honeycomb-tracing 113,555 ★
    Trace Paperclip runs, requests, and full CI suites in Honeycomb. Use to find traces, diagnose latency, design
  • azure-monitor-opentelemetry-ts 49,642 ★
    Auto-instrument Node.js applications with distributed tracing, metrics, and logs.
  • devops-troubleshooter 49,642 ★
    Expert DevOps troubleshooter specializing in rapid incident response, advanced debugging, and modern observabi
  • distributed-tracing 49,642 ★
    Implement distributed tracing with Jaeger and Tempo for request flow visibility across microservices.