graphsignal-top: a `top` for inference GPUs in the open-source Graphsignal profiler, kernels ranked by time, live, with readable names

Key points

• graphsignal-run vllm serve <model> --port 8000 # one terminal1
• What you get: per-GPU util over time, memory, power, throttling; the engine's running/waiting requests, tok/s and TTFT/TPOT p50/p95; a GPU time split (kernels / graphs / memcpy / sync); and every kernel ranked by time over the last 5 s with a readable name and category, not just the mangled symbol.1
• Tabs for CUDA graph replays, transfers and syncs.1
• Works remotely too: graphsignal-top --host gpu-box against a profiler started with --listen-host, or port-forward over ssh. --once prints a single frame if you just want it in a log.1

Sources (1)

• [1]graphsignal-top: a `top` for inference GPUs in the open-source Graphsignal profiler, kernels ranked by time, live, with readable names
  r/LocalLLaMA (top, daily) · Oct 12, 01:35 PM

  A few weeks ago we posted the open-source Graphsignal profiler here: wrap vllm serve / sglang serve / whatever in graphsignal-run and it serves everything it measures as JSON, mainly so an agent can read it in a loop.

  graphsignal-run vllm serve <model> --port 8000 # one terminal

Extractive summary: sentences quoted from the sources.