Files
sglang/python
leavelet 0da83747cf CUDA graph: opt-in per-buffer + per-shape decode CG memory logging
Attribute decode CUDA-graph GPU memory at capture time, gated by
SGLANG_LOG_CG_BUFFERS=1 (off by default, startup-only, rank0):
  1. Per-runner static input/output buffer table (name/shape/dtype/MB)
     across the 3 EAGLE families (target-verify, draft, draft-extend),
     flagging buffers that share_buffers() aliased onto an earlier family.
  2. Per-shape graph-pool growth deltas in the capture loop + a per-family
     TOTAL, isolating the shared activation pool from per-shape outputs.
Also fix --enable-profile-cuda-graph dumping all families to one
overwritten cuda_graph_runner_memory_usage.pickle: now writes a unique
cuda_graph_mem_<family>.pickle per runner.

Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
2026-06-24 16:28:15 +00:00
..
2026-06-10 05:54:43 +08:00