[model-gateway][tracing]: implement request tracing using OpenTelemetry with trace context propagation (HTTP) (#13897)

2025-12-06 05:59:04 -08:00
parent 6d41791823
commit e12c6b320f
19 changed files with 814 additions and 35 deletions
@@ -438,6 +438,14 @@ python -m sglang_router.launch_router \
  --request-id-headers x-request-id x-trace-id
 ```

+Enable opentelmetry tracing:
+```bash
+python -m sglang_router.launch_router \
+  --worker-urls http://worker1:8000 \
+  --enable-trace \
+  --otlp-traces-endpoint 0.0.0.0:4317
+```
+
 ---

 ## Troubleshooting