[Auto Sync] Update environ.py, fp8.py (20260121) (#17486)

Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com> Co-authored-by: Binyao Jiang <byjiang1996@gmail.com>
2026-01-21 12:04:09 -08:00
parent cda43ffa4d
commit 1fdf5cac39
2 changed files with 30 additions and 5 deletions
@@ -448,6 +448,8 @@ class Envs:
    # TokenizerManager
    SGLANG_REQUEST_STATE_WAIT_TIMEOUT = EnvInt(4)

+    # Aiter
+    SGLANG_USE_AITER_FP8_PER_TOKEN = EnvBool(False)
    # fmt: on