bugfix: The default value of the environment virable is None, so that… (#18309)
Co-authored-by: ronnie_zheng <zl19940307@163.com> Co-authored-by: sglang-npu-bot <sglangnpu@163.com>
This commit is contained in:
@@ -253,7 +253,7 @@ class Envs:
|
||||
SGLANG_DYNAMIC_CHUNKING_SMOOTH_FACTOR = EnvFloat(0.75)
|
||||
SGLANG_SCHEDULER_SKIP_ALL_GATHER = EnvBool(False)
|
||||
SGLANG_SCHEDULER_DECREASE_PREFILL_IDLE = EnvBool(False)
|
||||
SGLANG_PREFILL_DELAYER_MAX_DELAY_PASSES = EnvInt(30)
|
||||
SGLANG_PREFILL_DELAYER_MAX_DELAY_PASSES = EnvInt(None)
|
||||
SGLANG_PREFILL_DELAYER_TOKEN_USAGE_LOW_WATERMARK = EnvFloat(None)
|
||||
SGLANG_DATA_PARALLEL_BUDGET_INTERVAL = EnvInt(1)
|
||||
SGLANG_REQ_WAITING_TIMEOUT = EnvFloat(-1) # in seconds
|
||||
|
||||
Reference in New Issue
Block a user