sglang

batch_invariant_ops

[Auto Sync] Update batch_invariant_ops.py (20260221) (#19098 )

2026-02-20 18:27:31 -08:00

batch_overlap

[AMD] support two batch overlapping for mori ep (#17953 )

2026-02-20 08:45:55 -08:00

checkpoint_engine

update pre-commit config (#18860 )

2026-02-16 00:18:31 +08:00

compilation

Fix PCG MoE Error (#17739 )

2026-02-19 16:48:06 +08:00

configs

[Model] Add Qwen3ForRewardModel and fix Qwen3ForSequenceClassification (#17992 )

2026-02-16 19:44:41 +08:00

connector

[Lint] Add python/sglang to ruff F401 checks and remove unused imports in files (#11685 )

2025-10-17 16:49:46 -07:00

constrained

Fix grammar sync across TP ranks (#17100 )

2026-01-15 18:38:01 -08:00

debug_utils

Fix lint on main (#19054 )

2026-02-20 15:45:24 +08:00

disaggregation

[AMD] Replace msgpack with msgspec in MORI-IO (#19007 )

2026-02-19 23:04:15 -08:00

distributed

[Fix] Run FlashInfer autotune on non-default stream for NCCL 2.29+ compatibility (#18987 )

2026-02-20 23:21:38 +08:00

dllm

Feature/sdar support (#19044 )

2026-02-19 21:58:15 -08:00

elastic_ep

[2/N] Added the core structure of elastic EP and the eplb algorithm with faulty rank (#10606 )

2025-10-22 01:13:31 -07:00

entrypoints

[FEAT] Add Anthropic compatible API endpoint (#18630 )

2026-02-21 19:37:38 +08:00

eplb

Re-introduce the unit test of test_mooncake_ep_small (#16019 )

2026-01-12 17:01:24 +08:00

function_call

update pre-commit config (#18860 )

2026-02-16 00:18:31 +08:00

grpc

[gRPC] Fix scheduler startup broken by context parallel refactor (#18933 )

2026-02-17 08:52:11 -08:00

hardware_backend/npu

update pre-commit config (#18860 )

2026-02-16 00:18:31 +08:00

layers

[Quantization] Support config.json quantization_config format, fix exclude_modules matching, and fix KV cache scale loading for Nemotron (#18546 )

2026-02-21 16:14:29 +08:00

lora

[Fix] Add lora tied lm head support (for Qwen2.5, Gemma, etc model need) (#18634 )

2026-02-19 00:34:51 +08:00

managers

Fix lint on main (#19054 )

2026-02-20 15:45:24 +08:00

mem_cache

Fix long prompt KV allocation by falling back to torch native APIs when exceeding Triton tensor limit (#18250 )

2026-02-19 19:15:05 -08:00

metrics

cleanup prefill metrics logging to fix dp-attn metrics (#18778 )

2026-02-17 14:35:35 -08:00

model_executor

Refactor graph input buffers (#18991 )

2026-02-20 18:09:31 -08:00

model_loader

[Quantization] Support config.json quantization_config format, fix exclude_modules matching, and fix KV cache scale loading for Nemotron (#18546 )

2026-02-21 16:14:29 +08:00

models

[Quantization] Support config.json quantization_config format, fix exclude_modules matching, and fix KV cache scale loading for Nemotron (#18546 )

2026-02-21 16:14:29 +08:00

multimodal

Fix GLM-4V processor registration when glm_ocr is unavailable (#18885 )

2026-02-16 16:02:31 +08:00

multiplex

[Bugfix] fix the display error (inconsistent context) (#17699 )

2026-01-31 23:35:11 -08:00

parser

update pre-commit config (#18860 )

2026-02-16 00:18:31 +08:00

sampling

Revert "feat: reduce constrained-decoding overhead in TP" (#16845 )

2026-01-10 11:39:38 +08:00

speculative

Refactor graph input buffers (#18991 )

2026-02-20 18:09:31 -08:00

tokenizer

[Piecewise Cuda Graph] rename, refactor and add more logging (#13675 )

2025-11-21 13:28:38 +08:00

tracing

SGLang Tracing: Improve root span attributes (#17008 )

2026-01-30 16:02:05 +08:00

utils

Fix libnuma.so does not exsit (#15355 )

2026-02-16 00:37:50 +08:00

weight_sync

[RL] Allow passing tensors of different dtypes for FlattenedTensorBucket (#13413 )

2025-11-19 17:24:48 +08:00

constants.py

Support releasing CUDA graph memory when paused (#7873 )

2025-10-28 14:40:50 +08:00

environ.py

feat: add cuda core dump CI warpper (#18909 )

2026-02-17 14:49:26 -08:00

server_args_config_parser.py

[ConfigArgumentMerger] Improve ConfigArgumentMerger compatibility with external callers (#17051 )

2026-01-16 15:32:42 +08:00

server_args.py

Fix bug in symm mem pre-allocation default (#19082 )

2026-02-21 11:51:28 +08:00