chenchenghao/sglang
1
0
Fork 0
Code Issues Pull Requests Actions 12 Packages Projects Releases Wiki Activity
11,101 Commits 1 Branch 0 Tags
3a4372721609c185f0a5eeea3447cdedebac8718
Commit Graph
7390 Commits
Author SHA1 Message Date
Chang Su dd2bbe6d62 fix(grpc): use context.abort() with proper status codes instead of in-band errors (#19972) 
Signed-off-by: Chang Su <chang.s.su@oracle.com>
 2026-03-05 14:53:18 -08:00
Qiaolin Yu 46dced64ea Adjust padding size to improve triton_kernels moe performance (#19174) 2026-03-05 14:50:40 -08:00
kpham-sglandhnyls2002 346a4131cf [Spec] Refactor NaN/OOB checks to async maybe_detect_* with env-var control (#19899) 
Co-authored-by: hnyls2002 <lsyincs@gmail.com>
 2026-03-05 13:51:05 -08:00
Xinyu ZhangandCursor b3cfad0a80 Add Ray actor support for scheduler process management (DP=1) (#17684) 
Co-authored-by: Cursor <cursoragent@cursor.com>
 2026-03-05 13:21:23 -08:00
sglang-botandClaude Opus 4.6 ebb66cc1de [misc] Priority scheduling metrics cleanup (#19927) 
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
 2026-03-05 12:42:42 -08:00
danielafrimi ff6048fb9c rename nemotron reasoning parser (#19865) 
Signed-off-by: dafrimi <dafrimi@nvidia.com>
 2026-03-05 11:27:07 -08:00
Mohammad Miadh Angkad 41fd53fe37 Fix profile_activities parameter name in bench_one_batch_server_internal.py (#19954) 2026-03-05 10:34:06 -08:00
akhilg-nv 73d272bddb Revised fix for HybridAttnBackend forward for linear attn (#19369) 2026-03-06 00:05:35 +08:00
Zheng Wengang 0de0d74195 [EPD][Feat]support adaptive forward (#18118) 2026-03-05 21:12:30 +08:00
StonyPortandqiuxuan.lzw 806d41ab65 [quant] fix fp32 downcasting (#19844) 
Co-authored-by: qiuxuan.lzw <qiuxuan.lzw@alibaba-inc.com>
 2026-03-05 17:54:59 +08:00
Rain Jiang 472eef4071 fa4 cleanup (#19727) 2026-03-05 17:54:25 +08:00
Chi McIsaacandMick c36de62bfc [diffusion] fix images/edit with 2 images (#17520) 
Signed-off-by: Chi McIsaac <chixie.mcisaac@gmail.com>
Co-authored-by: Mick <mickjagger19@icloud.com>
 2026-03-05 16:56:39 +08:00
xingsy97 dbc896f204 [Test] Enhance JIT kvcache store kernel test coverage (#19630) 2026-03-05 16:17:15 +08:00
Tiwei Bie 727face6c2 [DLLM] Add initial radix cache support (#18724) 2026-03-04 23:24:09 -08:00
Kalyan Kumarandgemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com> c1df359b44 Add XPU profiler activity support in benchmark code (#12981) 
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
 2026-03-04 23:22:56 -08:00
Mohammad Miadh Angkad 2bdd89a6cd [Kernel Slimming] Migrate NVFP4 kernels to JIT (#19437) 2026-03-05 15:22:28 +08:00
Yilong Zhao 1bbfed0539 [misc] add env for http keep alive timeout (#19847) 2026-03-04 22:00:51 -08:00
Chenxi LiandConnorLi96 86c5617787 [BUG]: fix prevent illegal memory access in Mamba SSM tracking during EAGLE speculative verification (#19415) 
Co-authored-by: ConnorLi96 <ConnorLi96@users.noreply.github.com>
 2026-03-04 21:13:21 -08:00
Baizhou Zhang 10c65df48a [Bug] Fix lora tp bug on H200 (#19769) 2026-03-04 20:11:02 -08:00
Xinyi Song 0e6a64712a [bugfix] Fix PPMissingLayer AttributeError when Using PP (#19804) 2026-03-04 19:48:15 -08:00
Kangyan-Zhouand 198381d9ce Add SSL/TLS support for HTTP and gRPC servers (#18973) 
Co-authored-by: guys@spotify.com
 2026-03-04 19:27:16 -08:00
Junhao LiuandMick 9c11a7ae40 [diffusion] fix: fix the frame interpolation testcase in CI regarding number of frames (#19659) 
Co-authored-by: Mick <mickjagger19@icloud.com>
 2026-03-05 11:21:53 +08:00
R0CKSTARandQingfu Wen fc53307ce9 [diffusion] hardware: SiluAndMul/RMSNorm/LayerNorm MUSA implementations (custom ops, 12/N) (#18583) 
Signed-off-by: Xiaodong Ye <xiaodong.ye@mthreads.com>
Co-authored-by: Qingfu Wen <qingfu.wen@mthreads.com>
 2026-03-05 11:10:57 +08:00
Xiaoyu ZhangandMick 9795b4cd5b [Diffusion] Open t5 encoder parallel folding for wan2.2 and mova video (#18493) 
Co-authored-by: Mick <mickjagger19@icloud.com>
 2026-03-05 10:18:00 +08:00
Ethan (Yusheng) Su e555a6c171 [feat] Enhance lora_update_weight_from_tensor for RL training (#19314) 2026-03-04 18:10:42 -08:00
Shu WangandBaizhou Zhang 43bdee703e Fix Fp8 MTP layer a2a backend without EP. (#18515) 
Co-authored-by: Baizhou Zhang <sobereddiezhang@gmail.com>
 2026-03-04 16:28:10 -08:00
Liangsheng Yin 33c92732f4 [Triton] Use dynamic loop bound in alloc_extend_kernel (#19898) 2026-03-04 16:15:58 -08:00
rakeshandgemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com> a710b7d791 [Sarvam] Add inference support for Sarvam MoE LLMs (#18938) 
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
 2026-03-04 15:28:00 -08:00
kpham-sgl 376dfb03f7 Fix issue 19717 by making qo_indptr uniform strided instead of packed (#19807) 2026-03-04 15:27:10 -08:00
zhuxinjie-nzandhnyls2002 28c931e1a5 feat: Priority-based scheduling optimization (including default priority, preemption toggle, priority-based metrics, etc.) (#17026) 
Co-authored-by: hnyls2002 <lsyincs@gmail.com>
 2026-03-04 14:52:08 -08:00
hlu1 9457c049e1 [Qwen3.5] Enable MTP spec_v2 and add test for nvidia/Qwen3.5-397B-A17B-NVFP4 (#19391) 2026-03-04 14:01:25 -08:00
Chang Su 0ee9d3c8e9 fix(grpc): send last chunk before completion during streaming (#19895) 2026-03-04 13:21:21 -08:00
Bingxu Chen 329817e262 [AMD] Move get_global_server_args import out of CUDA-only block to fix NameError on AMD (#19866) 2026-03-04 10:23:42 -08:00
Ken J 44208d2adf [vlm][minicpm] support input formats of processor output and embedding (#19614) 2026-03-04 12:11:12 -05:00
Kangyan-ZhouandClaude Opus 4.6 c03deb8175 Fix disagg PD bootstrap and KV transfer metrics (#19009) 
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
 2026-03-04 09:08:10 -08:00
strgrb 738ebfd330 KDA: fuse qkv conv and support stride for fused_sigmoid_gating_delta_rule_update_kernel (#19506) 2026-03-04 22:45:53 +08:00
YeChang GuoGuoYechangroot
 		6910c1b281 [Feature][NPU]: add runtime support for GPTQ-quantized MoE models (#16364) 
Co-authored-by: GuoYechang <52730608+GuoYechang@users.noreply.github.com>
Co-authored-by: root <root@localhost.localdomain>
 2026-03-04 16:02:19 +03:00
Shangming Cai c2b66d320d [HiCache] Add an env var to control transfer engine reuse (#19867) 2026-03-04 20:36:32 +08:00
chenxu214 88cfa6c11d [NPU]Releasing redundant memory of w13_weight and nz when the ascend_fuseep feature is enabled (#19813) 2026-03-04 19:26:29 +08:00
sky 17119a697d Optimization: Reduce the number of D2H operations (#19424) 
Signed-off-by: wangfakang <fakangwang@gmail.com>
 2026-03-04 16:32:42 +08:00
Mohammad Miadh Angkad 09fa012ba7 Fix /health regression from early prebound socket listen (#19805) 2026-03-03 23:00:46 -08:00
Yuhao Yang 115f879958 Helios: Real Real-Time Long Video Generation Model (#19782) 2026-03-04 14:58:04 +08:00
qwemei ranyhyang201
 		562c3ff2d0 [Feature] implement the standard multi-layer MTP for step3p5 (#18564) 
Co-authored-by: mei ran <meiran0528@gmail.com>
Co-authored-by: yhyang201 <yhyang201@gmail.com>
 2026-03-03 22:48:53 -08:00
DefTruth e9b5706545 [diffusion] feat: support torch compile for diffusers backend (#19673) 2026-03-04 14:08:45 +08:00
Michael c6850ac30c [AMD] Fix Qwen3-Coder-Next: Add missing k_scale/v_scale args to extend_attention_fwd in aiter_backend (#19736) 2026-03-03 22:01:08 -08:00
Jue Wang 5972f97f11 Remove naive rotary forward overriding. (#19263) 2026-03-03 21:50:40 -08:00
ybyang ac1f07487a Fix triton alloc extend kernel (#19780) 2026-03-03 21:01:16 -08:00
Bi XueLiangsheng Yinhnyls2002
 		73bf2c5bdc [sgl]add pin_mem to remove cpu->gpu copy sync point (#19795) 
Co-authored-by: Liangsheng Yin <hnyls2002@gmail.com>
Co-authored-by: hnyls2002 <lsyincs@gmail.com>
 2026-03-03 21:00:51 -08:00
sglang-bot b7f7df7ee6 [NSA] Fix line-too-long lint in can_nsa_prefill_cp_round_robin_split (#19829) 2026-03-03 20:34:22 -08:00
Yuhao Yang ca44aa25af Fix dp_attention crash when dp_size < tp_size in warmup dummy run (#19760) 2026-03-03 19:43:13 -08:00