chenchenghao/sglang
1
0
Fork 0
Code Issues Pull Requests Actions 12 Packages Projects Releases Wiki Activity
10,359 Commits 1 Branch 0 Tags
604db4471d01ac6cc104e7783c95d96b35ed2495
Commit Graph

10359 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Liangsheng Yin
604db4471d [Core] Clarify memory variable naming in model runner (#20060) 2026-03-06 14:00:46 -08:00
Alison Shao
ac453b253f Add Qwen3.5-397B-A17B nightly test (8-GPU) (#19906) 
Co-authored-by: Alison Shao <alisonshao@mac.lan>
Co-authored-by: Alison Shao <alisonshao@Mac.attlocal.net>
 2026-03-06 13:49:28 -08:00
Liangsheng Yin
7a6cf0e9ba [Core] Extract _calculate_mamba_ratio and _init_pools from init_memory_pool (#20058) 2026-03-06 13:37:22 -08:00
Mohammad Miadh Angkad
8cdb7e1fd4 [CI] Add GPT-OSS test for SM120 (#20056) 2026-03-06 11:43:04 -08:00
Mohammad Miadh Angkad
759700c808 Fix SM120 triton_kernels MXFP4 block_k for GPT-OSS (#20040) 2026-03-06 10:53:08 -08:00
R0CKSTAR
de1a0afcbc [MUSA][10/N] Add GGUF support (#18357) 
Signed-off-by: Xiaodong Ye <xiaodong.ye@mthreads.com>
 2026-03-06 10:50:35 -08:00
JohnHerry
e8f2b80340 [diffusion] improve: improve code readability of DenoisingStage (#20003) 2026-03-06 23:23:44 +08:00
xingsy97
54634b9a40 [Kernel] Dispatch exp/sin/cos through dtype_trait (#19798) 2026-03-06 22:57:52 +08:00
Johnsonms
2d266c73ea Migrate renorm kernels from sgl-kernel to FlashInfer JIT (#18854) 2026-03-06 22:53:28 +08:00
Xiaoyu Zhang
6d22c9f369 [Diffusion] Move hf kernels diffusion cuda kernels skills to SGLD (#20001) 
Co-authored-by: Mick <mickjagger19@icloud.com>
 2026-03-06 22:16:06 +08:00
Yuan Luo
f7de9375ac [GDN][Qwen3-Next][Qwen3.5] Fuse fused_gdn_gating and fused_recurrent_gated_delta_rule_update in verify_target (#19775) 2026-03-06 21:42:44 +08:00
Prozac614
e3b581ce6b [diffusion] fix: remove num_frames in wan2_1_t2v_1_3b_lora_1gpu test (#20009) 
Co-authored-by: daiweitao <dwti614707404@163.com>
 2026-03-06 21:36:43 +08:00
Kangyan-Zhou
25e678d933 [diffusion] endpoint: add /server_info and /model_info endpoints for gateway discovery (#20020) 
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
 2026-03-06 21:36:13 +08:00
Thomas Wang
550506894a [AMD] Upgrade aiter version (#19936) 
Co-authored-by: HaiShaw <hixiao@gmail.com>
 2026-03-06 02:31:04 -08:00
inkcherry
84aaa69795 [AMD] Use bfloat16 for correction_bias in AITER FP8 path to avoid runtime dtype conversion for dsv3 (#19843) 2026-03-06 00:57:12 -08:00
Clint
27053aa5ed Fix MLA decode path returning unwritten (padded) rows (#19902) 2026-03-06 00:54:29 -08:00
xdtbynd
0252ca8255 [Bugfix] Fix the bug blocking the startup of Llama-3.2-11b-Vision-Instruct (#19638) 
Co-authored-by: sglang-npu-bot <sglangnpu@163.com>
 2026-03-06 16:21:50 +08:00
YC Tseng
23eb24ddfe [AMD] Update/fix AMD CI workflow dispatch mechanism (#20014) 
Co-authored-by: bingxche <Bingxu.Chen@amd.com>
 2026-03-06 15:27:44 +08:00
Zheng Wengang
da27d9bff6 [Bug-Fix][EPD]: skip log waiting-image-req for zmq_to_tokenzer/mooncake (#19555) 2026-03-06 14:39:22 +08:00
Baizhou Zhang
04e364d538 [V32] Enhance deepseek v32 related tests (#19985) 2026-03-05 20:12:49 -08:00
Mook
be9a9e4819 refactor(multimodal/test): centralize model names and shared utilities in test_utils (#19354) 
Co-authored-by: Ratish P <114130421+Ratish1@users.noreply.github.com>
 2026-03-05 20:09:42 -08:00
Baizhou Zhang
51e5dc845a Revert "[Kernel Slimming] Migrate NVFP4 kernels to JIT" (#20005) 2026-03-05 19:40:00 -08:00
sushil Dubey
6e5a2de354 [diffusion] fix: fix reading multiple prompts from prompt file (#19075) 
Signed-off-by: Sushil Dubey <sushil.dubey@intel.com>
 2026-03-06 11:23:31 +08:00
Simo Lin
9502369488 fix(grpc): add server-side keepalive options to prevent GOAWAY (#19986) 
Signed-off-by: Simo Lin <linsimo.mark@gmail.com>
 2026-03-05 18:56:35 -08:00
liupeng374
5471e4a492 [NPU][Feature] eliminate dsv3 redundant rotary embed calculation (#19842) 2026-03-06 09:02:14 +08:00
chenxu214
b912d7ae19 [OPT]Skip the first delayer to maximize the BS of the decoding. (#19836) 2026-03-06 08:53:19 +08:00
shadowxz109
261be85ecc Support mrope_position_delta cache 2026-03-06 08:50:53 +08:00
Xinyuan Tong
9ebffef1ef [FIX] NSA backend page_table overflow in speculative decoding target_verify (#19016) 2026-03-05 16:04:58 -08:00
Ajay Anubolu
13af7cbb02 fix: use consistent time denominator for throughput metrics in bench_one_batch_server (#19223) 2026-03-05 15:58:17 -08:00
Chang Su
dd2bbe6d62 fix(grpc): use context.abort() with proper status codes instead of in-band errors (#19972) 
Signed-off-by: Chang Su <chang.s.su@oracle.com>
 2026-03-05 14:53:18 -08:00
Qiaolin Yu
46dced64ea Adjust padding size to improve triton_kernels moe performance (#19174) 2026-03-05 14:50:40 -08:00
kpham-sgl
346a4131cf [Spec] Refactor NaN/OOB checks to async maybe_detect_* with env-var control (#19899) 
Co-authored-by: hnyls2002 <lsyincs@gmail.com>
 2026-03-05 13:51:05 -08:00
Alison Shao
1c1712d8e5 [CI] Skip flashinfer-cubin reinstall when version matches (#19470) 
Co-authored-by: Alison Shao <alisonshao@MacBook-Pro-D2W773R9CD.local>
Co-authored-by: Alison Shao <alisonshao@Mac.attlocal.net>
Co-authored-by: Alison Shao <alisonshao@mac.lan>
 2026-03-05 13:30:44 -08:00
Xinyu Zhang
b3cfad0a80 Add Ray actor support for scheduler process management (DP=1) (#17684) 
Co-authored-by: Cursor <cursoragent@cursor.com>
 2026-03-05 13:21:23 -08:00
Minglei Zhu
07e7603c0c Update sgl-attn to include SWA decode optimizations (#19655) 2026-03-05 12:45:25 -08:00
sglang-bot
ebb66cc1de [misc] Priority scheduling metrics cleanup (#19927) 
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
 2026-03-05 12:42:42 -08:00
danielafrimi
ff6048fb9c rename nemotron reasoning parser (#19865) 
Signed-off-by: dafrimi <dafrimi@nvidia.com>
 2026-03-05 11:27:07 -08:00
Jonathan Lee
e58391dd7d Add --json-log flag to enable structured JSON logging (#19968) 
Co-authored-by: github_username <github_email>
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
 2026-03-05 11:24:12 -08:00
Mohammad Miadh Angkad
41fd53fe37 Fix profile_activities parameter name in bench_one_batch_server_internal.py (#19954) 2026-03-05 10:34:06 -08:00
Mick
d605d811fb update CODEOWNERS (#19969) 2026-03-05 10:19:05 -08:00
Michael
203cd8eb02 [AMD] [Z-Image-Turbo Day 0] Add Z-Image-Turbo nightly test for AMD GPUs (#19733) 2026-03-05 08:36:17 -08:00
akhilg-nv
73d272bddb Revised fix for HybridAttnBackend forward for linear attn (#19369) 2026-03-06 00:05:35 +08:00
YC Tseng
b5edab57f2 [AMD] CI - Add MI35x nightly/PR tests for kv-cache-fp8 and allreduce-fusion (DeepSeek) (#19834) 
Co-authored-by: bingxche <Bingxu.Chen@amd.com>
 2026-03-05 07:09:57 -08:00
Zheng Wengang
0de0d74195 [EPD][Feat]support adaptive forward (#18118) 2026-03-05 21:12:30 +08:00
StonyPort
806d41ab65 [quant] fix fp32 downcasting (#19844) 
Co-authored-by: qiuxuan.lzw <qiuxuan.lzw@alibaba-inc.com>
 2026-03-05 17:54:59 +08:00
Rain Jiang
472eef4071 fa4 cleanup (#19727) 2026-03-05 17:54:25 +08:00
Chi McIsaac
c36de62bfc [diffusion] fix images/edit with 2 images (#17520) 
Signed-off-by: Chi McIsaac <chixie.mcisaac@gmail.com>
Co-authored-by: Mick <mickjagger19@icloud.com>
 2026-03-05 16:56:39 +08:00
xingsy97
dbc896f204 [Test] Enhance JIT kvcache store kernel test coverage (#19630) 2026-03-05 16:17:15 +08:00
Tiwei Bie
727face6c2 [DLLM] Add initial radix cache support (#18724) 2026-03-04 23:24:09 -08:00
Kalyan Kumar
c1df359b44 Add XPU profiler activity support in benchmark code (#12981) 
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
 2026-03-04 23:22:56 -08:00