chenchenghao/sglang
1
0
Fork 0
Code Issues Pull Requests Actions 12 Packages Projects Releases Wiki Activity
7,565 Commits 1 Branch 0 Tags
a4ffd665c00a2ac9818803737d634a5a656d8113
Commit Graph

1358 Commits

Author SHA1 Message Date
wentx
b7b7524e95 [Tool Call] Fix DeepSeekV32Detector skipping functions with no params in streaming mode (#14573) 2025-12-07 18:32:10 -08:00
Baizhou Zhang
6799847ebf [CI]Unblock and split spec v2+dp test (#14551) 2025-12-07 17:39:25 -08:00
Baizhou Zhang
673c11ba73 [Minor] Temporarily skipping deepep large mtp test (#14586) 2025-12-07 13:59:16 -08:00
b8zhong
3b47973af8 [CI] Tiny speed up VLM CI (#14517) 
Co-authored-by: Brayden Zhong <b8zhong@users.noreply.github.com>
 2025-12-07 13:30:41 -08:00
Hudson Xing
84efe54bc4 Fix FP8 KV Triton type issue and add regression test (#14553) 2025-12-07 10:51:46 -08:00
khalilzhk
948b6acee8 [BugFix] fix prefixcache performance and accuracy on ascend (#13573) 2025-12-08 02:16:20 +08:00
Vladimir Serov
f124539a01 [NPU]LoRA: Adding Torch Native backend (#14132) 2025-12-08 02:16:07 +08:00
Liangsheng Yin
125e17efd5 Add small model test for spec v2 + dp + trtllm_mla (#14576) 2025-12-07 23:55:00 +08:00
Hanming Lu
e592ee6545 [Qwen3-next] remove heuristics and add radix cache kl test (#14520) 2025-12-06 12:11:40 -08:00
Baizhou Zhang
bc388471d2 [1/n] Fix hanging during DeepGemm Warmup (#14493) 2025-12-06 10:44:02 -08:00
Baizhou Zhang
42fcf5438f Revert "tiny remove deprecated endpoint call" (#14533) 2025-12-05 23:48:54 -08:00
blzheng
d257bf87b9 [CPU] add mamba fla kernels for Qwen3-next (#12324) 2025-12-06 14:16:23 +08:00
fzyzcjy
3d1b591aa1 Tiny use trtllm_mha as default when possible (#14291) 2025-12-05 14:26:03 -08:00
Alison Shao
16e8463a90 Add Mistral Large 3 basic test to PR CI (#14460) 2025-12-05 10:38:52 -08:00
b8zhong
ec7b2c16d9 tiny remove deprecated endpoint call (#13607) 2025-12-05 09:54:49 -08:00
Hudson Xing
38daa29466 Add fused FP8 KV cache write kernel for TRTLLM MHA backend (#14093) 
Co-authored-by: Qiaolin Yu <liin1211@outlook.com>
 2025-12-06 00:53:55 +08:00
roikoren755
889b46ea50 [Spec] Mamba2 support in target models (#13434) 2025-12-06 00:50:46 +08:00
Alison Shao
662809874c Add Mistral Large 3 to nightly CI tests (#14459) 2025-12-05 23:16:27 +08:00
Yuxuan Zhang
8fce9e7b2a support GLM-V vision model dp (#14097) 2025-12-05 21:03:54 +08:00
Xinyuan Tong
6d37e70883 ministral3 (#14251) 
Signed-off-by: Xinyuan Tong <xinyuantong.cs@gmail.com>
Co-authored-by: Yueming Yuan <yy28@illinois.edu>
 2025-12-04 14:31:26 -08:00
YAMY
7dfcc78155 [DeepseekV3.2][NSA][Indexer] Fix PAGED top-k transform for NSA indexer chunked execution on H200 (#14325) 2025-12-04 10:25:03 -08:00
Cherry_ming
1808df48fe [NPU]add nightly-test-npu (#14143) 2025-12-05 00:43:35 +08:00
Liangsheng Yin
441420e149 Add mooncake transfer_engine_bench into maunal test (#14429) 
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
 2025-12-04 22:35:00 +08:00
jianan-gu
70d2587324 [CPU] Optimize small oc GEMM for Qwen3-next on CPU (#12446) 
Co-authored-by: Zheng, Beilei <beilei.zheng@intel.com>
 2025-12-04 00:38:47 -08:00
Even Zhou
894c0dc57c [NPU][1/N] NPU basic functions refactor and new modelslim quant type (#13359) 2025-12-04 16:15:31 +08:00
Ma Mingfei
f90b400431 [CPU] add support for mamba causal conv1d for qwen3-next (#12309) 2025-12-04 13:41:42 +08:00
sunxxuns
5bbd83a2c8 ci: Migrate AMD workflows to new MI325 runners; temporarily disabled failed CI's to be added back (#14226) 2025-12-03 11:33:27 -08:00
Lianmin Zheng
46d7b35ec7 Move custom_ops under layers; move _custom_ops.py → custom_all_reduce_ops.py (#14326) 2025-12-03 10:33:37 -08:00
blzheng
974c562a25 [CPU] add fused_qkvzba_split_reshape_cat kernel for Qwen3-next (#12330) 2025-12-03 23:46:08 +08:00
Liangsheng Yin
24903b88ba Tiny adjust CI testcases (#14362) 2025-12-03 21:19:51 +08:00
ZhengdQin
d122e32467 [NPU] bug fix: w_vc need contiguous for NPU batch_matmul_transpose ops (#13980) 2025-12-03 19:35:18 +08:00
Cheng Wan
96cc10834a [CI] update estimated elapsed time of some unittests (#14347) 2025-12-03 01:21:40 -08:00
Yuhao Yao
77512ae0d7 [bugfix] Fix prefill tbo disabled when --deepep-mode=auto (#14333) 
Co-authored-by: Cheng Wan <wan4ch@gmail.com>
 2025-12-03 01:20:33 -08:00
Xuan Liao
c233e9d7a9 [CPU] Support chunk_gated_delta_rule kernel for Qwen3-Next (#12441) 2025-12-03 17:03:48 +08:00
Johnsonms
043f13171f [Performance] Optimize NSA Indexer K/S Buffer Access with Fused Triton Kernels (#13812) 
Co-authored-by: Johnsonms <johnson@together.ai>
 2025-12-02 18:53:06 -08:00
sglang-bot
7ae368efde chore: bump SGLang version to 0.5.6 (#14316) 
Co-authored-by: sglang-bot <sglang-bot@users.noreply.github.com>
 2025-12-02 17:17:13 -08:00
Eva20150932-atlascloud
7c38eca1e4 feat: DeepSeek new v3.2 encoding (#14249) 
Co-authored-by: Xinyuan Tong <xinyuantong.cs@gmail.com>
 2025-12-02 11:41:05 -08:00
Lianmin Zheng
64092c8b55 [Auto Sync] Rename is_hybrid to is_hybrid_swa (#14252) 
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: Hanming Lu <69857889+hanming-lu@users.noreply.github.com>
Co-authored-by: Hanming Lu <hanming@x.ai>
 2025-12-01 23:24:24 -08:00
Yuan Luo
26aebf83d3 [VLM] Support Piecewise CUDA Graph for Qwen3-Omni-MOE (#14222) 
Co-authored-by: luoyuan.luo <luoyuan.luo@antgroup.com>
 2025-12-02 10:12:10 +08:00
Baizhou Zhang
eb5008846a [CI] Fix test_deepep_large.py (#14247) 2025-12-01 15:18:48 -08:00
liupeng374
2e8f54e61e [spec-overlap] bugfix for pd disaggregation and npu (#14088) 
Co-authored-by: Even Zhou <even.y.zhou@outlook.com>
 2025-12-01 22:58:20 +08:00
YAMY
decb48965d [DeepSeekV3.2] Enable pure TP & Partial DP Attention (#13646) 2025-11-30 15:59:23 -08:00
Liangsheng Yin
0a9d64530d Support grammar + spec + reasoning (#14163) 2025-11-30 21:19:57 +08:00
fzyzcjy
36b729c2b8 Implement profiler v2 and fix stage mixture bug (#14148) 2025-11-30 16:59:52 +08:00
Kangyan-Zhou
1d3d8b3418 Fix Minimax M2 loading issue (#13956) 2025-11-29 17:07:19 -05:00
Lianmin Zheng
155a9e7237 Fix condition for streaming output_ids in tokenizer manager (#13759) 
Signed-off-by: Xinyuan Tong <xinyuantong.cs@gmail.com>
Co-authored-by: Chang Su <chang.s.su\n@oracle.com>
Co-authored-by: Xinyuan Tong <115166877+JustinTong0323@users.noreply.github.com>
Co-authored-by: Xinyuan Tong <xinyuantong.cs@gmail.com>
 2025-11-29 13:56:15 -08:00
Shangming Cai
c6d34a0688 Move piecewise cuda graph test to manual dir to fix CI (#14121) 
Signed-off-by: Shangming Cai <csmthu@gmail.com>
 2025-11-29 00:52:01 -08:00
Cheng Wan
0fe74af563 Remove incorrect deep_gemm assertions from server_args.py (#14113) 
Co-authored-by: Kangyan Zhou <zky314343421@gmail.com>
 2025-11-28 20:25:39 -08:00
fjybiocs
143b57b805 enable piecewise cuda graph for prefill server (#13377) 
Co-authored-by: serverance.fu <serverance.fu@temu.com>
 2025-11-29 12:09:26 +08:00
Yan Ru Pei
f446b51c41 fix: malformed KV events for NVIDIA Dynamo (#13488) 
Signed-off-by: PeaBrane <yanrpei@gmail.com>
Co-authored-by: ishandhanani <82981111+ishandhanani@users.noreply.github.com>
Co-authored-by: Zhiqiang Xie <xiezhq@stanford.edu>
 2025-11-28 14:55:20 -08:00