Commit Graph

6244 Commits

Author SHA1 Message Date
Vincent Zhong
b4d2da106e [docs] upd docker files names everywhere (#12133) 2025-10-25 18:20:23 -07:00
Johnsonms
b72f9f08c1 [Test] Add dsv3.2 nsa backend testing (#11936) 2025-10-25 17:07:37 -07:00
Lianmin Zheng
8e70064c37 Clean up server launch code and multi tokenizer (#12132) 2025-10-25 16:40:27 -07:00
Qiaolin Yu
d98b81e260 Accelerate deepseek fp4 b200 ci (#11993) 2025-10-25 15:29:14 -07:00
Baizhou Zhang
bcecf27e7c [Doc] Fix format for deepseek v3.2 document (#12130) 2025-10-25 15:07:50 -07:00
Baizhou Zhang
4b0ac1d52a Update sgl-kernel version to 0.3.16.post4 (#12125) 2025-10-25 14:33:33 -07:00
Baizhou Zhang
8e987fa2a3 Update document index for DeepSeek-v32 docs (#12101) 2025-10-25 13:38:58 -07:00
Kangyan-Zhou
9e656dd3b2 Reenable b200 tests (#11814) 2025-10-25 13:02:33 -07:00
Lianmin Zheng
3862661cd4 Fix token for CI monitor (#12127)
Co-authored-by: sglang-bot <sglangbot@gmail.com>
2025-10-25 12:38:26 -07:00
YAMY
c8492978a1 Fix Illegal Instruction/IMA errors when using DP attention -- num_tokens_for_logprob calculation (#12115) 2025-10-25 12:28:26 -07:00
Lianmin Zheng
428710c2ec clean up github tokens (#12126)
Co-authored-by: sglang-bot <sglangbot@gmail.com>
2025-10-25 12:23:54 -07:00
Lifu Huang
d9b31011aa Skip TestLlama4LoRA in CI (#12098) 2025-10-25 12:16:36 -07:00
Xiaoyu Zhang
d0cff78f54 [CI] Add ci monitor balance workflow (#11962) 2025-10-25 12:14:36 -07:00
DarkSharpness
e8b71445c0 [Misc] Improve the error message of failed import (#12119) 2025-10-25 12:09:05 -07:00
Lianmin Zheng
4caca1ba04 Clean up server args & Add CI scripts (#12124) 2025-10-25 11:53:57 -07:00
Kangyan-Zhou
ceb105a780 Update setup_github_runner.md 2025-10-25 09:22:00 -07:00
Simo Lin
22cbc9c086 [bugs] docker file name should be <name>.Dockerfile so it can properly render (#11869) 2025-10-25 08:34:43 -07:00
ishandhanani
3865afc5df fix: release workflow should work on both archs (#12110) 2025-10-24 23:22:31 -07:00
Keyang Ru
4ea42f7cea [router] Refactor data connector architecture with unified storage modules (#12096) 2025-10-24 22:44:34 -07:00
Lianmin Zheng
ea13cb1452 [Auto Sync] Update test_deterministic.py, test_deterministi... (20251024) (#12083)
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: Stefan He <hebiaobuaa@gmail.com>
2025-10-24 22:28:01 -07:00
sglang-bot
a04212f128 chore: bump sgl-kernel version to 0.3.16.post4 (#12103)
Co-authored-by: sglang-bot <sglang-bot@users.noreply.github.com>
2025-10-24 22:04:14 -07:00
Baizhou Zhang
ce86979355 [Fix] Set global args in cpu test (#12105) 2025-10-24 21:46:17 -07:00
Kangyan-Zhou
22f55e1b15 Fix kernel version bump file (#12087) 2025-10-24 20:32:33 -07:00
vipwangerxiao
8982418957 Fix 'KeyError' for per_token expert distribution recorder (#9501)
Signed-off-by: Peng Wang <rocking@linux.alibaba.com>
Co-authored-by: Peng Wang <rocking@linux.alibaba.com>
2025-10-25 03:28:50 +00:00
Fan Yin
433c622e80 [Docs] update sgl-kernel readme (#11379) 2025-10-24 19:31:14 -07:00
fzyzcjy
20bd2271e2 Support true on-policy (#12058) 2025-10-25 10:23:42 +08:00
Cheng Wan
649949807f [10/N] MoE Refactor: reorganize deepgemm runner in DeepEPMoE (#12054) 2025-10-24 19:16:17 -07:00
Baizhou Zhang
729b242934 [Doc] Add documentation for DeepSeek V3.2 (#11877)
Co-authored-by: Xinyuan Tong <115166877+JustinTong0323@users.noreply.github.com>
Co-authored-by: ybyang <ybyang7@iflytek.com>
2025-10-24 19:06:22 -07:00
fzyzcjy
d7056c5236 Enhance tests in deterministic kernels (#12070) 2025-10-25 08:53:22 +08:00
Jinwu
13bf565d60 [2/N]Support DeepSeek-R1 w4a8 low latency deepep (#8464)
Co-authored-by: Hank Han <hanhan7630@outlook.com>
Co-authored-by: Shangchuan Huang <2510421000@qq.com>
2025-10-24 17:41:16 -07:00
yinghui
e51046beaa perf: trtllm_mla attention backend spec decoding speedup w/ cuda graph (#12093) 2025-10-24 16:05:44 -07:00
Luca Lowndes
4eeeae1e75 Fix: Update blog link (#12071) 2025-10-24 15:26:23 -07:00
Minglei Zhu
f4b78d137c [1/2] deepseek deterministic: support deterministic inference for deepseek arch models on a single GPU (#12000) 2025-10-24 15:17:28 -07:00
Chang Su
4463e90dd2 [router][grpc] Remove gpt_oss parsers and remove _parser suffix in tool parser files (#12091) 2025-10-24 15:14:41 -07:00
Simo Lin
229f236da8 [router] migrate app context to builder pattern 2/n (#12089) 2025-10-24 15:04:32 -07:00
Simo Lin
5983e5bd1b [router] migrate app context to builder pattern 1/n (#12086) 2025-10-24 13:35:22 -07:00
Jonah Bernard
4b046a72d3 docs(server-arguments): add allowed options for each argument (#11560) 2025-10-24 11:49:20 -07:00
Simo Lin
770d63123c [router] fix ut router config init to use build pattern (#12084) 2025-10-24 11:16:31 -07:00
ishandhanani
14203432b4 fix(compile_utils, ep_moe): update environment variable and dtype check (#12034) 2025-10-24 11:00:12 -07:00
Keyang Ru
d7f0d88fa2 [router] implement response api get input item function and refactor input/output store (#11924) 2025-10-24 10:44:21 -07:00
Glen Liu
fc86b18b3e adjust dynamic vs static outputs comparison in test_lora_update.py (#11884) 2025-10-24 10:35:34 -07:00
0bfa394aff [Fix]: HiCache hasher failed when EAGLE mode enabled (#12025) 2025-10-24 23:53:13 +08:00
fzyzcjy
e04340bf48 Fix multi processing serializer bug (#11958) 2025-10-24 22:53:45 +08:00
Xiaoyu Zhang
8470133852 [b200] fix piecewise cuda graph launch bug (#12067) 2025-10-24 22:36:39 +08:00
Muqi Li
93ef9a094d [Profiler] expand '~' for torch_profiler_output_dir (#11999) 2025-10-24 17:20:46 +08:00
Muqi Li
b04cd3d487 Add 'gguf' to project dependencies (#12046) 2025-10-24 17:16:19 +08:00
Yuan Luo
7ef5d8afd4 Revise POINTSV15Chat model (#12049)
Co-authored-by: luoyuan.luo <luoyuan.luo@antgroup.com>
2025-10-24 17:09:45 +08:00
Qiaolin Yu
71d41212e4 Fix dpsk-r1-fp4 launching crash (#12063) 2025-10-24 17:04:50 +08:00
Xinyuan Tong
b9fb74f3bc fix: bench_serving ITL calculation when using spec-decoding (#12064) 2025-10-24 17:02:44 +08:00
ybyang
e15b63a182 [Fix] fix missing ipc_name of __getitem__ in some IO structs (#12053)
Signed-off-by: ybyang <ybyang7@iflytek.com>
2025-10-24 16:59:14 +08:00