Commit Graph

6264 Commits

Author SHA1 Message Date
Elfie Guo
a1d5bc4cce Avoid using flashinfer_allreduce_fusion when dp attention is enabled. (#11632) 2025-10-26 12:31:14 -07:00
Zijian Zhang
a8023891f6 model: support NVILA and NVILA Lite (#10399) 2025-10-26 09:58:09 -07:00
fzyzcjy
0103f374ba Support DeepGEMM for deterministic inference (#12142) 2025-10-26 22:36:17 +08:00
zyksir
96a5a949f6 [Fix] fix allreduce bug in Piecewise Graph (#12106) 2025-10-26 21:15:48 +08:00
Liangsheng Yin
ea385ae85a Fix ITL metrics when using openai endpoint with spec (#12156) 2025-10-26 18:06:25 +08:00
Simo Lin
9e949e5877 [router] centralize mcp tool args handling (#12155) 2025-10-26 01:47:12 -07:00
Chang Su
6dbb569bc3 [router][grpc] Fix tool call id in parse_json_schema_response (#12152) 2025-10-26 01:40:53 -07:00
Liangsheng Yin
5994e6c373 Do not use MagicMock to mock server_args in tests (#12154) 2025-10-26 16:00:46 +08:00
huangtingwei
3e6281d0aa [HiCache]Page head layout IO kernel (#11615) 2025-10-26 15:53:50 +08:00
Kai-Hsun Chen
6371f7af27 [quantization] AWQ Marlin doesn't work when dtype is bfloat16 (#11494)
Signed-off-by: Kai-Hsun Chen <khchen@x.ai>
Co-authored-by: Xinyuan Tong <115166877+JustinTong0323@users.noreply.github.com>
2025-10-26 15:49:45 +08:00
Liangsheng Yin
8491c794ad [misc] depdencies & enviroment flag (#12113) 2025-10-26 14:52:35 +08:00
Liangsheng Yin
bda3758fac [log] Make forward iter count optional (#12116) 2025-10-26 14:51:07 +08:00
Lianmin Zheng
7b36c47b3b Clean up attention backend selection code & Other minor rename (#12136) 2025-10-25 23:50:12 -07:00
Chang Su
773d89da8c [router] cleaned up all the redundant comments in the config module (#12147) 2025-10-25 23:10:59 -07:00
Simo Lin
03e7d94916 [router] update smg code owners for each component (#12141) 2025-10-25 22:28:59 -07:00
Kaixi Hou
ff60406429 [NVIDIA] Change default quant method for model_opt (#11991) 2025-10-25 22:04:57 -07:00
Simo Lin
212f5e4822 [router] MCP Manager Refactoring - Flat Architecture with Connection Pooling (#12097) 2025-10-25 21:26:28 -07:00
Yineng Zhang
fe527812a6 docs: update README (#12139) 2025-10-25 20:49:10 -07:00
Baizhou Zhang
97828878d8 [Doc] Small update of DeepSeek v3.2 document (#12138) 2025-10-25 20:34:05 -07:00
fzyzcjy
c001deba37 Make bmm batch invariant injection optional (#12118) 2025-10-26 10:18:35 +08:00
Vincent Zhong
b4d2da106e [docs] upd docker files names everywhere (#12133) 2025-10-25 18:20:23 -07:00
Johnsonms
b72f9f08c1 [Test] Add dsv3.2 nsa backend testing (#11936) 2025-10-25 17:07:37 -07:00
Lianmin Zheng
8e70064c37 Clean up server launch code and multi tokenizer (#12132) 2025-10-25 16:40:27 -07:00
Qiaolin Yu
d98b81e260 Accelerate deepseek fp4 b200 ci (#11993) 2025-10-25 15:29:14 -07:00
Baizhou Zhang
bcecf27e7c [Doc] Fix format for deepseek v3.2 document (#12130) 2025-10-25 15:07:50 -07:00
Baizhou Zhang
4b0ac1d52a Update sgl-kernel version to 0.3.16.post4 (#12125) 2025-10-25 14:33:33 -07:00
Baizhou Zhang
8e987fa2a3 Update document index for DeepSeek-v32 docs (#12101) 2025-10-25 13:38:58 -07:00
Kangyan-Zhou
9e656dd3b2 Reenable b200 tests (#11814) 2025-10-25 13:02:33 -07:00
Lianmin Zheng
3862661cd4 Fix token for CI monitor (#12127)
Co-authored-by: sglang-bot <sglangbot@gmail.com>
2025-10-25 12:38:26 -07:00
YAMY
c8492978a1 Fix Illegal Instruction/IMA errors when using DP attention -- num_tokens_for_logprob calculation (#12115) 2025-10-25 12:28:26 -07:00
Lianmin Zheng
428710c2ec clean up github tokens (#12126)
Co-authored-by: sglang-bot <sglangbot@gmail.com>
2025-10-25 12:23:54 -07:00
Lifu Huang
d9b31011aa Skip TestLlama4LoRA in CI (#12098) 2025-10-25 12:16:36 -07:00
Xiaoyu Zhang
d0cff78f54 [CI] Add ci monitor balance workflow (#11962) 2025-10-25 12:14:36 -07:00
DarkSharpness
e8b71445c0 [Misc] Improve the error message of failed import (#12119) 2025-10-25 12:09:05 -07:00
Lianmin Zheng
4caca1ba04 Clean up server args & Add CI scripts (#12124) 2025-10-25 11:53:57 -07:00
Kangyan-Zhou
ceb105a780 Update setup_github_runner.md 2025-10-25 09:22:00 -07:00
Simo Lin
22cbc9c086 [bugs] docker file name should be <name>.Dockerfile so it can properly render (#11869) 2025-10-25 08:34:43 -07:00
ishandhanani
3865afc5df fix: release workflow should work on both archs (#12110) 2025-10-24 23:22:31 -07:00
Keyang Ru
4ea42f7cea [router] Refactor data connector architecture with unified storage modules (#12096) 2025-10-24 22:44:34 -07:00
Lianmin Zheng
ea13cb1452 [Auto Sync] Update test_deterministic.py, test_deterministi... (20251024) (#12083)
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: Stefan He <hebiaobuaa@gmail.com>
2025-10-24 22:28:01 -07:00
sglang-bot
a04212f128 chore: bump sgl-kernel version to 0.3.16.post4 (#12103)
Co-authored-by: sglang-bot <sglang-bot@users.noreply.github.com>
2025-10-24 22:04:14 -07:00
Baizhou Zhang
ce86979355 [Fix] Set global args in cpu test (#12105) 2025-10-24 21:46:17 -07:00
Kangyan-Zhou
22f55e1b15 Fix kernel version bump file (#12087) 2025-10-24 20:32:33 -07:00
vipwangerxiao
8982418957 Fix 'KeyError' for per_token expert distribution recorder (#9501)
Signed-off-by: Peng Wang <rocking@linux.alibaba.com>
Co-authored-by: Peng Wang <rocking@linux.alibaba.com>
2025-10-25 03:28:50 +00:00
Fan Yin
433c622e80 [Docs] update sgl-kernel readme (#11379) 2025-10-24 19:31:14 -07:00
fzyzcjy
20bd2271e2 Support true on-policy (#12058) 2025-10-25 10:23:42 +08:00
Cheng Wan
649949807f [10/N] MoE Refactor: reorganize deepgemm runner in DeepEPMoE (#12054) 2025-10-24 19:16:17 -07:00
Baizhou Zhang
729b242934 [Doc] Add documentation for DeepSeek V3.2 (#11877)
Co-authored-by: Xinyuan Tong <115166877+JustinTong0323@users.noreply.github.com>
Co-authored-by: ybyang <ybyang7@iflytek.com>
2025-10-24 19:06:22 -07:00
fzyzcjy
d7056c5236 Enhance tests in deterministic kernels (#12070) 2025-10-25 08:53:22 +08:00
Jinwu
13bf565d60 [2/N]Support DeepSeek-R1 w4a8 low latency deepep (#8464)
Co-authored-by: Hank Han <hanhan7630@outlook.com>
Co-authored-by: Shangchuan Huang <2510421000@qq.com>
2025-10-24 17:41:16 -07:00