YAMY
|
c8492978a1
|
Fix Illegal Instruction/IMA errors when using DP attention -- num_tokens_for_logprob calculation (#12115)
|
2025-10-25 12:28:26 -07:00 |
|
Lianmin Zheng
|
428710c2ec
|
clean up github tokens (#12126)
Co-authored-by: sglang-bot <sglangbot@gmail.com>
|
2025-10-25 12:23:54 -07:00 |
|
Lifu Huang
|
d9b31011aa
|
Skip TestLlama4LoRA in CI (#12098)
|
2025-10-25 12:16:36 -07:00 |
|
Xiaoyu Zhang
|
d0cff78f54
|
[CI] Add ci monitor balance workflow (#11962)
|
2025-10-25 12:14:36 -07:00 |
|
DarkSharpness
|
e8b71445c0
|
[Misc] Improve the error message of failed import (#12119)
|
2025-10-25 12:09:05 -07:00 |
|
Lianmin Zheng
|
4caca1ba04
|
Clean up server args & Add CI scripts (#12124)
|
2025-10-25 11:53:57 -07:00 |
|
Kangyan-Zhou
|
ceb105a780
|
Update setup_github_runner.md
|
2025-10-25 09:22:00 -07:00 |
|
Simo Lin
|
22cbc9c086
|
[bugs] docker file name should be <name>.Dockerfile so it can properly render (#11869)
|
2025-10-25 08:34:43 -07:00 |
|
ishandhanani
|
3865afc5df
|
fix: release workflow should work on both archs (#12110)
|
2025-10-24 23:22:31 -07:00 |
|
Keyang Ru
|
4ea42f7cea
|
[router] Refactor data connector architecture with unified storage modules (#12096)
|
2025-10-24 22:44:34 -07:00 |
|
Lianmin Zheng
|
ea13cb1452
|
[Auto Sync] Update test_deterministic.py, test_deterministi... (20251024) (#12083)
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: Stefan He <hebiaobuaa@gmail.com>
|
2025-10-24 22:28:01 -07:00 |
|
sglang-bot
|
a04212f128
|
chore: bump sgl-kernel version to 0.3.16.post4 (#12103)
Co-authored-by: sglang-bot <sglang-bot@users.noreply.github.com>
|
2025-10-24 22:04:14 -07:00 |
|
Baizhou Zhang
|
ce86979355
|
[Fix] Set global args in cpu test (#12105)
|
2025-10-24 21:46:17 -07:00 |
|
Kangyan-Zhou
|
22f55e1b15
|
Fix kernel version bump file (#12087)
|
2025-10-24 20:32:33 -07:00 |
|
vipwangerxiao
|
8982418957
|
Fix 'KeyError' for per_token expert distribution recorder (#9501)
Signed-off-by: Peng Wang <rocking@linux.alibaba.com>
Co-authored-by: Peng Wang <rocking@linux.alibaba.com>
|
2025-10-25 03:28:50 +00:00 |
|
Fan Yin
|
433c622e80
|
[Docs] update sgl-kernel readme (#11379)
|
2025-10-24 19:31:14 -07:00 |
|
fzyzcjy
|
20bd2271e2
|
Support true on-policy (#12058)
|
2025-10-25 10:23:42 +08:00 |
|
Cheng Wan
|
649949807f
|
[10/N] MoE Refactor: reorganize deepgemm runner in DeepEPMoE (#12054)
|
2025-10-24 19:16:17 -07:00 |
|
Baizhou Zhang
|
729b242934
|
[Doc] Add documentation for DeepSeek V3.2 (#11877)
Co-authored-by: Xinyuan Tong <115166877+JustinTong0323@users.noreply.github.com>
Co-authored-by: ybyang <ybyang7@iflytek.com>
|
2025-10-24 19:06:22 -07:00 |
|
fzyzcjy
|
d7056c5236
|
Enhance tests in deterministic kernels (#12070)
|
2025-10-25 08:53:22 +08:00 |
|
Jinwu
|
13bf565d60
|
[2/N]Support DeepSeek-R1 w4a8 low latency deepep (#8464)
Co-authored-by: Hank Han <hanhan7630@outlook.com>
Co-authored-by: Shangchuan Huang <2510421000@qq.com>
|
2025-10-24 17:41:16 -07:00 |
|
yinghui
|
e51046beaa
|
perf: trtllm_mla attention backend spec decoding speedup w/ cuda graph (#12093)
|
2025-10-24 16:05:44 -07:00 |
|
Luca Lowndes
|
4eeeae1e75
|
Fix: Update blog link (#12071)
|
2025-10-24 15:26:23 -07:00 |
|
Minglei Zhu
|
f4b78d137c
|
[1/2] deepseek deterministic: support deterministic inference for deepseek arch models on a single GPU (#12000)
|
2025-10-24 15:17:28 -07:00 |
|
Chang Su
|
4463e90dd2
|
[router][grpc] Remove gpt_oss parsers and remove _parser suffix in tool parser files (#12091)
|
2025-10-24 15:14:41 -07:00 |
|
Simo Lin
|
229f236da8
|
[router] migrate app context to builder pattern 2/n (#12089)
|
2025-10-24 15:04:32 -07:00 |
|
Simo Lin
|
5983e5bd1b
|
[router] migrate app context to builder pattern 1/n (#12086)
|
2025-10-24 13:35:22 -07:00 |
|
Jonah Bernard
|
4b046a72d3
|
docs(server-arguments): add allowed options for each argument (#11560)
|
2025-10-24 11:49:20 -07:00 |
|
Simo Lin
|
770d63123c
|
[router] fix ut router config init to use build pattern (#12084)
|
2025-10-24 11:16:31 -07:00 |
|
ishandhanani
|
14203432b4
|
fix(compile_utils, ep_moe): update environment variable and dtype check (#12034)
|
2025-10-24 11:00:12 -07:00 |
|
Keyang Ru
|
d7f0d88fa2
|
[router] implement response api get input item function and refactor input/output store (#11924)
|
2025-10-24 10:44:21 -07:00 |
|
Glen Liu
|
fc86b18b3e
|
adjust dynamic vs static outputs comparison in test_lora_update.py (#11884)
|
2025-10-24 10:35:34 -07:00 |
|
|
|
0bfa394aff
|
[Fix]: HiCache hasher failed when EAGLE mode enabled (#12025)
|
2025-10-24 23:53:13 +08:00 |
|
fzyzcjy
|
e04340bf48
|
Fix multi processing serializer bug (#11958)
|
2025-10-24 22:53:45 +08:00 |
|
Xiaoyu Zhang
|
8470133852
|
[b200] fix piecewise cuda graph launch bug (#12067)
|
2025-10-24 22:36:39 +08:00 |
|
Muqi Li
|
93ef9a094d
|
[Profiler] expand '~' for torch_profiler_output_dir (#11999)
|
2025-10-24 17:20:46 +08:00 |
|
Muqi Li
|
b04cd3d487
|
Add 'gguf' to project dependencies (#12046)
|
2025-10-24 17:16:19 +08:00 |
|
Yuan Luo
|
7ef5d8afd4
|
Revise POINTSV15Chat model (#12049)
Co-authored-by: luoyuan.luo <luoyuan.luo@antgroup.com>
|
2025-10-24 17:09:45 +08:00 |
|
Qiaolin Yu
|
71d41212e4
|
Fix dpsk-r1-fp4 launching crash (#12063)
|
2025-10-24 17:04:50 +08:00 |
|
Xinyuan Tong
|
b9fb74f3bc
|
fix: bench_serving ITL calculation when using spec-decoding (#12064)
|
2025-10-24 17:02:44 +08:00 |
|
ybyang
|
e15b63a182
|
[Fix] fix missing ipc_name of __getitem__ in some IO structs (#12053)
Signed-off-by: ybyang <ybyang7@iflytek.com>
|
2025-10-24 16:59:14 +08:00 |
|
Yuxuan Zhang
|
4060ed37cb
|
Refactoring GLM-4.5 and GLM-4.5V related implementations (#11800)
|
2025-10-24 08:22:36 +00:00 |
|
fzyzcjy
|
2342605ef0
|
Tiny cleanup send_single (#12056)
|
2025-10-23 23:53:42 -07:00 |
|
Simo Lin
|
dbf17a8313
|
[router] Add mTLS Support for Router-to-Worker Communication (#12019)
Co-authored-by: Chang Su <chang.s.su@oracle.com>
|
2025-10-23 23:14:09 -07:00 |
|
fzyzcjy
|
0f0c430e93
|
Install numactl in Dockerfile for GH200/GB200/GB300 (#11853)
|
2025-10-23 21:39:10 -07:00 |
|
Rain Jiang
|
8e797a47f0
|
fix: the hardcode hf repo name comparison for deepseek-ocr (#12031)
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
|
2025-10-23 21:37:56 -07:00 |
|
Zaili Wang
|
aa3003f116
|
Add gguf dependency for cpu/xpu (#12041)
|
2025-10-23 21:13:17 -07:00 |
|
Yongfei Xu
|
4793ec7d1a
|
Opt MHA chunked prefix: merge prefix and extend kv cache to run mha once (#10953)
|
2025-10-23 20:58:10 -07:00 |
|
Zaili Wang
|
92009bd28e
|
fix: fix MMMU loading issue (#11759)
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
|
2025-10-23 20:21:38 -07:00 |
|
Baizhou Zhang
|
4ef981e2b6
|
Revert "[Fix] Fix lint to pass CI" (#12042)
|
2025-10-23 19:44:58 -07:00 |
|
