sglang-bot
|
4a56fa5cf2
|
chore: bump sgl-kernel version to 0.3.17.post1 (#13325)
|
2025-11-15 23:36:32 +08:00 |
|
FlyPanda
|
51f9b9628b
|
[optimize] Provide Usrbio compilation and installation commands (#12329)
|
2025-11-15 23:06:24 +08:00 |
|
Liangsheng Yin
|
daf494b681
|
tiny fix lint (#13337)
|
2025-11-15 23:05:08 +08:00 |
|
xlzheng
|
37e8724ef3
|
perf: optimize TypeBasedDispatcher using dict for O(1) lookup (#12001)
|
2025-11-15 22:02:42 +08:00 |
|
Zhihao Lyu
|
10592e9c08
|
[Ascend][Feat] Add Ascend sampling backend (#12692)
Co-authored-by: ronnie_zheng <zl19940307@163.com>
|
2025-11-15 21:59:58 +08:00 |
|
Even Zhou
|
2aec8b6e1b
|
[Feature] Spec-Overlap supporting DP-ATTN; PD-Disaggregation; npugraph mode (#12443)
|
2025-11-15 21:51:07 +08:00 |
|
Ke Bao
|
0d41ddfbd0
|
Temporarily disable test_vision_openai_server_a CI (#13331)
|
2025-11-15 19:46:49 +08:00 |
|
Simo Lin
|
37c8761567
|
[model-gateway] remove grpc feature flag and mark as default (#13330)
|
2025-11-15 03:16:57 -08:00 |
|
Adarsh Shirawalmath
|
3f400f25df
|
[Diffusion] add health endpoints to diffusion server (#13329)
|
2025-11-15 19:12:37 +08:00 |
|
Yongfei Xu
|
d91b16eb16
|
Opt tp: tp attn support tp reduce scattered input (#10568)
|
2025-11-15 02:08:12 -08:00 |
|
Xinyue Zhang
|
4a10e37ba7
|
[router] Fix flaky router e2e tests (#13306)
|
2025-11-15 02:00:25 -08:00 |
|
Charles Chen
|
b051d76dab
|
Fix: add missing get_embed_and_head in MiniMax M2 for Eagle3 (#13297)
|
2025-11-15 01:36:03 -08:00 |
|
Yineng Zhang
|
d52d992a90
|
Update README (#13326)
|
2025-11-15 01:33:10 -08:00 |
|
fzyzcjy
|
d971f22898
|
Super tiny expose transform_scale_ue8m0 API for RL frameworks (#13323)
|
2025-11-15 17:31:04 +08:00 |
|
Xiaoyu Zhang
|
1d3d42bda0
|
[opt kimi k2 1 / n] Add kimi k2 moe fused gate (#13287)
|
2025-11-15 17:14:19 +08:00 |
|
Ke Bao
|
8e9f05ece1
|
Update marlin moe kernel interface (#13322)
|
2025-11-15 17:10:39 +08:00 |
|
Zilin Zhu
|
bc083521a8
|
[RL] support update_weights_from_tensor for mtp (#7415)
|
2025-11-15 16:57:01 +08:00 |
|
fzyzcjy
|
33f08a98b0
|
Tiny refactor condition to requant scale ue8m0 (#13286)
|
2025-11-15 16:36:00 +08:00 |
|
fzyzcjy
|
8e6083bfcf
|
Support inverse transform ue8m0 scale (#13285)
|
2025-11-15 16:34:32 +08:00 |
|
fzyzcjy
|
2fbc78a083
|
Support fast gemm when in batch invariant DeepGEMM fallback (#13259)
|
2025-11-15 16:34:15 +08:00 |
|
Zilin Zhu
|
f0b5ccf5f5
|
[RL] Allow bypassing /health check (#13320)
|
2025-11-15 16:33:54 +08:00 |
|
Simo Lin
|
b732ffa404
|
[model-gateway] move python to binding folder (#13295)
|
2025-11-15 00:32:21 -08:00 |
|
Zilin Zhu
|
56fc483073
|
[RL] support only do cpu backup on draft model (#13318)
|
2025-11-15 16:31:57 +08:00 |
|
Ke Bao
|
2a96e302cb
|
Revert moe sum reduce for marlin moe (#13314)
|
2025-11-15 15:57:41 +08:00 |
|
Minglei Zhu
|
8a4373405e
|
re-submit 12911 but relax the requirement for deepgemm (#13226)
|
2025-11-15 15:37:12 +08:00 |
|
Yuan Luo
|
f0021c0dc8
|
Add feature flag for mm inputs processing optimization (#13278)
Co-authored-by: luoyuan.luo <luoyuan.luo@antgroup.com>
|
2025-11-15 14:43:44 +08:00 |
|
Douglas Yang
|
7ee3e36412
|
Fix: test_vlm_offline_throughput output throughput (#13279)
|
2025-11-15 14:31:48 +08:00 |
|
Ho-Ren (Jack) Chuang
|
6d5e16fb1c
|
feat: Add FP4 (E2M1) KV Cache Support for MHA (#12612)
Signed-off-by: Ho-Ren (Jack) Chuang <horenchuang@bytedance.com>
Co-authored-by: Yichen Wang <yichen.wang@bytedance.com>
|
2025-11-14 22:31:35 -08:00 |
|
alisonshao
|
67e6f1438d
|
Consolidate similar tests to reduce duplication (#12871)
|
2025-11-15 14:29:44 +08:00 |
|
Zilin Zhu
|
34851471b2
|
Add more statistics for spec decoding (#13317)
|
2025-11-15 14:20:28 +08:00 |
|
Adarsh Shirawalmath
|
c2083116e3
|
[Diffusion] switch to local calculate_dimensions (#13294)
|
2025-11-15 13:55:13 +08:00 |
|
Baizhou Zhang
|
10285ec204
|
[Misc]Add date to cu13 dev image tag (#13316)
|
2025-11-14 19:42:50 -08:00 |
|
Yiming
|
9b3fc186bc
|
Fix syntax errors in cpp_radix_tree (#13315)
|
2025-11-15 11:35:43 +08:00 |
|
Simo Lin
|
172c71a23d
|
[model-gateway] smg release 0.2.3 (#13312)
|
2025-11-14 19:04:20 -08:00 |
|
Adarsh Shirawalmath
|
af373636da
|
CI: add server performance test for SGLang diffusion (#13091)
Co-authored-by: Mick <mickjagger19@icloud.com>
|
2025-11-15 10:11:19 +08:00 |
|
Minglei Zhu
|
a5be6ef98e
|
[Deterministic] Support Qwen3-Next model deterministic inference (#13100)
|
2025-11-14 18:01:18 -08:00 |
|
Kangyan-Zhou
|
8f4e18a294
|
Add missing model for 2-gpu-runner in nightly tests (#13311)
|
2025-11-14 17:34:43 -08:00 |
|
Kangyan-Zhou
|
e9681444bd
|
Add missing model in model validate list (#13310)
|
2025-11-14 17:29:21 -08:00 |
|
Yuwei An
|
eae59b337e
|
Piecewise Cuda Graph Support for gpt-oss model (#13045)
Signed-off-by: Oasis-Git <ayw.sirius19@gmail.com>
|
2025-11-15 09:28:00 +08:00 |
|
Xinyue Zhang
|
14dc052382
|
[router]Replace requests lib with openai in e2e_response_api (#13293)
|
2025-11-14 16:56:40 -08:00 |
|
Kangyan-Zhou
|
b223669136
|
Remove nightly b200 tests and revert a change for test file (#13305)
|
2025-11-14 16:30:22 -08:00 |
|
alisonshao
|
dcc47a56c9
|
Implement nightly test workflow naming conventions (#13170)
|
2025-11-14 16:14:53 -08:00 |
|
Johnsonms
|
6448b4cd2c
|
Fix NSA indexer nightly test failed issues (#13298)
|
2025-11-14 13:14:57 -08:00 |
|
Kaixi Hou
|
5ae0ac4244
|
[NVIDIA] Fix use case of SGLANG_ENABLE_FLASHINFER_GEMM (#13274)
Co-authored-by: Baizhou Zhang <sobereddiezhang@gmail.com>
|
2025-11-14 12:51:11 -08:00 |
|
Lianmin Zheng
|
22f641ab4f
|
[minor] remove debug code in python/sglang/srt/compilation/weak_ref_tensor_jit.py (#13235)
Co-authored-by: Stefan He <hebiaobuaa@gmail.com>
|
2025-11-14 12:22:24 -08:00 |
|
Stefan He
|
0997c78d2c
|
Support FP8 Per Token Quant Piecewise (#13272)
|
2025-11-14 11:40:12 -08:00 |
|
Zesen SenmiaoORZ
|
fd3be107bb
|
[Doc] Add item for repetition punishment (#13260)
|
2025-11-14 11:15:56 -08:00 |
|
Praneth Paruchuri
|
665f43bdd8
|
model: support teleflm (#10573)
|
2025-11-15 03:14:49 +08:00 |
|
Praneth Paruchuri
|
a53f2d6c12
|
Support orion (#10665)
|
2025-11-15 03:08:32 +08:00 |
|
hlu1
|
a7002e614b
|
[Deepseek V3.2] Clean up MTP (#13236)
|
2025-11-14 11:01:37 -08:00 |
|