Xiaoyu Zhang
|
95191ebdca
|
Migrate weak_ref_tensor to sgl-kernel (#12505)
|
2025-11-02 10:55:39 +08:00 |
|
Baizhou Zhang
|
9a512cf95b
|
[CI] Move some Lora/Deterministic CI tests to nightly (#12507)
|
2025-11-01 19:54:22 -07:00 |
|
Binyao Jiang
|
3451fc3280
|
[Feature] Qwen3-Next & FLA: Support MTP topk>1; Up to 6% faster (#11133)
Co-authored-by: Stefan He <hebiaobuaa@gmail.com>
|
2025-11-01 19:47:56 -07:00 |
|
Zhihao Lyu
|
c550ab9125
|
[Ascend] Add Ascend NPU support for sglang.check_env & rework proposal (#11052)
Co-authored-by: ronnie_zheng <zl19940307@163.com>
|
2025-11-01 19:26:45 -07:00 |
|
Even Zhou
|
086f0b79fc
|
[CI][NPU] remove pypi mirror site that hangs ci dependency installation (#12499)
|
2025-11-01 19:25:53 -07:00 |
|
Xun Sun
|
0afd68321b
|
Update Mooncake EP's a2a interface (#12391)
|
2025-11-01 18:48:47 -07:00 |
|
Johnsonms
|
6f858930c8
|
[Bug] test_flashattn_mla_backend errors in Hopper #12487 (#12488)
|
2025-11-01 18:28:06 -07:00 |
|
Minglei Zhu
|
229256c505
|
[Deterministic] add deepseek v3 deterministic inference CI test (#12412)
|
2025-11-01 18:10:32 -07:00 |
|
hzh0425
|
6b634493c3
|
[HICache / PD]: Support offloading incremental KV cache in decode side. (#11966)
|
2025-11-01 14:59:37 -07:00 |
|
ybyang
|
756ad9ceb1
|
Reduce docker image size. mount cache when use pip/cargo build (#12238)
Signed-off-by: ybyang <ybyang7@iflytek.com>
|
2025-11-01 14:58:04 -07:00 |
|
Xinyuan Tong
|
d2a8f71c2f
|
[feat] Add SGLANG_TOOL_STRICT_LEVEL for tool-call behavior control (#12423)
Signed-off-by: Xinyuan Tong <xinyuantong.cs@gmail.com>
|
2025-11-01 13:15:02 -07:00 |
|
Baizhou Zhang
|
2b7bf11bd2
|
[Hotfix] Remove extra comment in sgl-kernel README (#12500)
|
2025-11-01 12:22:45 -07:00 |
|
Baizhou Zhang
|
566ade0388
|
[CI] Build aarch64 kernels for sgl-kernel test (#12480)
|
2025-11-01 11:55:42 -07:00 |
|
Ke Bao
|
69193f7122
|
Filter tokenizer warning for kimi models (#12485)
|
2025-11-01 16:27:31 +08:00 |
|
yinghui
|
d5b6e50fe8
|
perf: trtllm mla performance minor improvements (#12435)
|
2025-10-31 22:48:02 -07:00 |
|
Liangsheng Yin
|
9632e48f5d
|
[hot fix] Remove from python.sglang.xxx (#12483)
|
2025-11-01 11:00:05 +08:00 |
|
Qiaolin Yu
|
59cce5941a
|
Use sgl fp4 quant kernel by default (#12482)
|
2025-10-31 19:51:28 -07:00 |
|
Surya-Gunukula
|
795e98f8a6
|
Forward unknown tool calls instead of dropping (#12226)
|
2025-11-01 02:10:35 +00:00 |
|
Shangming Cai
|
358ae3563d
|
Tiny fix eos handling for PD disaggregation (#12334)
Signed-off-by: Shangming Cai <csmthu@gmail.com>
|
2025-10-31 17:57:10 -07:00 |
|
sglang-bot
|
41c10e67fc
|
chore: bump SGLang version to 0.5.4.post2 (#12439)
|
2025-10-31 17:38:50 -07:00 |
|
Xinyuan Tong
|
0bfe1d145c
|
fa3 & trtllm_mha spec overlap (#11874)
|
2025-10-31 17:38:13 -07:00 |
|
Baizhou Zhang
|
5f98b7fe61
|
[CI] Fix kernel installation on aarch runners (#12475)
|
2025-10-31 14:25:27 -07:00 |
|
Ke Bao
|
a4bf5c6ad2
|
Support Kimi Linear (#12469)
Co-authored-by: yizhang2077 <1109276519@qq.com>
|
2025-10-31 14:03:35 -07:00 |
|
fzyzcjy
|
30ad107028
|
Try to allow NCCL cumem for multi node nvlink case (#11987)
|
2025-10-31 12:48:25 -07:00 |
|
yinghui
|
a80bcb5a68
|
Add env var to disable FA4 warmup (#12430)
|
2025-10-31 12:25:00 -07:00 |
|
Ke Bao
|
f7f9e41b36
|
Fix run benchmark (#12473)
|
2025-11-01 02:39:48 +08:00 |
|
ishandhanani
|
263eab9f5d
|
fix: dummy health check server not accessible on non-zero rank nodes (#12297)
|
2025-10-31 11:34:57 -07:00 |
|
fzyzcjy
|
25257d8e00
|
Tiny assert no running requests when releasing memory to avoid IMA (#12341)
|
2025-11-01 01:28:53 +08:00 |
|
daniel, chen
|
cf0c24150a
|
add served model name in bench serving (#12428)
|
2025-11-01 01:28:11 +08:00 |
|
huangtingwei
|
5538e05cb1
|
fix default env var for mooncake store (#12429)
|
2025-11-01 01:25:33 +08:00 |
|
Yuan Luo
|
c30ebb9300
|
[VLM] Optimize async mm data process mechanism (#12066)
Co-authored-by: luoyuan.luo <luoyuan.luo@antgroup.com>
|
2025-11-01 01:24:53 +08:00 |
|
ykcombat
|
41efcaeb45
|
[Feature] PD-Multiplexing Context and Scheduler, lazy import spatial. (#12275)
|
2025-11-01 00:40:01 +08:00 |
|
0xNullPath
|
70562969b9
|
[Bug] OOM (Out-of-Memory) errors for extreme testing scenarios (min_tokens=2) (#11757)
Signed-off-by: Yan Lu <luyan@nvidia.com>
|
2025-11-01 00:28:41 +08:00 |
|
Neelabh Sinha
|
b57dc169eb
|
[Test] Add Functional Tests for Penalty Parameters (#11931)
|
2025-11-01 00:10:17 +08:00 |
|
Ke Bao
|
0095e01874
|
Fix lint in deepseek-ocr (#12470)
|
2025-11-01 00:08:19 +08:00 |
|
Xinyuan Tong
|
684864814b
|
Feat: deepseek-ocr logits processor (#12415)
Co-authored-by: xinyuant <xinyuant@usc.edu>
|
2025-10-31 23:35:22 +08:00 |
|
sjtu_shenhai
|
410225b719
|
[Bug fix] Fix severe memory waste issue with torch.empty pin_memory (#12266)
|
2025-10-31 21:30:37 +08:00 |
|
Liangsheng Yin
|
2c9aebea70
|
Simplify watchdog (#12463)
|
2025-10-31 21:17:38 +08:00 |
|
Kindyaa
|
bc741073a3
|
fix:watchdog thread exception (#12328)
|
2025-10-31 20:54:50 +08:00 |
|
Yuhong Guo
|
2f6af1a3de
|
Enable bailing_moe to support TP=16 (#12369)
|
2025-10-31 19:32:49 +08:00 |
|
Zaili Wang
|
50b6842b4b
|
fix: Add default value for backend in sample_mmmu_requests (#12256)
|
2025-10-31 19:31:40 +08:00 |
|
Lianmin Zheng
|
2d5605e89b
|
Fix ci install to allow prerelease (#12449)
|
2025-10-31 02:22:15 -07:00 |
|
Liangsheng Yin
|
300b4c212e
|
[CI] fix possible port conflicts. (#12452)
Co-authored-by: Lianmin Zheng <15100009+merrymercy@users.noreply.github.com>
|
2025-10-31 17:20:20 +08:00 |
|
Lianmin Zheng
|
c0652d907b
|
Clean up sgl kernel (#12413)
Co-authored-by: Byron Hsu <byronhsu1230@gmail.com>
|
2025-10-31 01:13:34 -07:00 |
|
Bruce-x-1997
|
2e48584b62
|
[bugfix] set is_prefill_only=false when mixed_chunk (#10889)
|
2025-10-31 00:12:21 -07:00 |
|
Baizhou Zhang
|
57cc5385c0
|
[CI] Add more bins for 1-gpu CI test (#12422)
|
2025-10-31 00:05:01 -07:00 |
|
Liangsheng Yin
|
5cc0d25a0d
|
Add trait for BasePrefixCache (#12436)
|
2025-10-31 14:03:27 +08:00 |
|
b8zhong
|
a076ec1a7a
|
Revert "fix llama4 kv cache layout" (#12437)
|
2025-10-30 22:33:37 -07:00 |
|
Keyang Ru
|
72b5f3d0bb
|
[ci] install released version router (#12410)
|
2025-10-30 21:59:08 -07:00 |
|
bppps
|
2f766f381d
|
[Bugfix]: distinguish processors for deepseek_vl2 and deepseek_ocr to p… (#12384)
|
2025-10-30 21:51:30 -07:00 |
|