chenchenghao/sglang
1
0
Fork 0
Code Issues Pull Requests Actions 11 Packages Projects Releases Wiki Activity
10,877 Commits 1 Branch 0 Tags
09acec19082672ec62340520a352bb7c444f9ac3
Commit Graph

533 Commits

Author SHA1 Message Date
wxiwnd
09acec1908 perf(disaggregation): cache static buffer metadata 2026-04-19 04:23:48 +08:00
wxiwnd
53a04a9a97 perf(disaggregation): reuse req pool freelists and alloc_extend tensors 2026-04-19 04:23:48 +08:00
laoyao0822
ef607c35c9 fix(spec_v2): support EAGLE with spec_v2 
1. add pass for spec_v2 in base_attn

2. fix: EAGLE with spec_v2 overlap Grammar accept_token failed

Signed-off-by: wxiwnd <wxiwnd@outlook.com>
 2026-04-09 01:37:13 +08:00
Lianmin Zheng
814202704b ci: unify PR test suite naming (#21187) 2026-03-23 00:18:45 -07:00
kpham-sgl
bc4aaab6a1 [Spec][Ngram] 2/N: Rename branch length to max trie depth (#21181) 
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
 2026-03-22 23:35:25 -07:00
Shangming Cai
a094eb9c21 Temporarily disable flaky qwen3 cp test in CI (#21178) 2026-03-22 21:13:52 -07:00
fanghao
2b47bd3a34 [Bug Fix] Fix non-streaming request abort failure when --enable-metrics is enabled (#20625) 2026-03-22 19:58:49 -07:00
Ziang Li
ce0541404f [FlashInfer v0.6.6][RL] Support fp8-last-n-bf16 RL for flashinfer_trtllm_routed moe backend (#20214) 2026-03-22 11:17:01 -07:00
Ke Bao
2406ddfdb8 Add ut guide to test skills (#21130) 2026-03-22 20:55:37 +08:00
Shunkangz
bb737d7a82 Support Qwen3 MoE context parallel (#18233) 
Co-authored-by: Shunkang <182541032+Shunkangz@users.noreply.github.co>
Co-authored-by: Jiying Dong <87510204+dongjiyingdjy@users.noreply.github.com>
 2026-03-22 01:27:20 -07:00
kpham-sgl
6d160b42bb [Spec][Ngram] 1/N: Reference based Speculative Decoding refactor (#20393) 2026-03-22 00:55:10 -07:00
Bowen Li
3bc595acbc [FlashAttn] Add fused triton kernel for normal_decode_set_metadata (#20778) 
Co-authored-by: kinza99 <dh18324568312@163.com>
 2026-03-22 15:12:29 +08:00
KnightLTC
a0862f00c2 dbrx instruct npu support (#17121) 
Co-authored-by: McZyWu <zhuoyun.wu.23@ucl.ac.uk>
 2026-03-21 17:10:35 +08:00
Alison Shao
852e112ebf [Qwen3.5] Fix broken pipeline parallelism layer splitting (#21070) 
Co-authored-by: Alison Shao <alison.shao@Mac.attlocal.net>
 2026-03-21 01:02:51 -07:00
Baizhou Zhang
9ca68a5904 Remove flaky test for test_lora_update.py (#21088) 2026-03-21 00:52:40 -07:00
Qiaolin Yu
3f883ebf2e Fix test_qwen35_models (#21081) 2026-03-21 00:22:38 -07:00
Lianmin Zheng
dba6fb3d30 Fix streaming logprobs corruption caused by shared mutable list reference (#21030) 2026-03-21 00:18:48 -07:00
Baizhou Zhang
67cad3e69e Revert "Support CuteDSL mm_fp4 backend" (#21077) 2026-03-20 22:47:47 -07:00
Liangsheng Yin
9614271ae4 [Test] Fix flaky multi-instance memory occupation test (#21074) 2026-03-20 22:19:03 -07:00
shuwenn
6c91590e1b [HiCache] refactor: hicache normalization flow and compatibility checks (#19669) 2026-03-20 18:38:44 -07:00
Zijun Gao
576e397b6e [Test] Add unit tests for srt/sampling (#20891) 2026-03-20 23:38:48 +08:00
fzyzcjy
146700db68 Add e2e demo test in dump comparator (#21031) 2026-03-20 22:41:01 +08:00
fzyzcjy
6703cc4484 Enhance output formatting in dump comparator (#21029) 2026-03-20 22:04:50 +08:00
fzyzcjy
fdbcb8156e Refactor dp_utils to use ParallelAxis enum in dump comparator (#21028) 2026-03-20 22:04:20 +08:00
fzyzcjy
154395ab7d Support s≡t dimension name equivalence in dump comparator (#21027) 2026-03-20 22:03:34 +08:00
fzyzcjy
cc22601d28 Validate replicated axes orthogonality in dump comparator (#21026) 2026-03-20 22:02:40 +08:00
fzyzcjy
2f01950a0e Support jointly-determined axes inference in dump comparator (#21025) 2026-03-20 22:01:26 +08:00
fzyzcjy
ecd7e40d20 Support dependent axis auto-resolution in dump comparator (#21024) 2026-03-20 21:56:39 +08:00
Lianmin Zheng
104b10f70a refactor: consolidate is_in_ci (jit_kernel, sgl-kernel benchmarks, tests) (#21009) 2026-03-20 05:55:36 -07:00
Lianmin Zheng
c1da420799 ci: run Stage A CUDA tests as stage-a-test-small-1-gpu on 5090 (#20988) 2026-03-20 02:55:16 -07:00
Lianmin Zheng
a0a4dae67f Revert "Fix DeepSeek V32 FP4 test" (#21003) 2026-03-20 02:19:28 -07:00
Baizhou Zhang
c82d20d48e Fix DeepSeek V32 FP4 test (#20984) 2026-03-20 01:04:32 -07:00
Lianmin Zheng
cea79530f8 ci: merge CPU default and stage-a-cpu-only suites (#20992) 2026-03-20 00:04:55 -07:00
Liangsheng Yin
6ad78b008b Consolidate streaming session tests (4 files → 3, fewer server starts) (#20961) 2026-03-19 19:13:28 -07:00
Leon Gao
63c38aba5e Fix token leak with logprob_start_len=0 in streaming sessions (#20557) 2026-03-19 15:37:27 -07:00
Brayden Zhong
b42b9f6e1a Support CuteDSL mm_fp4 backend (#18801) 2026-03-19 14:20:01 -07:00
AlfredYong
c562e0d13b [feat] Enhance Kimi-K2/K2.5 function call and reasoning detection (#19552) 
Co-authored-by: alfredyyang <alfredyyang@tencent.com>
Co-authored-by: Xinyuan Tong <115166877+JustinTong0323@users.noreply.github.com>
 2026-03-19 12:57:57 -07:00
billishyahao
2ee7f41e25 [AMD] add mori ep normal tbo unittest (#20941) 2026-03-19 11:52:25 -07:00
YC Yen-Ching Tseng
9e629d31fd [AMD] CI - Fix AMD CI (multimodal test, move flaky test to non-deterministic group) (#20815) 2026-03-19 11:50:19 -07:00
Shangming Cai
4c52b7fcc6 [CI] Improve PP consistency check success rate (#20838) 
Signed-off-by: Shangming Cai <csmthu@gmail.com>
 2026-03-19 19:12:50 +08:00
Ethan (Yusheng) Su
7f6f1a3ab1 [LoRA][II] Add fused MOE LoRA Triton kernel and tests (#19711) 2026-03-18 19:58:14 -07:00
Liangsheng Yin
8b9482e665 fix(dp-attn): consistent overlap disable decision across DP ranks (#20853) 2026-03-18 15:16:39 -07:00
Xinyuan Tong
d1e95af282 Upgrade transformers==5.3.0 (#17784) 
Signed-off-by: Xinyuan Tong <xinyuantong.cs@gmail.com>
Co-authored-by: Kangyan-Zhou <zky314343421@gmail.com>
Co-authored-by: Alison Shao <alisonshao@mac.lan>
Co-authored-by: Mick <mickjagger19@icloud.com>
 2026-03-18 13:50:43 -07:00
Артем Савкин
6cca5b9b97 [NPU] [BUGFIX] Test ascend memory consumption.py fix (#17995) 2026-03-18 22:47:43 +03:00
Viacheslav
30a35ecd90 Add gigachat3.1 parser (#19886) 
Signed-off-by: Viacheslav Barinov <vvadbarinov@sberbank.ru>
Signed-off-by: Viacheslav Bv <viacheslav.teh@gmail.com>
Co-authored-by: Viacheslav Barinov <vvadbarinov@sberbank.ru>
 2026-03-17 22:45:01 -07:00
Kaixi Hou
4cc19862ef [NVIDIA] Integrate FlashInfer decode kernel (Blackwell) for Qwen3.5 (#19150) 
Co-authored-by: Claude Sonnet 4.6 <noreply@anthropic.com>
 2026-03-18 13:11:18 +08:00
Liangsheng Yin
4d3976b6c5 [HiCache] Check in-flight async ops in is_fully_idle() before attach/detach (#20746) 2026-03-17 17:28:26 -07:00
Yongfei Xu
17031120b8 [DeepSeek v3.2][Bugfix] get_index_k_scale_buffer support cp (#18280) 2026-03-17 09:54:54 -07:00
Ke Bao
7f99319c56 Add evict policy ut (#20787) 2026-03-17 22:06:14 +08:00
YC Yen-Ching Tseng
18dd5c972d [AMD] Fix AMD CI : stage-c-large-8-gpu-amd-mi35x (#20521) 
Co-authored-by: billisyahao <bill.he@amd.com>
 2026-03-16 23:53:33 -07:00