chenchenghao/sglang
1
0
Fork 0
Code Issues Pull Requests Actions 12 Packages Projects Releases Wiki Activity
10,877 Commits 1 Branch 0 Tags
09acec19082672ec62340520a352bb7c444f9ac3
Commit Graph

2091 Commits

Author SHA1 Message Date
wxiwnd
09acec1908 perf(disaggregation): cache static buffer metadata 2026-04-19 04:23:48 +08:00
wxiwnd
53a04a9a97 perf(disaggregation): reuse req pool freelists and alloc_extend tensors 2026-04-19 04:23:48 +08:00
laoyao0822
ef607c35c9 fix(spec_v2): support EAGLE with spec_v2 
1. add pass for spec_v2 in base_attn

2. fix: EAGLE with spec_v2 overlap Grammar accept_token failed

Signed-off-by: wxiwnd <wxiwnd@outlook.com>
 2026-04-09 01:37:13 +08:00
Lianmin Zheng
814202704b ci: unify PR test suite naming (#21187) 2026-03-23 00:18:45 -07:00
Lianmin Zheng
7757a9ddd0 ci: remove IS_BLACKWELL env var; auto-detect Blackwell (#21118) 2026-03-22 23:44:48 -07:00
kpham-sgl
bc4aaab6a1 [Spec][Ngram] 2/N: Rename branch length to max trie depth (#21181) 
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
 2026-03-22 23:35:25 -07:00
Shangming Cai
a094eb9c21 Temporarily disable flaky qwen3 cp test in CI (#21178) 2026-03-22 21:13:52 -07:00
fanghao
2b47bd3a34 [Bug Fix] Fix non-streaming request abort failure when --enable-metrics is enabled (#20625) 2026-03-22 19:58:49 -07:00
Ziang Li
ce0541404f [FlashInfer v0.6.6][RL] Support fp8-last-n-bf16 RL for flashinfer_trtllm_routed moe backend (#20214) 2026-03-22 11:17:01 -07:00
Ke Bao
2406ddfdb8 Add ut guide to test skills (#21130) 2026-03-22 20:55:37 +08:00
Shunkangz
bb737d7a82 Support Qwen3 MoE context parallel (#18233) 
Co-authored-by: Shunkang <182541032+Shunkangz@users.noreply.github.co>
Co-authored-by: Jiying Dong <87510204+dongjiyingdjy@users.noreply.github.com>
 2026-03-22 01:27:20 -07:00
kpham-sgl
6d160b42bb [Spec][Ngram] 1/N: Reference based Speculative Decoding refactor (#20393) 2026-03-22 00:55:10 -07:00
Bowen Li
3bc595acbc [FlashAttn] Add fused triton kernel for normal_decode_set_metadata (#20778) 
Co-authored-by: kinza99 <dh18324568312@163.com>
 2026-03-22 15:12:29 +08:00
KnightLTC
a0862f00c2 dbrx instruct npu support (#17121) 
Co-authored-by: McZyWu <zhuoyun.wu.23@ucl.ac.uk>
 2026-03-21 17:10:35 +08:00
Alison Shao
852e112ebf [Qwen3.5] Fix broken pipeline parallelism layer splitting (#21070) 
Co-authored-by: Alison Shao <alison.shao@Mac.attlocal.net>
 2026-03-21 01:02:51 -07:00
Baizhou Zhang
9ca68a5904 Remove flaky test for test_lora_update.py (#21088) 2026-03-21 00:52:40 -07:00
Qiaolin Yu
3f883ebf2e Fix test_qwen35_models (#21081) 2026-03-21 00:22:38 -07:00
Lianmin Zheng
dba6fb3d30 Fix streaming logprobs corruption caused by shared mutable list reference (#21030) 2026-03-21 00:18:48 -07:00
Baizhou Zhang
67cad3e69e Revert "Support CuteDSL mm_fp4 backend" (#21077) 2026-03-20 22:47:47 -07:00
Liangsheng Yin
9614271ae4 [Test] Fix flaky multi-instance memory occupation test (#21074) 2026-03-20 22:19:03 -07:00
shuwenn
6c91590e1b [HiCache] refactor: hicache normalization flow and compatibility checks (#19669) 2026-03-20 18:38:44 -07:00
Zijun Gao
576e397b6e [Test] Add unit tests for srt/sampling (#20891) 2026-03-20 23:38:48 +08:00
fzyzcjy
146700db68 Add e2e demo test in dump comparator (#21031) 2026-03-20 22:41:01 +08:00
fzyzcjy
6703cc4484 Enhance output formatting in dump comparator (#21029) 2026-03-20 22:04:50 +08:00
fzyzcjy
fdbcb8156e Refactor dp_utils to use ParallelAxis enum in dump comparator (#21028) 2026-03-20 22:04:20 +08:00
fzyzcjy
154395ab7d Support s≡t dimension name equivalence in dump comparator (#21027) 2026-03-20 22:03:34 +08:00
fzyzcjy
cc22601d28 Validate replicated axes orthogonality in dump comparator (#21026) 2026-03-20 22:02:40 +08:00
fzyzcjy
2f01950a0e Support jointly-determined axes inference in dump comparator (#21025) 2026-03-20 22:01:26 +08:00
fzyzcjy
ecd7e40d20 Support dependent axis auto-resolution in dump comparator (#21024) 2026-03-20 21:56:39 +08:00
Lianmin Zheng
2d7a262ca3 ci: rename 1/2-gpu-runner labels to 1/2-gpu-h100 (#21008) 2026-03-20 06:04:15 -07:00
Lianmin Zheng
104b10f70a refactor: consolidate is_in_ci (jit_kernel, sgl-kernel benchmarks, tests) (#21009) 2026-03-20 05:55:36 -07:00
Lianmin Zheng
c1da420799 ci: run Stage A CUDA tests as stage-a-test-small-1-gpu on 5090 (#20988) 2026-03-20 02:55:16 -07:00
Lianmin Zheng
a0a4dae67f Revert "Fix DeepSeek V32 FP4 test" (#21003) 2026-03-20 02:19:28 -07:00
Baizhou Zhang
c82d20d48e Fix DeepSeek V32 FP4 test (#20984) 2026-03-20 01:04:32 -07:00
Lianmin Zheng
cea79530f8 ci: merge CPU default and stage-a-cpu-only suites (#20992) 2026-03-20 00:04:55 -07:00
Lianmin Zheng
712a48c5d2 ci: move metrics scripts under scripts/ci/utils (#20986) 2026-03-19 23:47:57 -07:00
Liangsheng Yin
6ad78b008b Consolidate streaming session tests (4 files → 3, fewer server starts) (#20961) 2026-03-19 19:13:28 -07:00
Leon Gao
63c38aba5e Fix token leak with logprob_start_len=0 in streaming sessions (#20557) 2026-03-19 15:37:27 -07:00
Brayden Zhong
b42b9f6e1a Support CuteDSL mm_fp4 backend (#18801) 2026-03-19 14:20:01 -07:00
AlfredYong
c562e0d13b [feat] Enhance Kimi-K2/K2.5 function call and reasoning detection (#19552) 
Co-authored-by: alfredyyang <alfredyyang@tencent.com>
Co-authored-by: Xinyuan Tong <115166877+JustinTong0323@users.noreply.github.com>
 2026-03-19 12:57:57 -07:00
billishyahao
2ee7f41e25 [AMD] add mori ep normal tbo unittest (#20941) 2026-03-19 11:52:25 -07:00
YC Yen-Ching Tseng
9e629d31fd [AMD] CI - Fix AMD CI (multimodal test, move flaky test to non-deterministic group) (#20815) 2026-03-19 11:50:19 -07:00
Cao E
274581fb77 Add support for more batch sizes in cpu_graph_runner (#13881) 2026-03-19 09:50:56 -07:00
Shangming Cai
4c52b7fcc6 [CI] Improve PP consistency check success rate (#20838) 
Signed-off-by: Shangming Cai <csmthu@gmail.com>
 2026-03-19 19:12:50 +08:00
blzheng
cd22aa27a9 [CPU] Add FP8 Bmm support (#9744) 
Co-authored-by: Fan Yin <1106310035@qq.com>
 2026-03-18 22:19:48 -07:00
blzheng
c2b01bd2fc [CPU] fix bug in AVX512 implementation of flash_attn_softmax (#20220) 
Co-authored-by: Wu, Chunyuan <chunyuan.wu@intel.com>
 2026-03-18 22:18:47 -07:00
Zaili Wang
2f4babe32b [CPU] support LayerNorm with 3D shape (#15075) 
Co-authored-by: Ma Mingfei <mingfei.ma@intel.com>
 2026-03-18 22:15:24 -07:00
blzheng
dc6aa26ce9 [CPU] Add mrope kernel for Qwen3-vl (#12531) 
Co-authored-by: Ma Mingfei <mingfei.ma@intel.com>
 2026-03-18 22:12:48 -07:00
Juan Muneton
4052b53227 fix scheduler for non-cuda devices and disable piecewise cuda graph f… (#19992) 
Co-authored-by: Kangyan-Zhou <zky314343421@gmail.com>
 2026-03-18 21:54:19 -07:00
Ethan (Yusheng) Su
7f6f1a3ab1 [LoRA][II] Add fused MOE LoRA Triton kernel and tests (#19711) 2026-03-18 19:58:14 -07:00