chenchenghao/sglang
1
0
Fork 0
Code Issues Pull Requests Actions 11 Packages Projects Releases Wiki Activity
10,192 Commits 1 Branch 0 Tags
53de53fb53f619ca267e61edde77458e070cd114
Commit Graph

10192 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Xiaoyu Zhang
53de53fb53 [jit_kernel] Tiny unify jit_kernel tests style (#19694) 2026-03-02 21:33:59 +08:00
Hexq0210
714c53d609 [NPU] support PD disaggregation on ascend when using PP (#14908) 
Co-authored-by: iridiumine <42236072+iridiumine@users.noreply.github.com>
 2026-03-02 21:33:16 +08:00
Bi Xue
eaf18ebe8d [sgl]add pin_mem to avoid cpu->gpu copy sync point (#19590) 2026-03-02 21:08:31 +08:00
JiaruiChang5268
b3718982a1 [Feature] add feature mla_ag_after_qlora for dsv3.2 (#19428) 
Co-authored-by: JiaruiChang5268 <changjiarui1@huawei.com>
 2026-03-02 20:00:31 +08:00
Shangming Cai
3f36f27eae [Bugfix] Fix nixl and mori backend for missing decode tp size in PD module (#19690) 
Signed-off-by: Shangming Cai <csmthu@gmail.com>
 2026-03-02 19:55:19 +08:00
AichenF
8df9b8dce9 [diffusion] fix: skip USP for cross-attention with replicated KV for wan (#19419) 
Co-authored-by: Mick <mickjagger19@icloud.com>
 2026-03-02 19:52:08 +08:00
Leoyzen
da2a0240f7 Add GLM45 tool interruption support (#17714) 
Co-authored-by: Sisyphus <clio-agent@sisyphuslabs.ai>
 2026-03-02 19:34:12 +08:00
fzyzcjy
7579ab3f33 Enhance error resilience in dump comparator (#19685) 2026-03-02 19:08:35 +08:00
fzyzcjy
e5ef845cad Support multiple verbosity in dump comparator (#19684) 2026-03-02 18:47:30 +08:00
fzyzcjy
3dd4649b42 Beautify text output in dump comparator (#19683) 2026-03-02 18:47:01 +08:00
fzyzcjy
5bf3deb4bc Trace execution information in dump comparator (#19682) 2026-03-02 18:46:27 +08:00
fzyzcjy
3ebd85bf1c Enhance sglang engine dumping tests in dump comparator (#19681) 2026-03-02 18:46:03 +08:00
fzyzcjy
abdc0ee71f Support directory detection in dump comparator (#19680) 2026-03-02 18:45:35 +08:00
fzyzcjy
6980416149 Support non orthogonal parallel axes and explicit replication annotation in dump comparator (#19679) 2026-03-02 18:44:33 +08:00
fzyzcjy
a70dd11011 Support flattened dims in dump comparator (#19678) 2026-03-02 18:43:01 +08:00
fzyzcjy
15e83eea61 Enhance replication check, matching pattern, logging in dump comparator (#19677) 2026-03-02 18:42:27 +08:00
fzyzcjy
ec44bc82ab Support presets and arbitrary skipping keys in dump comparator (#19676) 2026-03-02 18:41:49 +08:00
Mick
2e15c015c0 [diffusion] feat: Add --model-id for config resolution; deprecate model_detectors (#19607) 2026-03-02 16:39:53 +08:00
YC Tseng
f2c5503542 [AMD] AMD AITER Scout Workflow (#19467) 
Co-authored-by: Bingxu Chen <Bingxu.Chen@amd.com>
 2026-03-02 16:10:44 +08:00
jacky.cheng
98f47d8175 [AMD] Add Qwen3-Coder-Next accuracy and functionality test scripts for MI35x 8-GPU (#18608) 2026-03-01 23:52:47 -08:00
kk
15af26d1e8 Add aiter attention support in prefill-attention-backend of gpt-oss (#18282) 
Co-authored-by: wunhuang <wunhuang@amd.com>
 2026-03-01 23:39:24 -08:00
ishandhanani
f7da379b61 feat: TTL-based prefix pinning with refresh-on-hit for HiRadixCache (#18941) 
Co-authored-by: Claude <noreply@anthropic.com>
 2026-03-01 23:27:22 -08:00
Xiaoyu Zhang
e42fa009d4 [Diffusion] diffusion profile and opt skills (#19540) 2026-03-02 15:06:29 +08:00
Leon Gao
07ef5f7be1 Remove sync points in mamba cache + prefill cudagraph plumbing for DP (#19639) 2026-03-02 15:03:42 +08:00
Ke Bao
4726073865 Fix mamba2 mixer ci test (#19658) 2026-03-02 14:55:15 +08:00
Baidu-AIAK
922aad2faa Cleanup disagg decode prebuilt flow and add cross-stream sync in merge_batch (#19568) 
Co-authored-by: vincent <vincent@vincentdeMacBook-Pro.local>
Co-authored-by: hnyls2002 <lsyincs@gmail.com>
Co-authored-by: Liangsheng Yin <hnyls2002@gmail.com>
 2026-03-01 21:52:27 -08:00
sglang-bot
0e53cee1f6 [CI] Disable test_lora_tp CUDA CI during H100 to H200 transition (#19654) 2026-03-01 21:43:32 -08:00
Kangyan-Zhou
ec9775491f Add bisect ci claude code skill (#19649) 
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
 2026-03-01 20:53:40 -08:00
Prozac614
57c5c343d7 [diffusion] model: support Hunyuan3D-2 (#18170) 
Co-authored-by: yingluosanqian <yingluosanqian@gmail.com>
Co-authored-by: daiweitao <dwti614707404@163.com>
Co-authored-by: Mick <mickjagger19@icloud.com>
 2026-03-02 12:28:05 +08:00
Yuan Luo
f6ee6dc8c3 [JIT-kernel] Add unit test for nsa indexer fused_store_k_cache (#19389) 
Co-authored-by: luoyuan.luo <luoyuan.luo@antgroup.com>
 2026-03-02 12:18:11 +08:00
Shangming Cai
0a6678bf3a [PD] Remove unused server args for disaggregation (#19618) 
Signed-off-by: Shangming Cai <csmthu@gmail.com>
 2026-03-02 11:38:50 +08:00
Henry
e5edf222cd [WIP]enable mxfp8 on nvidia sm120 (#19112) 
Co-authored-by: Your Name <you@example.com>
 2026-03-01 19:06:43 -08:00
shuwenn
e3e71f275a docs: refactor speculative decoding doc (#19186) 2026-03-01 22:03:20 -05:00
SoluMilken
20282f5664 [fix typo] expert_indicies -> expert_indices (#19627) 
Co-authored-by: ishandhanani <82981111+ishandhanani@users.noreply.github.com>
 2026-03-01 17:37:34 -08:00
zwang86
f51ddba131 feat: add FA4 SM90 paged KV decode support & update attention docs (#18442) 
Co-authored-by: Zeyu Wang <zeyu.wang@yahooinc.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: Brayden Zhong <b8zhong@uwaterloo.ca>
 2026-03-02 09:12:19 +08:00
Glen Liu
8a0b7575b0 [Test] add unit test for skipping already preempted request (#18912) 2026-03-01 15:44:15 -08:00
Kangyan-Zhou
98224de29b [Bugfix] Add missing auto_create_handle_loop to communicator methods (#19610) 
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
 2026-03-01 15:00:05 -08:00
SoluMilken
0b3ddbcf10 [fix typo] seperated_timestep -> separated_timestep (#19622) 2026-03-01 14:09:51 -08:00
Kangyan-Zhou
dc02e5bea7 [HiCache] Re-land spec v2 + decode KV cache offloading compatibility (#19615) 
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
 2026-03-01 13:58:31 -08:00
Ziang Li
0e86977811 [RL] Support per-layer mixed FP8/BF16 serving for FP8 checkpoints (#18742) 2026-03-01 21:59:22 +08:00
Mick
a75840b373 [diffusion] CI: create and refactor UT (#19619) 2026-03-01 19:38:20 +08:00
Brayden Zhong
80a6b32703 [Perf] Optimize NSA backend metadata under MTP (#19536) 
Co-authored-by: Baidu-AIAK <Baidu_AIAK@163.com>
Co-authored-by: zengpai <zengpai@baidu.com>
 2026-03-01 01:59:26 -08:00
Mick
d098c8dab0 [diffusion] add .claude and update contributing with attitude towards vibe-pr (#19511) 2026-03-01 14:41:55 +08:00
Bingxu Chen
5fa6633485 [AMD] Fix MoRI EP warmup hang by restoring deepep_mode=normal default (#19498) 2026-02-28 22:05:22 -08:00
Kangyan-Zhou
dcf462cfba Revert "[HiCache] Enable spec v2 + decode KV cache offloading compatibility" (#19613) 2026-02-28 21:54:32 -08:00
Kangyan-Zhou
8167346609 [HiCache] Enable spec v2 + decode KV cache offloading compatibility (#19518) 
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
 2026-02-28 21:53:52 -08:00
Yi Zhong
894e887e4a [Blackwell] Make mxint4 flashinfer_trtllm moe gemm set by default on blackwell (#18136) 
Signed-off-by: vincentzed <207368749+vincentzed@users.noreply.github.com>
 2026-03-01 05:21:01 +00:00
Jun Liu
38dc372dae [Bugfix] Fix KeyError: 'prompt_tokens' when streaming requests are aborted (#19514) 2026-02-28 20:21:35 -08:00
Zhang Yiyang (SII)
4ec450e97b [diffusion][MOVA] fix: fix task type in MOVA pipeline and shared model placement (#19489) 2026-03-01 12:13:15 +08:00
Liangsheng Yin
5acb45cf32 [Session] Extract SessionController and clean up session logic in Scheduler (#19547) 2026-02-28 19:47:44 -08:00