chenchenghao/sglang
1
0
Fork 0
Code Issues Pull Requests Actions 11 Packages Projects Releases Wiki Activity
10,192 Commits 1 Branch 0 Tags
53de53fb53f619ca267e61edde77458e070cd114
Commit Graph

1919 Commits

Author SHA1 Message Date
Leoyzen
da2a0240f7 Add GLM45 tool interruption support (#17714) 
Co-authored-by: Sisyphus <clio-agent@sisyphuslabs.ai>
 2026-03-02 19:34:12 +08:00
fzyzcjy
7579ab3f33 Enhance error resilience in dump comparator (#19685) 2026-03-02 19:08:35 +08:00
fzyzcjy
e5ef845cad Support multiple verbosity in dump comparator (#19684) 2026-03-02 18:47:30 +08:00
fzyzcjy
3dd4649b42 Beautify text output in dump comparator (#19683) 2026-03-02 18:47:01 +08:00
fzyzcjy
5bf3deb4bc Trace execution information in dump comparator (#19682) 2026-03-02 18:46:27 +08:00
fzyzcjy
3ebd85bf1c Enhance sglang engine dumping tests in dump comparator (#19681) 2026-03-02 18:46:03 +08:00
fzyzcjy
abdc0ee71f Support directory detection in dump comparator (#19680) 2026-03-02 18:45:35 +08:00
fzyzcjy
6980416149 Support non orthogonal parallel axes and explicit replication annotation in dump comparator (#19679) 2026-03-02 18:44:33 +08:00
fzyzcjy
a70dd11011 Support flattened dims in dump comparator (#19678) 2026-03-02 18:43:01 +08:00
fzyzcjy
15e83eea61 Enhance replication check, matching pattern, logging in dump comparator (#19677) 2026-03-02 18:42:27 +08:00
fzyzcjy
ec44bc82ab Support presets and arbitrary skipping keys in dump comparator (#19676) 2026-03-02 18:41:49 +08:00
jacky.cheng
98f47d8175 [AMD] Add Qwen3-Coder-Next accuracy and functionality test scripts for MI35x 8-GPU (#18608) 2026-03-01 23:52:47 -08:00
Ke Bao
4726073865 Fix mamba2 mixer ci test (#19658) 2026-03-02 14:55:15 +08:00
Baidu-AIAK
922aad2faa Cleanup disagg decode prebuilt flow and add cross-stream sync in merge_batch (#19568) 
Co-authored-by: vincent <vincent@vincentdeMacBook-Pro.local>
Co-authored-by: hnyls2002 <lsyincs@gmail.com>
Co-authored-by: Liangsheng Yin <hnyls2002@gmail.com>
 2026-03-01 21:52:27 -08:00
sglang-bot
0e53cee1f6 [CI] Disable test_lora_tp CUDA CI during H100 to H200 transition (#19654) 2026-03-01 21:43:32 -08:00
Glen Liu
8a0b7575b0 [Test] add unit test for skipping already preempted request (#18912) 2026-03-01 15:44:15 -08:00
Kangyan-Zhou
dc02e5bea7 [HiCache] Re-land spec v2 + decode KV cache offloading compatibility (#19615) 
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
 2026-03-01 13:58:31 -08:00
Kangyan-Zhou
dcf462cfba Revert "[HiCache] Enable spec v2 + decode KV cache offloading compatibility" (#19613) 2026-02-28 21:54:32 -08:00
Kangyan-Zhou
8167346609 [HiCache] Enable spec v2 + decode KV cache offloading compatibility (#19518) 
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
 2026-02-28 21:53:52 -08:00
fzyzcjy
e64095c3c7 Support data parallel attention in dump comparator (#19602) 2026-03-01 10:51:21 +08:00
fzyzcjy
ea6ff7b01f Support multi sharding group on the same dimension in dump comparator (#19601) 2026-03-01 10:36:48 +08:00
fzyzcjy
46960e65cf Add skip patterns, tee to file, tensor load warning in dump comparator (#19600) 2026-03-01 10:36:22 +08:00
fzyzcjy
b0b26a7ef1 Support concat mode in token aligner in dump comparator (#19599) 2026-03-01 10:35:50 +08:00
fzyzcjy
e78f1283f7 Support overriding and post-hoc providing metadata in dump comparator (#19598) 2026-03-01 10:35:06 +08:00
fzyzcjy
e41164af1c Enhance replicated tensor checker in dump comparator (#19597) 2026-03-01 10:34:34 +08:00
fzyzcjy
ec08240a6a Support data parallel in dump comparator (#19596) 2026-03-01 10:34:03 +08:00
fzyzcjy
003ad6daaa Support partial tensors waiting for reduction and pipeline parallel in dump comparator (#19595) 2026-03-01 10:33:39 +08:00
fzyzcjy
67810828cf Visualize per-token information in dump comparator (#19594) 2026-03-01 10:32:59 +08:00
fzyzcjy
f5a10e04cd Support arbitrary filtering in dumper (#19593) 2026-03-01 10:31:21 +08:00
Mohammad Miadh Angkad
9c81ce4707 [Anthropic API] Preserve image content in tool_result conversion (#19233) 
Co-authored-by: Xinyuan Tong <115166877+JustinTong0323@users.noreply.github.com>
 2026-02-28 12:07:22 -08:00
zhangheng
a0d8a7ae6d [RadixTree][6/N Refactor]: Refactor SWARadixTree to simplify the computation and alignment of bigram keys. (#19427) 2026-02-28 20:01:39 +08:00
fzyzcjy
5705e02d28 Support singleton dimension squeezing in dump comparator (#19566) 2026-02-28 18:11:46 +08:00
fzyzcjy
80bbd30909 Visualize comparison detailed results in dump comparator (#19565) 2026-02-28 18:08:16 +08:00
fzyzcjy
40facdb28c Handle recompute and verify closeness in dumper (#19564) 2026-02-28 18:07:44 +08:00
fzyzcjy
63a4778542 Support non-intrusive arbitrary dumping in dumper and add e2e tests (#19563) 2026-02-28 18:06:55 +08:00
fzyzcjy
4097eb5ce9 Support patching source code (#19561) 2026-02-28 18:05:45 +08:00
fzyzcjy
b73aa53d7e Enhance metrics in dump comparator (#19560) 2026-02-28 18:05:19 +08:00
fzyzcjy
706ab9296a Support method decorator for tagging and add minimalistic comparator in dumper (#19559) 2026-02-28 18:04:54 +08:00
fzyzcjy
9bf3638a25 Support handling arbitrary objects in dump comparator (#19558) 2026-02-28 18:04:13 +08:00
Cherry_ming
1eb40d8d45 [NPU]Optimize the PR pipeline to reduce E2E runtime (#18767) 
Co-authored-by: Sugar920 <121632458+Sugar920@users.noreply.github.com>
 2026-02-28 17:06:03 +08:00
Zheng Duan
a2ea5941d5 [feat] Support nvfp4 quantized model of Qwen3-Next (#17627) 2026-02-27 18:28:47 -08:00
Liangsheng Yin
e08ef06758 [Session] Gate streaming sessions with --enable-streaming-session and spec v2 guard (#19531) 2026-02-27 18:14:55 -08:00
Yuwei An
8c0f2d40bd [CI] Nutanix LoRA adapter removed from HuggingFace (#19533) 
Signed-off-by: Oasis-Git <ayw.sirius19@gmail.com>
 2026-02-27 17:46:24 -08:00
Aurick Qiao
c6cb0c9649 [Session] Add streaming mode with SessionAwareCache fast path (#19171) 
Co-authored-by: hnyls2002 <lsyincs@gmail.com>
 2026-02-27 16:31:08 -08:00
Alison Shao
2bd2b60b5c [CI] Disable test_lora_update: Nutanix LoRA adapter removed from HuggingFace (#19527) 
Co-authored-by: Alison Shao <alisonshao@MacBook-Pro-D2W773R9CD.local>
 2026-02-27 15:38:19 -08:00
Alison Shao
6ca7da3e7c Fix nightly VLM accuracy: gemma3n TP fixes + removal, latency thresholds (#19401) 
Co-authored-by: Alison Shao <alisonshao@MacBook-Pro-D2W773R9CD.local>
 2026-02-27 14:24:02 -08:00
Baizhou Zhang
776709efe8 [3/n] deepseek_v2.py Refactor: Migrate MLA forward method in deepseek_v2.py (#19122) 2026-02-27 13:37:29 -08:00
Michael
1b79934d34 [AMD] Fix AMD CI test of TestToolChoiceLfm2Moe (#19113) 
Co-authored-by: michaelzhang-ai <michaelzhang-ai@users.noreply.github.com>
Co-authored-by: bingxche <Bingxu.Chen@amd.com>
Co-authored-by: yctseng0211 <yctseng@amd.com>
 2026-02-27 10:18:15 -08:00
Michael
403195d59d [AMD] [MiniMax-M2.5 Day 0] Add MiniMax-M2.5 nightly accuracy test (#19443) 2026-02-27 02:39:33 -08:00
ympcMark
43fade5f69 [4/N] (Elastic EP) Back up Expert Weights in DRAM (#17374) 
Co-authored-by: UNIDY2002 <unidy2002@outlook.com>
 2026-02-27 15:59:13 +08:00