chenchenghao/sglang
1
0
Fork 0
Code Issues Pull Requests Actions 11 Packages Projects Releases Wiki Activity
11,116 Commits 1 Branch 0 Tags
47cb9b9d116d1c5c112e894110ec94de80f2db6b
Commit Graph

2261 Commits

Author SHA1 Message Date
fzyzcjy
f2d1b7c4ad Support sequence parallel and trivial dims in dump comparator (#19460) 2026-02-27 08:11:15 +08:00
fzyzcjy
eb2ada3804 Support non-packed format when aligning tokens in dump comparator (#19459) 2026-02-27 08:10:29 +08:00
fzyzcjy
e1e0cfd856 Use named tensors in dump comparator (#19458) 2026-02-27 08:09:55 +08:00
fzyzcjy
eb0e905fc3 Update token layout and cleanup printer in dump comparator (#19457) 2026-02-27 08:09:15 +08:00
fzyzcjy
8ac64e1487 Support unifying axis ordering in dump comparator (#19456) 2026-02-27 08:08:32 +08:00
fzyzcjy
425d333ee3 Support token dim in arbitrary location in dump comparator (#19455) 2026-02-27 08:07:38 +08:00
zhangheng
e4b708d3e9 [Spec V2] Support specV2 for mamba hybrid attention (#18808) 
Co-authored-by: Yi Zhong <207368749+vincentzed@users.noreply.github.com>
Co-authored-by: yizhang2077 <1109276519@qq.com>
Co-authored-by: Hanming Lu <hanming@x.ai>
 2026-02-27 00:36:01 +08:00
Alison Shao
e14fd4accb Fix nightly Mistral-Large-3 NVFP4 accuracy threshold (#19402) 
Co-authored-by: Alison Shao <alisonshao@MacBook-Pro-D2W773R9CD.local>
 2026-02-26 15:59:11 +08:00
Alison Shao
a0a8f1473c [Benchmark] Fix generated_shared_prefix attribute naming and remove args dependency (#19363) 
Co-authored-by: Alison Shao <alisonshao@Mac.attlocal.net>
Co-authored-by: sglang-bot <sglangbot@gmail.com>
 2026-02-25 18:45:54 -08:00
fzyzcjy
265eb56d44 Support multi-step alignment and pipeline integration in dump comparator (#19378) 2026-02-26 10:23:22 +08:00
fzyzcjy
f9a2f0398f Support token aligner planning and execution in dump comparator (#19377) 2026-02-26 10:04:33 +08:00
fzyzcjy
d34d5aca07 Support loading token aligner data in dump comparator (#19376) 2026-02-26 10:03:56 +08:00
fzyzcjy
e8dd14519d Add aligner entrypoint and bundle handler in dump comparator (#19375) 2026-02-26 10:03:22 +08:00
fzyzcjy
2739d7df62 Reorganize modules and pipeline in dump comparator (#19374) 2026-02-26 10:00:13 +08:00
fzyzcjy
508b8e3387 Handle warnings via sink for structured output and add pair in dump comparator (#19373) 2026-02-26 09:59:15 +08:00
fzyzcjy
46321ee70e Support dumping rid for correlation across passes in dump comparator (#19372) 2026-02-26 09:57:57 +08:00
Daniel Cámpora
350190487b Flashinfer MOE FP8 support for Mistral Large 3. (#15422) 
Co-authored-by: elvischenv <219235043+elvischenv@users.noreply.github.com>
 2026-02-25 15:00:37 -08:00
Alison Shao
cc1ca61c81 fix: add --cuda-graph-max-bs to DSV3 FA3 FP8 KV cache test (#19307) 2026-02-25 10:27:31 -08:00
mqhc2020
307a2b73ed [AMD] add testcases for Qwen3 235b Instruct 2507 models (#18805) 
Co-authored-by: bingxche <Bingxu.Chen@amd.com>
 2026-02-25 02:17:52 -08:00
xutizhou
a1b39c1c26 Perf/fuse mamba state scatter mtp verify (#18088) 2026-02-25 15:40:55 +08:00
Hubert Lu
17b0affbdf [AMD] Support --enable-aiter-allreduce-fusion on AMD GPUs (#13747) 
Co-authored-by: yctseng0211 <yctseng@amd.com>
 2026-02-24 23:11:55 -08:00
Liangsheng Yin
539f772f54 [PD-Disagg] Fully support external DP dispatch w/ PD-disaggregation mode. (#19268) 
Co-authored-by: Ratish P <114130421+ratish1@users.noreply.github.com>
 2026-02-24 19:58:01 -08:00
Michael
23adb50751 [AMD] [GLM-5 Day 0] Add GLM-5 nightly test (#18911) 2026-02-24 19:39:17 -08:00
Feng Su
3b89302277 Refactor: observability code cleanup (#17862) 
Signed-off-by: Feng Su <sufeng@linux.alibaba.com>
 2026-02-24 18:07:29 -08:00
fzyzcjy
b7af58b9af Support replication axis in dump comparator (#19282) 2026-02-25 09:48:43 +08:00
fzyzcjy
2e2b18e870 Support context parallel zigzag reordering in dump comparator (#19281) 2026-02-25 09:46:17 +08:00
fzyzcjy
0de1f4b07b Support multi axis unsharding in dump comparator (#19280) 2026-02-25 09:44:07 +08:00
fzyzcjy
4bb678f28a Full test coverage in dump comparator (#19279) 2026-02-25 09:43:29 +08:00
fzyzcjy
94ca2ac5d7 Support TP unification and enhance tests in dump comparator (#19278) 2026-02-25 09:42:56 +08:00
fzyzcjy
39ba9b5ab5 Support simple unsharding in dumper comparator (#19277) 2026-02-25 09:42:21 +08:00
fzyzcjy
02ca107b2c Support dims annotation and enhance dump loader in dumper (#19276) 2026-02-25 09:41:48 +08:00
fzyzcjy
8b1ab4aaf9 Support agent-friendly output formats in dump comparator (#19275) 2026-02-25 09:40:33 +08:00
fzyzcjy
d7578ce279 Implement simplest dump comparator v2 (#19274) 2026-02-25 09:37:21 +08:00
Alison Shao
750ecf4a45 Add server CUDA graph warmup CI step for cold H200 nodes (#19201) 2026-02-24 16:07:01 -08:00
Kaiqi Jin
152560d1b9 [PCG] add pcg CI test for gpt-oss model (#18961) 2026-02-24 15:32:34 -08:00
Ratish P
ae6f6e1495 [Refactor] Benchmark: Add typed DatasetArgs/Loader registry and CPU dataset unit tests (#19147) 
Co-authored-by: Liangsheng Yin <lsyincs@gmail.com>
 2026-02-24 12:22:01 -08:00
Yuan Luo
31c7dc9d99 [VLM] Introduce FlashInfer CUDNN Prefill as ViT Backend (#19003) 
Co-authored-by: luoyuan.luo <luoyuan.luo@antgroup.com>
 2026-02-24 19:49:22 +08:00
xdtbynd
1a83b2c15d fix: fix the bug blocking completion template application (#17010) 
Co-authored-by: xdtbynd <supercluster@vip.qq.com>
Co-authored-by: cy <chenyang08056032@163.com>
Co-authored-by: sglang-npu-bot <sglangnpu@163.com>
 2026-02-24 18:50:08 +08:00
Liangsheng Yin
9fac90d85d [CI] Tiny enhance the dp attention load blance benchmark (#19194) 2026-02-23 14:33:32 -08:00
Liangsheng Yin
2274bfebb1 [PD-Disagg] Support query dp rank from bootstrap server. (#19168) 
Signed-off-by: Chang Huaixin (OpenAnolis) <changhuaixin@linux.alibaba.com>
Co-authored-by: Chang Huaixin (OpenAnolis) <changhuaixin@linux.alibaba.com>
 2026-02-23 10:59:30 -08:00
fzyzcjy
1a1c768d44 Support kwargs and megatron core tensor parsing in dumper (#19138) 2026-02-22 16:24:33 +08:00
Ziang Li
eddf193292 [DSv32] [GLM5] Improve Model Quality by Avoiding FP32 Precision Loss in weights_proj (#19041) 2026-02-22 16:20:51 +08:00
fzyzcjy
326b788ab4 Fix wrongly large dumped file and handle non intrusive hook reset in dumper (#19124) 2026-02-22 16:20:08 +08:00
fzyzcjy
c1f497e20e Enhance reset, states, http in dumper (#19095) 2026-02-22 16:17:41 +08:00
fzyzcjy
4091b720c5 Support multi colocated dumper, named exp cleanup, argparse config (#19094) 2026-02-22 16:16:15 +08:00
fzyzcjy
31f0c11405 Configure and call dumper in main SGLang logic (#19093) 2026-02-22 16:14:27 +08:00
fzyzcjy
cc63c99f11 Enhance hook mechanism in dumper (#19073) 2026-02-22 16:13:38 +08:00
fzyzcjy
fdf80b5031 Extract framework plugins in dumper (#19072) 2026-02-22 16:10:43 +08:00
fzyzcjy
e32b5364a2 Auto annotate context in dumper (#19071) 2026-02-22 16:08:48 +08:00
fzyzcjy
8bc0751376 Support enabling partial non intrusive dump in dumper (#19069) 2026-02-22 16:07:45 +08:00