chenchenghao/sglang
1
0
Fork 0
Code Issues Pull Requests Actions 11 Packages Projects Releases Wiki Activity
9,931 Commits 1 Branch 0 Tags
fcfd964d7d774433bb1d46b2250914fb8e1e0788
Commit Graph

6472 Commits

Author SHA1 Message Date
GMI Xiao Jin
fcfd964d7d [diffusion] model: LTX-2 Support PR3 (#19151) 2026-02-24 16:55:28 +08:00
Simo Lin
88a7e48108 fix(grpc): handle embedding requests in _handle_batch_output (#19221) 
Signed-off-by: Simo Lin <linsimo.mark@gmail.com>
 2026-02-23 22:32:16 -08:00
Mick
2e053d6eb6 [diffusion] quant: support quant for all dits (#19156) 
Co-authored-by: zyzshishui <zyzshishui@gmail.com>
 2026-02-24 14:20:54 +08:00
fy
4f25a48d7a support xverse_moe on npu 
Co-authored-by: sglang-npu-bot <sglangnpu@163.com>
 2026-02-24 14:11:20 +08:00
Liangsheng Yin
5e80027ac7 [PD-Disagg] Support FAKE transfer backend for more cases (#19215) 2026-02-23 20:50:43 -08:00
jianzhao-xu
d8ef33a551 bugfix: prioritize init_npu_backend to fix various initialization bugs (#17652) 2026-02-24 12:25:20 +08:00
Liangsheng Yin
feb041f4e5 [PD-Disagg] Improve type hints across all conn.py (#19208) 2026-02-23 19:44:23 -08:00
Liangsheng Yin
ea7ef63e6d [PD-Disagg] Deduplicate common KVManager methods into CommonKVManager (#19205) 
Co-authored-by: Shangming Cai <csmthu@gmail.com>
 2026-02-23 18:34:21 -08:00
Kangyan-Zhou
8aeb16f3fc fix: add missing blank line after docstring in serving_transcription.py (#19206) 
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
 2026-02-23 18:29:38 -08:00
Xinyuan Tong
581bf53e03 Whisper model support & /v1/audio/transcriptions endpoint & benchmark (#16983) 
Signed-off-by: Xinyuan Tong <xinyuantong.cs@gmail.com>
Co-authored-by: MahmoudAshraf97 <hassouna97.ma@gmail.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
 2026-02-23 17:28:37 -08:00
Liangsheng Yin
d160c5b9bb [PD-Disagg] Unify prefill info data transition flow, all with PrefillServerInfo (#19195) 2026-02-23 16:15:20 -08:00
Liangsheng Yin
9fac90d85d [CI] Tiny enhance the dp attention load blance benchmark (#19194) 2026-02-23 14:33:32 -08:00
Liangsheng Yin
2aa3fe394e [CI] fix the teardown output of disaggregation test (#19193) 
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
 2026-02-23 12:41:03 -08:00
Liangsheng Yin
2274bfebb1 [PD-Disagg] Support query dp rank from bootstrap server. (#19168) 
Signed-off-by: Chang Huaixin (OpenAnolis) <changhuaixin@linux.alibaba.com>
Co-authored-by: Chang Huaixin (OpenAnolis) <changhuaixin@linux.alibaba.com>
 2026-02-23 10:59:30 -08:00
Linyu Wu
2cdde5d4ab [Kernel Slimming] Migrate AWQ marlin repack kernel to JIT (#18949) 
Co-authored-by: Xiaoyu Zhang <35585791+BBuf@users.noreply.github.com>
 2026-02-23 22:05:27 +08:00
Xiaoyu Zhang
e0e0cad6bc [Diffusion] Match rotary_embedding module name style (#19179) 2026-02-23 21:02:34 +08:00
Xiaoyu Zhang
2717393681 [Refactor] Split rotary_embedding.py into a modular package (#19144) 2026-02-23 20:05:29 +08:00
Junrong Lin
6448de7e96 Reorganize topk logic to clean up code and expose logical experts (#16945) 2026-02-23 00:30:57 -08:00
Yuzhen Zhou
4f3dc1ef5b [ROCm] Use unreg path for custom all-reduce during CUDA graph capture (#19162) 2026-02-22 23:27:31 -08:00
Changyi Yang
c3c1532820 [diffusion] feat: detect Flux2 custom VAE path from component_paths (#19170) 2026-02-23 15:19:53 +08:00
Qiaolin Yu
42b1019881 Fix bench_one_batch_server by moving the print statements (#19175) 2026-02-22 22:06:25 -08:00
Baizhou Zhang
2472e47d73 Revert "Refactor graph input buffers (#18991)" (#19173) 2026-02-23 13:09:54 +08:00
Baizhou Zhang
fa80b9beba [CI] Skip some subtests for tool call parser (#19172) 2026-02-23 12:20:12 +08:00
Ratish P
0e670c36d6 fix(diffusion): enforce strict input_reference validation for T2V (#14825) 
Co-authored-by: Xiaoyu Zhang <35585791+BBuf@users.noreply.github.com>
 2026-02-23 12:04:06 +08:00
Baizhou Zhang
43f83525c0 Revert "[AMD] support two batch overlapping for mori ep #17953" (#19161) 2026-02-23 01:19:23 +08:00
Mick
45095bac70 [diffusion] refactor: rename quantized model path server arg (#19142) 2026-02-22 23:18:35 +08:00
Talor Abramovich
c6a99e43b9 Fix corrupted JSONL metrics file due to concurrent writes (#19011) 2026-02-22 20:33:27 +08:00
Mick
7d4860bc5e [diffusion] CI: relax perf check threshold (#19154) 2026-02-22 20:02:12 +08:00
Mick
87823722b3 [diffusion] chore: minor cleanups (#19123) 2026-02-22 19:07:25 +08:00
fzyzcjy
1a1c768d44 Support kwargs and megatron core tensor parsing in dumper (#19138) 2026-02-22 16:24:33 +08:00
Ziang Li
eddf193292 [DSv32] [GLM5] Improve Model Quality by Avoiding FP32 Precision Loss in weights_proj (#19041) 2026-02-22 16:20:51 +08:00
fzyzcjy
326b788ab4 Fix wrongly large dumped file and handle non intrusive hook reset in dumper (#19124) 2026-02-22 16:20:08 +08:00
fzyzcjy
c1f497e20e Enhance reset, states, http in dumper (#19095) 2026-02-22 16:17:41 +08:00
fzyzcjy
4091b720c5 Support multi colocated dumper, named exp cleanup, argparse config (#19094) 2026-02-22 16:16:15 +08:00
fzyzcjy
31f0c11405 Configure and call dumper in main SGLang logic (#19093) 2026-02-22 16:14:27 +08:00
fzyzcjy
cc63c99f11 Enhance hook mechanism in dumper (#19073) 2026-02-22 16:13:38 +08:00
fzyzcjy
fdf80b5031 Extract framework plugins in dumper (#19072) 2026-02-22 16:10:43 +08:00
fzyzcjy
e32b5364a2 Auto annotate context in dumper (#19071) 2026-02-22 16:08:48 +08:00
fzyzcjy
8bc0751376 Support enabling partial non intrusive dump in dumper (#19069) 2026-02-22 16:07:45 +08:00
fzyzcjy
0384c459a7 Support non-intrusive dumping in dumper (#19068) 2026-02-22 16:04:02 +08:00
fzyzcjy
5eccc3cff9 Refactor dumper and change on_forward_pass_start API (#19065) 2026-02-22 16:03:27 +08:00
Shangming Cai
eccee4c48e [PD] Change bootstrap_room metadata dtype from int64 to uint64 (#19141) 2026-02-22 14:20:16 +08:00
YAMY
5995bfec63 [Qwen3-Next] Enable fused_qkvzba_split_reshape_cat also for prefill (#18917) 2026-02-22 13:57:17 +08:00
Qiaolin Yu
8cf003c44b Fix spec v2+dp attention in nsa backend (#19134) 2026-02-22 13:46:15 +08:00
Bhavneek Singh
8612358ee9 [BUG] [DLLM] Missing max_running_requests value (#18740) 2026-02-22 13:38:56 +08:00
fy1214
ae62898ffb [diffusion] quant: adapt FP8 linear to sgld and support quant in flux (#17023) 
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: Mick <mickjagger19@icloud.com>
 2026-02-22 12:55:28 +08:00
YAMY
cef353f338 [Fix] Quick fix for int32 overflow in Mooncakes' send_kvcache_slice (#19076) 2026-02-22 12:00:33 +08:00
Liangsheng Yin
4653939cda Revert "[jit kernel] Support per_token_group_quant_8bit jit kernel" (#19131) 2026-02-22 07:54:24 +08:00
Liangsheng Yin
1f2da824dd [Benchmark] Remove re-exports from bench_serving.py (#19130) 2026-02-21 14:30:30 -08:00
Ratish P
f158869c2c [Refactor] Benchmark Phase 1: extract utils and datasets from bench_serving (#19077) 
Co-authored-by: Xuchun Shang <107600043+xucsh@users.noreply.github.com>
 2026-02-21 13:50:11 -08:00