Mick
|
5639145fac
|
diffusion: reduce effort of supporting new model (#12982)
|
2025-11-10 21:20:33 +08:00 |
|
ShawnKung
|
afee2843d5
|
feat(metrics): add scheduler and hiradix cache metrics (#10218) (#10225)
Co-authored-by: Zhiqiang Xie <xiezhq@stanford.edu>
|
2025-11-10 18:14:47 +08:00 |
|
Zhihao Zhang
|
6f08488042
|
fix missing output_token_logprobs when using ngram speculative decoding (#10702)
Co-authored-by: a4zhangfei <a4zhangfei@qq.com>
|
2025-11-10 02:04:42 -08:00 |
|
syy-hw
|
611a4fd08b
|
[router] bucket policy (#11719)
|
2025-11-10 02:02:53 -08:00 |
|
Lianmin Zheng
|
9ea2c686c7
|
[Auto Sync] Update batch_invariant_ops.py (20251109) (#12916)
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: Stefan He <hebiaobuaa@gmail.com>
|
2025-11-10 01:51:39 -08:00 |
|
PiteXChen
|
e2a784ecda
|
[RadixTree] Reduce Syscalls, Optimize Collection Filtering and Align with cpp (#12239)
Signed-off-by: CLFutureX <chenyongqyl@163.com>
|
2025-11-10 17:47:59 +08:00 |
|
Xiaoyu Zhang
|
05559a4a90
|
Support hidden_dim % 4 == 0 in per_token_quant_fp8 (#12883)
|
2025-11-10 17:13:14 +08:00 |
|
Neelabh Sinha
|
7bffc5dc25
|
[Fix] Add validation for served model name to reserve : for LoRA adapter syntax (#12912)
Co-authored-by: neelabhsinha <neelabhsinha97@gmail.com>
|
2025-11-09 23:42:02 -08:00 |
|
huangtingwei
|
a5e5088dfb
|
Fix errors of page head kernels in sgl-kernel for ROCm (#12604)
|
2025-11-10 15:15:50 +08:00 |
|
Xuchun Shang
|
ac19ce7efb
|
[PP] put pp assert in model runner (#12934)
Signed-off-by: Xuchun Shang <xuchun.shang@gmail.com>
|
2025-11-10 14:58:19 +08:00 |
|
Mick
|
95876d75cb
|
chore: include a minimum image for vlms when warming-up (#9528)
|
2025-11-10 14:56:59 +08:00 |
|
sglang-bot
|
a30f190762
|
chore: bump sgl-kernel version to 0.3.17 (#12931)
|
2025-11-10 14:54:02 +08:00 |
|
Liangsheng Yin
|
dc8a5a1ce7
|
[Refactor / Style] Unify all event loops (except for PP) (#12959)
|
2025-11-10 14:49:12 +08:00 |
|
Mick
|
e123648b36
|
diffusion: fix wan-2.2-TI2V and support sp (#12926)
|
2025-11-10 14:37:57 +08:00 |
|
kk
|
90401cf7d2
|
Fix the run-time error when calling fused_rms_mxfp4_quant that change return output number (#12803)
Co-authored-by: wunhuang <wunhuang@amd.com>
|
2025-11-09 21:48:36 -08:00 |
|
Atream
|
9cfe78dd30
|
clean redundant code in previous PR (#12957)
|
2025-11-09 21:40:32 -08:00 |
|
Mick
|
307e7a6128
|
diffusion: fix detected file changes rule in CI (#12943)
|
2025-11-10 13:37:16 +08:00 |
|
Atream
|
ddd1440d0f
|
Refactor KTransformers heterogeneous compute with unified GPU-quantization backend (#12834)
Co-authored-by: Chen Hongtao <56470055+chenht2022@users.noreply.github.com>
Co-authored-by: chenht2022 <cht22@mails.tsinghua.edu.cn>
Co-authored-by: skqliao <skqliao@gmail.com>
Co-authored-by: ovowei <1913953267@qq.com>
|
2025-11-09 21:06:32 -08:00 |
|
Edwin Gao
|
d1be60c3c5
|
[Refactor] rename set_index_k_and_scale_buffer to set_index_k_scale_b… (#12956)
|
2025-11-09 20:35:19 -08:00 |
|
Adarsh Shirawalmath
|
583bb1804e
|
[Docs] Add docs for Qwen3-VL image and video support (#12554)
Co-authored-by: Ubuntu <azureuser@athena.w2cgneqjjboeneyk2w5mje3jyf.bx.internal.cloudapp.net>
|
2025-11-10 12:16:04 +08:00 |
|
MMuzzammil1
|
1f2a6c691b
|
Bugfix: LMCache Connector with Sglang (#12946)
Signed-off-by: Mohd Muzzammil <me.muzzammil@samsung.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
|
2025-11-10 12:13:37 +08:00 |
|
Liangsheng Yin
|
61c7fe7aed
|
Minor code cleanup / improvement for PREBUILT_EXTEND mode (#12948)
|
2025-11-10 11:59:54 +08:00 |
|
Mick
|
83f89cc615
|
diffusion: skip full CI suite for multimodal_gen changes (#12940)
|
2025-11-10 10:46:24 +08:00 |
|
Ke Bao
|
db24d34603
|
Support piecewise cuda graph for MLA (#11812)
|
2025-11-10 09:13:48 +08:00 |
|
ishandhanani
|
885cfca273
|
ci: try to fix gpg error during kernel build (#12928)
|
2025-11-09 11:45:29 -08:00 |
|
Liangsheng Yin
|
4e916f9840
|
[lint] tiny fix unimported packages. (#12927)
|
2025-11-10 00:59:10 +08:00 |
|
Liangsheng Yin
|
4f65a64666
|
Refactor / Unify event loop across PD-Disagg, Overlap, DP-Attn cases (#12839)
Co-authored-by: cctry <17473714+cctry@users.noreply.github.com>
|
2025-11-10 00:42:50 +08:00 |
|
Mick
|
f5b3ccd9a5
|
feat: basic support for server-level multimodal cache (#10775)
|
2025-11-10 00:27:50 +08:00 |
|
Ke Bao
|
bb00e24f87
|
Adjust server launch time in ci (#12917)
|
2025-11-09 20:41:29 +08:00 |
|
Liangsheng Yin
|
210a9cab6d
|
[CI] Fix matrix.part in pr-test. (#12920)
|
2025-11-09 18:53:18 +08:00 |
|
Teng Ma
|
b8ac4fcb51
|
[PD] feat: refactor custom mem pool and add barex pd support (#12332)
|
2025-11-09 18:51:34 +08:00 |
|
Liangsheng Yin
|
877cb52840
|
[CI] increase ut buckets & adjust estimation time. (#12919)
|
2025-11-09 18:17:50 +08:00 |
|
Zijian Zhang
|
3633f8b0cf
|
Add Jet-Nemotron (#12448)
|
2025-11-09 01:32:47 -08:00 |
|
Kangyan-Zhou
|
93cf60fc64
|
Fix Deepseek nightly tests (#12906)
|
2025-11-09 00:26:06 -08:00 |
|
Ke Bao
|
b5e0417392
|
Add kimi k2 thinking to ci (#12907)
|
2025-11-09 16:10:32 +08:00 |
|
Minglei Zhu
|
8a821af793
|
fallback to triton mm_persistent kernel when deepGemm fail (#12911)
|
2025-11-08 23:42:26 -08:00 |
|
Kangyan-Zhou
|
4b1d163bfd
|
Add HF cleanup logic in ci_install_dependency.sh (#12895)
|
2025-11-08 22:56:25 -08:00 |
|
Kangyan-Zhou
|
c21a3ec299
|
Fix duplicate nightly test name (#12905)
|
2025-11-08 21:38:48 -08:00 |
|
Ke Bao
|
b142831a26
|
Fix empty server args in marlin moe test (#12904)
|
2025-11-09 13:30:47 +08:00 |
|
Kangyan-Zhou
|
d134096319
|
Add Deepseek models into nightly tests (#12865)
|
2025-11-09 13:17:49 +08:00 |
|
Qiaolin Yu
|
f290e8016e
|
Revert "Fix spec decoding acc length for dpsk-r1-fp4 tp8" (#12900)
|
2025-11-08 20:42:42 -08:00 |
|
Qiaolin Yu
|
9299a62fcb
|
Fix spec decoding acc length for dpsk-r1-fp4 tp8 (#12896)
|
2025-11-08 19:55:45 -08:00 |
|
Liangsheng Yin
|
49543be9da
|
Tiny simplify can_run_dp_cuda_graph gather logic (#12891)
|
2025-11-09 11:15:36 +08:00 |
|
Ke Bao
|
5236290399
|
Update CODEOWNERS (#12897)
|
2025-11-09 09:37:11 +08:00 |
|
sglang-bot
|
b2b26d4324
|
chore: bump sgl-kernel version to 0.3.16.post6 (#12889)
|
2025-11-09 09:16:28 +08:00 |
|
alisonshao
|
d3a03aeef8
|
Refs/heads/add nightly test multi gpu configs (#12870)
|
2025-11-08 15:14:50 -08:00 |
|
Baizhou Zhang
|
5f02b918ec
|
[Fix] Fix trtllm-mla backend when chunked prefix cache is disabled (#12361)
|
2025-11-08 15:10:25 -08:00 |
|
b8zhong
|
49653c8896
|
use fast stream instead of torch.cuda.current_stream in llama 4 shared experts overlap (#12811)
|
2025-11-08 15:04:37 -08:00 |
|
Ke Bao
|
44f594d832
|
Apply moe_reduce_sum kernel for fused_marlin_moe (#12888)
|
2025-11-09 01:31:05 +08:00 |
|
fzyzcjy
|
2b6c4257a0
|
Fix sending all requests to the first rank in DP attention (#12832)
|
2025-11-09 00:18:53 +08:00 |
|