|
90a0133515
|
[Auto Sync] Update http_server.py, io_struct.py, scheduler_... (20251120) (#13679)
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: Zhuqi Li <zhli@x.ai>
|
2025-11-20 23:17:15 -08:00 |
|
|
|
fb04d43428
|
[kimi k2 thinking] Avoid useless torch.zeros_ (#13596)
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
|
2025-11-21 13:15:27 +08:00 |
|
|
Xiaoyu Zhang
|
dc69462456
|
[CI fix] Fix image download failures in VLM CI tests (#13613)
|
2025-11-20 11:18:06 +08:00 |
|
|
Liangsheng Yin
|
196b940aed
|
[3/N] CI refactor: move some manually triggered tests. (#13448)
|
2025-11-19 23:06:53 +08:00 |
|
|
Kangyan-Zhou
|
c0d1a3383b
|
Remove jet-ai/Jet-Nemotron-2B in nightly text tests as this is constantly failing (#13540)
|
2025-11-18 13:58:16 -08:00 |
|
|
Binyao Jiang
|
90c18a16cb
|
[GLM4.6v] Required changes for bumping up to transformer 5.x (#13229)
|
2025-11-18 10:58:00 +08:00 |
|
|
Vedant V Jhaveri
|
aac07bf7fd
|
[Embeddings Performance Testing] Add performance test for embedding models (#12359)
|
2025-11-17 15:35:18 -08:00 |
|
|
Liangsheng Yin
|
6042010964
|
[2/N] CI refactor: sperate some backend-independent CPU tasks. (#13447)
|
2025-11-18 02:08:19 +08:00 |
|
|
Liangsheng Yin
|
ab63f3c50b
|
[1/N] CI refactor: introduce CI register. (#13345)
|
2025-11-17 12:21:20 +08:00 |
|
|
Lifu Huang
|
254f62d879
|
Support spec decoding when LoRA is applied to target model (#12903)
|
2025-11-16 13:20:23 -08:00 |
|
|
|
e4b2937017
|
[AMD] Add AITER Custom All-Reduce (#13102)
Co-authored-by: Brayden Zhong <b8zhong@uwaterloo.ca>
Co-authored-by: HaiShaw <hixiao@gmail.com>
|
2025-11-12 21:53:44 -08:00 |
|
|
Lianmin ZhengandStefan He
|
d646cf6347
|
[Auto Sync] Update test_deterministic.py (20251112) (#13128)
Co-authored-by: Stefan He <hebiaobuaa@gmail.com>
|
2025-11-12 11:12:23 -08:00 |
|
|
Qi YuhangandFan Yin
|
7ea5b42d70
|
[sgl-kernel][5/N]Support Expert Specialization Grouped GEMM (#12666)
Co-authored-by: Fan Yin <1106310035@qq.com>
|
2025-11-11 21:23:25 -08:00 |
|
|
Liangsheng Yin
|
1086473111
|
Enhance retract test (page cases, long output cases) (#12781)
|
2025-11-11 03:03:26 +08:00 |
|
|
fzyzcjy
|
b0ee99dd03
|
Super tiny fix typo (#13001)
|
2025-11-11 00:47:45 +08:00 |
|
|
Zijian Zhang
|
3633f8b0cf
|
Add Jet-Nemotron (#12448)
|
2025-11-09 01:32:47 -08:00 |
|
|
Ke Bao
|
b142831a26
|
Fix empty server args in marlin moe test (#12904)
|
2025-11-09 13:30:47 +08:00 |
|
|
alisonshao
|
d3a03aeef8
|
Refs/heads/add nightly test multi gpu configs (#12870)
|
2025-11-08 15:14:50 -08:00 |
|
|
Jonah Bernard
|
bc25ea6762
|
[MoE] Add Comprehensive MoE Integration Tests (#12090)
|
2025-11-07 00:34:46 -08:00 |
|
|
Lianmin Zheng
|
c7d57d5bb3
|
Fix CI and style (#12658)
|
2025-11-05 15:08:15 -08:00 |
|
|
Kaixi Hou
|
141278048e
|
[NVIDIA] Fix unit test of MoE and add it to nightly ci (#12709)
|
2025-11-05 14:33:18 -08:00 |
|
|
Glen Liu
|
cbf23dbbfa
|
[Feature] add --lora-request-distribution arg to bench_serving.py and support skewed and distinct workloads (#12175)
|
2025-11-04 21:41:40 -08:00 |
|
|
Kaixi Hou
|
0711d1509b
|
[NVIDIA] Fix cutedsl backend of MoE (#12353)
|
2025-11-04 18:54:55 -08:00 |
|
|
Liangsheng Yin
|
aa797d013d
|
[Test] Merge all constrained decoding tests. (#12633)
|
2025-11-05 00:43:06 +08:00 |
|
|
akhilg-nv
|
e607850fcf
|
Enable mixed type LayerNorm kernel for NSA indexer (#12044)
|
2025-11-03 16:50:41 -08:00 |
|
|
Jonah Bernard
|
6ef23b9833
|
[Test] Add parameters to SRTRunner (#12227)
|
2025-11-03 11:20:56 -08:00 |
|
|
Ho-Ren (Jack) ChuangandYichen Wang
|
76196b3cbf
|
feat: Add FP4 (E2M1) KV Cache Support with Quantization Utilities for MLA (#10078)
Signed-off-by: Ho-Ren (Jack) Chuang <horenchuang@bytedance.com>
Co-authored-by: Yichen Wang <yichen.wang@bytedance.com>
|
2025-11-01 22:24:58 -07:00 |
|
|
Johnsonms
|
6f858930c8
|
[Bug] test_flashattn_mla_backend errors in Hopper #12487 (#12488)
|
2025-11-01 18:28:06 -07:00 |
|
|
Liangsheng YinandLianmin Zheng
|
300b4c212e
|
[CI] fix possible port conflicts. (#12452)
Co-authored-by: Lianmin Zheng <15100009+merrymercy@users.noreply.github.com>
|
2025-10-31 17:20:20 +08:00 |
|
|
Liangsheng Yin
|
73dfd2dfb1
|
[Test] Enhance radix cache test for spec cases (#12394)
|
2025-10-30 18:46:28 +08:00 |
|
|
Kangyan-ZhouandClaude
|
2b71531a70
|
Allow benchmarking tool to handle empty response (#12174)
Co-authored-by: Claude <noreply@anthropic.com>
|
2025-10-29 20:26:23 -07:00 |
|
|
Rain H
|
750940ae36
|
Eagle3 DP attention for Qwen3 MoE (#12002)
|
2025-10-29 20:25:17 +08:00 |
|
|
Lifu Huang
|
ce832d7034
|
Add env var to control custom Triton kernel cache and set CSGMV as default backend. (#12176)
|
2025-10-27 17:49:32 -07:00 |
|
|
satyamk7054andSatyam Kumar
|
9fc3e8aac7
|
Add support for Matryoshka embeddings (#126) (#11142)
Co-authored-by: Satyam Kumar <satyamk@linkedin.com>
|
2025-10-28 02:49:36 +08:00 |
|
|
Weiwei
|
caa4819bfc
|
Add support for AutoRound quantized models (#10153)
|
2025-10-27 18:17:29 +08:00 |
|
|
|
ea13cb1452
|
[Auto Sync] Update test_deterministic.py, test_deterministi... (20251024) (#12083)
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: Stefan He <hebiaobuaa@gmail.com>
|
2025-10-24 22:28:01 -07:00 |
|
|
fzyzcjy
|
d7056c5236
|
Enhance tests in deterministic kernels (#12070)
|
2025-10-25 08:53:22 +08:00 |
|
|
fzyzcjy
|
2342605ef0
|
Tiny cleanup send_single (#12056)
|
2025-10-23 23:53:42 -07:00 |
|
|
|
770529a731
|
model: support deepseek-ocr (#11891)
Co-authored-by: yhyang201 <47235274+yhyang201@users.noreply.github.com>
Co-authored-by: yhyang201 <yhyang201@gmail.com>
Co-authored-by: Shi Shuai <126407087+shuaills@users.noreply.github.com>
Co-authored-by: Xinyuan Tong <xinyuantong.cs@gmail.com>
|
2025-10-24 03:15:17 +08:00 |
|
|
Lianmin ZhengandStefan He
|
ab07cd3e5a
|
[Auto Sync] Update test_deterministic_utils.py (20251023) (#12022)
Co-authored-by: Stefan He <hebiaobuaa@gmail.com>
|
2025-10-23 11:20:45 -07:00 |
|
|
yinghui
|
c23eda8589
|
Fix incorrect KV indices creation when page_size=32 in TRTLLM MLA backend (#11985)
|
2025-10-22 22:44:45 -07:00 |
|
|
Liangsheng YinandXiaoyu Zhang
|
9d61205dac
|
[lint] improve ruff check (#11922)
Co-authored-by: Xiaoyu Zhang <35585791+BBuf@users.noreply.github.com>
|
2025-10-22 11:32:50 +08:00 |
|
|
Qiaolin Yu
|
d9a20fd28a
|
Use trtllm_mla decode kernel for draft extend in speculative decoding (#11664)
|
2025-10-21 11:42:09 +08:00 |
|
|
JohnnyandBaizhou Zhang
|
252dc4e112
|
[NVIDIA] FA3/FA4 Fix (#11606)
Co-authored-by: Baizhou Zhang <sobereddiezhang@gmail.com>
|
2025-10-19 17:10:10 -07:00 |
|
|
|
4fff1ec1d9
|
Deterministic Mode: Add 1-stage triton kernel for prefill (#11147)
Co-authored-by: Minglei Zhu <mingleizhu1122@gmail.com>
Co-authored-by: Binyao Jiang <bijiang@linkedin.com>
|
2025-10-20 01:47:36 +08:00 |
|
|
Liangsheng Yin
|
7a020e0f3b
|
[Test] Add basic matched stop for beta eagle (#11833)
|
2025-10-20 01:17:00 +08:00 |
|
|
Liangsheng Yin
|
b288f4f440
|
Improve send_sone script (#11817)
|
2025-10-19 11:28:16 +08:00 |
|
|
Minglei ZhuandBaizhou Zhang
|
13219e1e48
|
completely remove mixed mode deterministic test as prefix mode could cover it (#11783)
Co-authored-by: Baizhou Zhang <sobereddiezhang@gmail.com>
|
2025-10-17 17:46:03 -07:00 |
|
|
Chang Su
|
627974405d
|
[Lint] Add python/sglang to ruff F401 checks and remove unused imports in files (#11685)
|
2025-10-17 16:49:46 -07:00 |
|
|
|
b9a54e0968
|
[minor] sync code on python/sglang/test/test_deterministic.py and improve ci tests (#11777)
Co-authored-by: Stefan He <hebiaobuaa@gmail.com>
Co-authored-by: Byron Hsu <byronhsu1230@gmail.com>
|
2025-10-17 14:25:22 -07:00 |
|