 Yineng Zhang
|
417e75a60f
|
fix: use 2-gpu-runner for pp 2 NemotronH ut (#16239)
|
2025-12-31 14:51:33 -08:00 |
|
|
Yineng Zhang
|
5595ae142c
|
docs: fix markdown preview (#16236)
|
2025-12-31 12:43:57 -08:00 |
|
|
|
00e607111a
|
[Auto Sync] Update request_metrics_exporter.py (20251230) (#16183)
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: Scott Lee <scottjlee@users.noreply.github.com>
|
2025-12-30 11:09:41 -08:00 |
|
|
Yineng Zhang
|
4b4050e27e
|
chore: update CI_PERMISSIONS (#15431)
|
2025-12-18 17:08:51 -08:00 |
|
|
Yineng Zhang
|
0861dca81f
|
Revert "[misc] Upgrade cutedsl to 4.3.1 (#14857)" (#15293)
|
2025-12-16 16:31:32 -08:00 |
|
|
Yineng Zhang
|
3ffa260474
|
chore: update CI_PERMISSIONS (#15212)
|
2025-12-15 15:09:05 -08:00 |
|
|
Yineng Zhang
|
36e7c8c59f
|
docs: update usage (#15142)
|
2025-12-14 18:42:21 -08:00 |
|
|
Yineng Zhangandfzyzcjy
|
4b7b5af36a
|
Revert several PRs (#14958)
Co-authored-by: fzyzcjy <ch271828n@outlook.com>
|
2025-12-12 11:25:12 -08:00 |
|
|
|
ef1ab2302a
|
[Auto Sync] Update tool_chat_template_deepseekv31.jinja (20251210) (#14837)
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: Jue Wang <zjuwangjue@gmail.com>
|
2025-12-10 10:56:24 -08:00 |
|
|
Yineng Zhang
|
66772aa2b4
|
chore: add code owners for deepseek_v2.py (#14714)
|
2025-12-08 23:24:06 -08:00 |
|
|
Yineng Zhang
|
b626334475
|
fix: make override DeepseekV2Model work (#14707)
|
2025-12-08 23:11:18 -08:00 |
|
|
Yineng Zhang
|
0e0b0c0566
|
Revert "[Bug] fix not desired disable fused share experts caused by r… (#14676)
|
2025-12-08 20:06:52 -08:00 |
|
|
Yineng Zhang
|
d52d992a90
|
Update README (#13326)
|
2025-11-15 01:33:10 -08:00 |
|
|
Yineng Zhang
|
f8d3d80f63
|
chore: bump flashinfer v0.5.2 (#13242)
|
2025-11-14 02:47:09 -08:00 |
|
|
Yineng Zhang
|
585c417fc0
|
chore: update CODEOWNERS (#12795)
|
2025-11-06 13:11:28 -08:00 |
|
|
Yineng ZhangandBaizhou Zhang
|
0c3543d7d5
|
chore: upgrade flashinfer 0.5.0 (#12523)
Co-authored-by: Baizhou Zhang <sobereddiezhang@gmail.com>
|
2025-11-02 20:54:12 -08:00 |
|
|
Yineng Zhang
|
64cf868eba
|
chore: cleanup quant deps (#12268)
|
2025-10-28 02:03:57 -07:00 |
|
|
Yineng Zhang
|
ea39952797
|
Revert "[Feature] PD-Multiplexing Context and Scheduler." (#12267)
|
2025-10-28 02:00:37 -07:00 |
|
|
|
a6ea3add76
|
[Auto Sync] Update scheduler.py, spec_info.py, run_suite.py... (20251027) (#12235)
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: gongwei-130 <56567052+gongwei-130@users.noreply.github.com>
|
2025-10-27 17:21:08 -07:00 |
|
|
Yineng Zhang
|
cd784faf20
|
docs: update contact (#12192)
|
2025-10-26 23:23:39 -07:00 |
|
|
Yineng Zhang
|
fe527812a6
|
docs: update README (#12139)
|
2025-10-25 20:49:10 -07:00 |
|
|
Yineng Zhang
|
704160017d
|
fix: resolve flashinfer 0.4.1 import (#11940)
|
2025-10-21 17:19:57 -07:00 |
|
|
|
c461e7714d
|
[Auto Sync] Update forward_batch_info.py (20251021) (#11934)
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: yinghui <32845984+cicirori@users.noreply.github.com>
|
2025-10-21 15:52:15 -07:00 |
|
|
Yineng Zhang
|
9792b9d7e3
|
chore: upgrade flashinfer 0.4.1 (#11933)
|
2025-10-21 14:46:31 -07:00 |
|
|
Yineng Zhang
|
b79f75fd53
|
[Auto Sync] Update scheduler.py (20251017) (#11738)
|
2025-10-17 12:36:07 -07:00 |
|
|
Yineng Zhang
|
da681f35d3
|
Revert "Set csgmv as default lora backend. (#11488)" (#11735)
|
2025-10-17 12:01:36 -05:00 |
|
|
Yineng Zhang
|
52a54a26b2
|
docs: Add Contributor Covenant Code of Conduct (#11689)
|
2025-10-15 18:50:26 -07:00 |
|
|
Yineng Zhang
|
ab9187a20b
|
docs: update sglang installation guide (#11659)
|
2025-10-15 00:35:48 -07:00 |
|
|
Yineng Zhang
|
91fc5bb5a9
|
feat: add add_chunked_prefix_cache_attention_backend (#11636)
|
2025-10-14 21:48:13 -07:00 |
|
|
Yineng Zhang
|
86373b9e48
|
fix: Update SGL_KERNEL_VERSION to 0.3.15 (#11633)
|
2025-10-14 14:45:28 -07:00 |
|
|
Yineng Zhang
|
f792e3c561
|
Revert "[NVIDIA] BUMP FA3 (#11444)" (#11582)
|
2025-10-13 20:51:45 -07:00 |
|
|
Yineng Zhang
|
0ecb42613d
|
fix: revert temporarily remove b200 tests (#11515)
|
2025-10-12 15:02:37 -07:00 |
|
|
Yineng Zhang
|
05f015f65f
|
chore: remove flashinfer cleanup cache (#11514)
|
2025-10-12 14:56:33 -07:00 |
|
|
Yineng Zhang
|
4299aebdbb
|
chore: update pyproject (#11420)
|
2025-10-10 00:56:30 -07:00 |
|
|
Yineng Zhang
|
d8467db727
|
fix: reinstall torch in deps install (#11414)
|
2025-10-09 22:58:18 -07:00 |
|
|
Yineng Zhang
|
44cb060785
|
chore: upgrade flashinfer 0.4.0 (#11364)
|
2025-10-09 14:17:54 -07:00 |
|
|
|
e22b13c569
|
[Auto Sync] Update scheduler.py (20251009) (#11350)
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: Junxiong Wang <junxiong@together.ai>
|
2025-10-08 17:39:04 -07:00 |
|
|
Yineng Zhang
|
fb27d38305
|
docs: update sgl-kernel README (#11286)
|
2025-10-06 17:55:22 -07:00 |
|
|
Yineng Zhang
|
3a641d9085
|
chore: upgrade sgl-kernel 0.3.13 (#11056)
|
2025-09-29 02:22:25 -07:00 |
|
|
Yineng Zhang
|
5942fdb480
|
chore: upgrade cutedsl 4.2.1 (#11054)
|
2025-09-29 00:24:17 -07:00 |
|
|
Yineng Zhang
|
172bcf0152
|
Revert "Refactor kv_cache_scheme handling for quantization (#10132)" (#10935)
|
2025-09-25 20:14:15 -07:00 |
|
|
|
42aedb02af
|
[Auto Sync] Update protocol.py (20250923) (#10820)
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: cicirori <32845984+cicirori@users.noreply.github.com>
|
2025-09-23 12:49:56 -07:00 |
|
|
Yineng Zhang
|
8c1ef0f914
|
chore: upgrade sgl-kernel 0.3.12 (#10782)
|
2025-09-23 00:18:54 -07:00 |
|
|
|
0753ef831e
|
[Auto Sync] Update flashattention_backend.py (20250922) (#10762)
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: Gordon Gustafson <ggustafson@together.ai>
|
2025-09-22 16:41:42 -07:00 |
|
|
Yineng Zhang
|
e53df7c009
|
chore: bump sgl-kernel v0.3.12 (#10732)
|
2025-09-22 14:39:25 -07:00 |
|
|
|
f67d1f45bc
|
[Auto Sync] Update deepseek_v2.py (20250922) (#10717)
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: Michael Granado <mgranado@together.ai>
|
2025-09-21 17:43:50 -07:00 |
|
|
Yineng Zhang
|
2f18602f13
|
fix: disable gpt-oss b200 ut (#10716)
|
2025-09-21 17:02:25 -07:00 |
|
|
Yineng Zhangandgemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
|
d403c143e3
|
feat: update server args (#10696)
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
|
2025-09-20 18:52:19 -07:00 |
|
|
Yineng Zhangandgithub-actions[bot] <github-actions[bot]@users.noreply.github.com>
|
f1d7892318
|
[Auto Sync] Update modelopt_quant.py (20250920) (#10688)
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
|
2025-09-20 02:37:49 -07:00 |
|
|
Yineng Zhang
|
7c876de7f5
|
fix: remove awq_dequantize deps (#10686)
|
2025-09-20 01:47:01 -07:00 |
|
|
Yineng Zhang
|
ba94b82986
|
fix: update run_suite (#10685)
|
2025-09-20 01:22:06 -07:00 |
|
|
Yineng Zhangandgithub-actions[bot] <github-actions[bot]@users.noreply.github.com>
|
b17e67df36
|
[Auto Sync] Update deepseek_v2.py (20250920) (#10683)
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
|
2025-09-19 23:43:31 -07:00 |
|
|
Yineng Zhangandgithub-actions[bot] <github-actions[bot]@users.noreply.github.com>
|
60e2a7cead
|
[Auto Sync] Update model_runner.py (20250920) (#10679)
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
|
2025-09-19 18:26:54 -07:00 |
|
|
Yineng Zhang
|
6f993e8b9e
|
chore: cleanup docker image (#10671)
|
2025-09-19 16:56:49 -07:00 |
|
|
Yineng Zhangandgithub-actions[bot] <github-actions[bot]@users.noreply.github.com>
|
dab4663b4e
|
[Auto Sync] Update .clang-format (20250919) (#10670)
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
|
2025-09-19 12:31:44 -07:00 |
|
|
Yineng Zhang
|
610a6d6e86
|
fix: resolve sync issue (#10668)
|
2025-09-19 12:05:39 -07:00 |
|
|
Yineng Zhang
|
5bfafdfcb4
|
chore: bump sgl-kernel 0.3.11 (#10630)
|
2025-09-18 18:43:20 -07:00 |
|
|
Yineng Zhang
|
2a2ff9a840
|
refactor: use registry for _get_attention_backend_from_str (#10629)
|
2025-09-18 16:27:59 -07:00 |
|
|
Yineng Zhang
|
564050766d
|
fix: update dsv3 fp4 ut (#10584)
|
2025-09-17 14:34:58 -07:00 |
|
|
Yineng Zhang
|
c0c6f543e4
|
chore: upgrade sgl-kernel 0.3.10 (#10500)
|
2025-09-16 02:00:53 -07:00 |
|
|
Yineng Zhang
|
5207424014
|
chore: bump v0.3.10 sgl-kernel (#10478)
|
2025-09-15 15:20:09 -07:00 |
|
|
Yineng Zhang
|
5c08d7d21d
|
fix: resolve sgl-kernel ut (#10476)
|
2025-09-15 11:42:48 -07:00 |
|
|
Yineng Zhang
|
86a32bb5cd
|
chore: bump v0.5.3rc0 (#10468)
|
2025-09-15 03:55:18 -07:00 |
|
|
Yineng Zhang
|
5afd036533
|
feat: support pip install sglang (#10465)
|
2025-09-15 03:09:17 -07:00 |
|
|
Yineng Zhang
|
dcee42c200
|
feat: add dsv3 fp4 cutlass moe etp ut (#10433)
|
2025-09-14 18:44:09 -07:00 |
|
|
Yineng Zhang
|
7ce6c10eb6
|
fix: enable cu124 and cu128 build on main push (#10431)
|
2025-09-14 16:19:35 -07:00 |
|
|
Yineng Zhang
|
55025b9282
|
fix: use latest flashinfer (#10428)
|
2025-09-14 15:07:14 -07:00 |
|
|
Yineng Zhang
|
9d775b1a2d
|
feat: add deepseek v3 fp4 ut (#10391)
|
2025-09-12 15:43:29 -07:00 |
|
|
Yineng Zhang
|
98adac8ef7
|
fix: exclude protobuf generated code (#10388)
|
2025-09-12 13:52:09 -07:00 |
|
|
Yineng Zhang
|
cef11e9a55
|
fix: resolve gb200 image link (#10343)
|
2025-09-12 13:46:02 -07:00 |
|
|
Yineng Zhang
|
b3839a7f99
|
fix: resolve transfer_kv_all_layer_direct_lf_pf import error (#10360)
|
2025-09-11 23:53:23 -07:00 |
|
|
Yineng Zhang
|
b0d25e72c4
|
chore: bump v0.5.2 (#10221)
|
2025-09-11 16:09:20 -07:00 |
|
|
Yineng Zhang
|
bfe01a5eef
|
chore: upgrade v0.3.9.post2 sgl-kernel (#10297)
|
2025-09-11 04:10:29 -07:00 |
|
|
Yineng Zhang
|
532f998b0f
|
chore: bump sgl-kernel 0.3.9.post2 (#10311)
|
2025-09-11 01:29:50 -07:00 |
|
|
Yineng Zhang
|
de15d1405a
|
Revert "Fix flashinfer version in sgl-kernel (#10135)" (#10310)
|
2025-09-11 01:27:58 -07:00 |
|
|
Yineng Zhang
|
5b7448de77
|
chore: bump sgl-kernel 0.3.9.post1 (#10294)
|
2025-09-10 18:26:34 -07:00 |
|
|
Yineng Zhang
|
6d55f60e77
|
Revert "[1/2] Optimizations and refactors about quant kernel (#9534)" (#10292)
|
2025-09-10 18:24:23 -07:00 |
|
|
Yineng Zhang
|
d3ee70985f
|
chore: upgrade v0.3.9 sgl-kernel (#10220)
|
2025-09-09 03:16:25 -07:00 |
|
|
Yineng Zhang
|
f3817cb0b2
|
chore: bump v0.3.9 sgl-kernel (#10208)
|
2025-09-09 01:40:05 -07:00 |
|
|
Yineng Zhangandcicirori
|
94fb4e9e54
|
feat: support fa cute in sgl-kernel (#10205)
Co-authored-by: cicirori <32845984+cicirori@users.noreply.github.com>
|
2025-09-09 00:14:39 -07:00 |
|
|
Yineng Zhang
|
cdc56ef6c1
|
feat: use sgl-kernel cu129 as default (#10188)
|
2025-09-08 22:01:17 -07:00 |
|
|
Yineng Zhang
|
19d64f2b72
|
fix: resolve lint issue (#10181)
|
2025-09-08 15:09:55 -07:00 |
|
|
Yineng Zhang
|
45b3a6a256
|
Revert "[ModelOpt] Fix Weight Loading for DSR1-FP4 Quantization (#9712)" (#10176)
|
2025-09-08 11:28:15 -07:00 |
|
|
Yineng Zhang
|
b7d1f17b8d
|
Revert "enable auto-round quantization model (#6226)" (#10148)
|
2025-09-07 22:31:11 -07:00 |
|
|
Yineng Zhang
|
0e78c63c0e
|
Revert "[1/N][Bug] Fix w4afp8 MoE NaN issue (sgl-kernel) (#9953)" (#10097)
|
2025-09-05 19:57:53 -07:00 |
|
|
Yineng Zhang
|
0e9387a95d
|
fix: update gb200 dep (#10052)
|
2025-09-04 20:30:46 -07:00 |
|
|
Yineng Zhang
|
fa9c82d339
|
chore: bump v0.5.2rc2 (#10050)
|
2025-09-04 20:07:27 -07:00 |
|
|
Yineng Zhang
|
de9217334b
|
feat: add gpt oss b200 ci (#9988)
|
2025-09-03 17:26:38 -07:00 |
|
|
Yineng Zhang
|
1b2ff4fb7f
|
Revert "Optimized deepseek-v3/r1 model performance on mxfp4 run (#9671)" (#9959)
|
2025-09-03 00:50:04 -07:00 |
|
|
Yineng Zhang
|
2c7ca33abb
|
Revert "[Fix] DeepSeek EP accuracy issue on B200 GPUs (#9946)" (#9955)
|
2025-09-02 23:49:56 -07:00 |
|
|
Yineng Zhang
|
18f91eb639
|
chore: bump v0.5.2rc1 (#9920)
|
2025-09-02 04:43:34 -07:00 |
|
|
Yineng Zhang
|
8766b3aca8
|
fix: update router deps (#9921)
|
2025-09-02 03:28:58 -07:00 |
|
|
Yineng Zhang
|
a96c5b5c14
|
chore: bump v0.3.8 sgl-kernel (#9907)
|
2025-09-02 01:27:26 -07:00 |
|
|
Yineng Zhang
|
16e56ea693
|
chore: bump v0.5.2rc0 (#9862)
|
2025-09-01 03:07:36 -07:00 |
|
|
Yineng Zhang
|
349b491c63
|
chore: upgrade flashinfer 0.3.0 (#9864)
|
2025-09-01 03:07:19 -07:00 |
|
|
Yineng Zhang
|
300676afac
|
chore: upgrade transformers 4.56.0 (#9827)
|
2025-08-30 14:07:34 -07:00 |
|
|
Yineng Zhang
|
9970e3bf32
|
chore: upgrade sgl-kernel 0.3.7.post1 with deepgemm fix (#9822)
|
2025-08-30 04:02:25 -07:00 |
|
|
Yineng Zhang
|
9c99949ef3
|
chore: update Dockerfile (#9820)
|
2025-08-30 03:08:14 -07:00 |
|
|
Yineng Zhang
|
c5082f0f73
|
chore: fix cuda driver api issue and bump sgl-kernel 0.3.7.post1 (#9746)
|
2025-08-30 02:01:54 -07:00 |
|
|
Yineng Zhang
|
8abe8deae6
|
fix: dsv3 lite q_lora_rank none (#9815)
|
2025-08-29 23:24:14 -07:00 |
|