 Douglas Yang
|
4c7136bb36
|
feature: adding openai compatible API request to bench_serving (#17219)
|
2026-01-23 16:04:28 -08:00 |
|
|
Nan Jiang
|
ad05782160
|
fix post_residual_addition more generally (#17286)
|
2026-01-23 15:43:37 -08:00 |
|
|
R0CKSTAR
|
a77729a276
|
[MUSA][1/N] sglang.check_env (#16959)
Signed-off-by: Xiaodong Ye <xiaodong.ye@mthreads.com>
|
2026-01-23 14:41:17 -08:00 |
|
|
Mansoor
|
bdaa3de075
|
Add return routed experts to the completions and chat/completions endpoints (#17434)
|
2026-01-23 12:12:36 -08:00 |
|
|
Tiwei Bie
|
5438cd20ce
|
[DLLM] Remove cuda graph batch size limitation (#17458)
|
2026-01-23 09:52:39 -08:00 |
|
|
Jerry Ji
|
010c17a133
|
[Refactor] Algebraic data type for nextn config + some basic refactors (#17347)
|
2026-01-24 01:16:55 +08:00 |
|
|
Yi ZhongandBrayden Zhong
|
08fcda2f63
|
add the fa4 mm backend and varlen func (#13539)
Signed-off-by: vincentzed <207368749+vincentzed@users.noreply.github.com>
Co-authored-by: Brayden Zhong <b8zhong@uwaterloo.ca>
|
2026-01-23 23:12:06 +08:00 |
|
|
akhilg-nvandDarkSharpness
|
2fb328109f
|
[DeepSeek V3.2] Enable trtllm NSA with bf16 kvcache (#16758)
Co-authored-by: DarkSharpness <76582120+DarkSharpness@users.noreply.github.com>
|
2026-01-23 20:26:21 +08:00 |
|
|
Nicolas Castet
|
48e9daadff
|
Support symmetric memory pre-allocation to avoid fragmentation (#17089)
|
2026-01-23 17:57:04 +08:00 |
|
|
Yuzhen Zhou
|
2169025b77
|
turn off dit_layerwise_offload for wan on rocm (#17569)
|
2026-01-23 15:22:42 +08:00 |
|
|
Lianmin Zheng
|
56e6652d1d
|
Lazy import torchao (#17626)
|
2026-01-22 22:04:51 -08:00 |
|
|
|
c0b5a180fe
|
[NPU]bugfix: fix for dsv3.2 and dsvl2 (#17007)
Co-authored-by: Hexq0210 <893781835@qq.com>
Co-authored-by: liupeng374 <782420244@qq.com>
Co-authored-by: cy <chenyang08056032@163.com>
|
2026-01-23 11:15:15 +08:00 |
|
|
Ke Bao
|
7ace64d1d8
|
Update mamba env setting (#17566)
|
2026-01-23 11:02:32 +08:00 |
|
|
siyu
|
62e6a749b0
|
Skip mm feature pool init to avoid EPD OOM (#16388)
|
2026-01-23 10:53:45 +08:00 |
|
|
MMuzzammil1
|
2399af5557
|
Bugfix: Writing to storage when write-back method is chosen (#14718)
|
2026-01-22 15:08:25 -08:00 |
|
|
hxie
|
13f88045b3
|
configuration file support and nixl integration augmentation for hicache-storage-backend-extra-config (#16602)
|
2026-01-22 14:31:48 -08:00 |
|
|
wufannandHubert Lu
|
a921029b97
|
[AMD] Support ds3.2 on gfx942 platform (#17504)
Co-authored-by: Hubert Lu <55214931+hubertlu-tw@users.noreply.github.com>
|
2026-01-22 13:57:08 -08:00 |
|
|
Jacob Gordon
|
15b511771d
|
refactor(codespell): corrects typos covered up by whitelist (#17601)
|
2026-01-22 11:45:47 -08:00 |
|
|
Jacob Gordon
|
2c86a065db
|
types: preps SessionReqNode for IDE-driven renames (#17602)
|
2026-01-22 11:36:23 -08:00 |
|
|
Baizhou Zhang
|
283a2daeaa
|
[hotfix] Reenable all reduce fusion on sm100 (#17591)
|
2026-01-22 23:36:38 +08:00 |
|
|
Yuhao Yang
|
f7a0bcda1e
|
model: step3-vl-10b (#17513)
|
2026-01-22 23:15:08 +08:00 |
|
|
Jincong Chen
|
72f790bf6f
|
[BUGFIX] Skip Mamba Cache Slot 0 to Avoid Using Dummy Cache (#17404)
|
2026-01-22 23:08:38 +08:00 |
|
|
Xiaoyu Zhang
|
5324027007
|
[Diffusion] Make the apply_qknorm function easier to use (#17537)
|
2026-01-22 22:32:15 +08:00 |
|
|
triple-mu
|
3705f90629
|
[diffusion] model: optimize torch.compile (#17472)
|
2026-01-22 22:05:47 +08:00 |
|
|
|
5d299c25c0
|
[NPU] bugfix with Kimi-k2 and bge-reranker-v2 model (#17478)
Co-authored-by: amote-i <49533125+amote-i@users.noreply.github.com>
Co-authored-by: cy <chenyang08056032@163.com>
|
2026-01-22 22:02:05 +08:00 |
|
|
chenxu214
|
a4dc432587
|
Change naming for graph mode on multiplatform (#17469)
|
2026-01-22 19:25:06 +08:00 |
|
|
Minglei Zhu
|
419bbcee10
|
refactor Qwen3-Next with a new RadixLinearAttention (#17373)
|
2026-01-22 17:42:06 +08:00 |
|
|
zhangheng
|
f33022d039
|
[RadixTree][3/N Refactor]：Support unified insert/evict params (#17401)
|
2026-01-22 17:36:31 +08:00 |
|
|
Chandrakant Khandelwal
|
61abff66c1
|
[NPU] [Bug Fix] Fix typo in npu device check in gpt_oss.py (#17553)
|
2026-01-21 23:26:35 -08:00 |
|
|
Zaili Wang
|
6a8f68b6d2
|
[Fix] fix device orientation for image processor (#15859)
|
2026-01-22 15:03:10 +08:00 |
|
|
Zaili Wang
|
672eb37534
|
[CPU][Fix CI] Solidate torch version for sgl-kernel-cpu and fix device orientation error (#17460)
|
2026-01-22 14:04:50 +08:00 |
|
|
Baizhou Zhang
|
e2d33531f3
|
[Kernel] Little refactor of flashinfer allreduce norm fusion (#17474)
|
2026-01-22 13:31:57 +08:00 |
|
|
Chi McIsaacandMick
|
71482dd171
|
[diffusion] feat: enable passing Cache‑DiT config for diffusers backend (#16662)
Signed-off-by: Chi <chixie.mcisaac@gmail.com>
Signed-off-by: qimcis <chixie.mcisaac@gmail.com>
Co-authored-by: Mick <mickjagger19@icloud.com>
|
2026-01-22 13:13:34 +08:00 |
|
|
YC Tsengandmichaelzhang-ai
|
17807caf82
|
[AMD] fix amd ci dpskv32 (#17432)
Co-authored-by: michaelzhang-ai <michaelzhang.ai@users.noreply.github.com>
|
2026-01-21 20:34:24 -08:00 |
|
|
Baizhou Zhangandiforgetmyname
|
fafa171529
|
[hotfix] Fixes on cuda 13 docker image (#17541)
Co-authored-by: iforgetmyname <iforgetmyname@users.noreply.github>
|
2026-01-22 12:29:55 +08:00 |
|
|
Yingchun Lai
|
a5bbcda968
|
fix: prefer to use max_completion_tokens rather than max_tokens (#17516)
|
2026-01-21 20:22:20 -08:00 |
|
|
Baizhou Zhang
|
3373545b9f
|
[HotFix]Fix dtype mismatch in nsa indexer on AMD device (#17518)
|
2026-01-22 12:17:02 +08:00 |
|
|
Piotr Mazurek
|
d6e2b88288
|
Add Liquid Foundation Model (LFM2) (#16890)
|
2026-01-22 11:11:20 +08:00 |
|
|
cen121212
|
0c2993eed0
|
Optimize Qwen3-VL video memory usage (#16366)
|
2026-01-22 09:10:08 +08:00 |
|
|
Xiaoyu Zhang
|
590969ee9c
|
[Diffusion] Support select fa2 backend in hopper (#17514)
|
2026-01-22 08:23:53 +08:00 |
|
|
|
b74a57a8d9
|
[Auto Sync] Update detokenizer_manager.py, io_struct.py, mu... (20260120) (#17442)
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: Wangfan Fu <wangfan@x.ai>
|
2026-01-21 14:48:32 -08:00 |
|
|
DarkSharpness
|
95f59c13fd
|
[Chore] include all jit files in building packages (#17493)
|
2026-01-21 14:48:02 -08:00 |
|
|
Lingjun Wen
|
cf89351691
|
[new-model] Add support for Cohere2ForCausalLM behind Command-A and Command-R Models (#16927)
|
2026-01-21 12:28:33 -08:00 |
|
|
|
1fdf5cac39
|
[Auto Sync] Update environ.py, fp8.py (20260121) (#17486)
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: Binyao Jiang <byjiang1996@gmail.com>
|
2026-01-21 12:04:09 -08:00 |
|
|
Jacob Gordon
|
cda43ffa4d
|
ci: avoids duplication of codespell config (#17519)
|
2026-01-21 12:02:37 -08:00 |
|
|
Yunmeng
|
390898545e
|
[Misc] Fix argument help string formatting (#17416)
|
2026-01-21 09:25:32 -08:00 |
|
|
Ke Bao
|
d725487dc8
|
Disable swa memory for gpt-oss with spec (#17517)
|
2026-01-22 01:04:19 +08:00 |
|
|
|
a95c9f5b81
|
[NPU] Remove paged attention & Change fia to default attention (#17394)
Co-authored-by: Liwansi <62291011+Liwansi@users.noreply.github.com>
Co-authored-by: chenxu214 <justin_cc2025@163.com>
Co-authored-by: chenyang08056032 <chenyang08056032@163.com>
|
2026-01-21 23:58:25 +08:00 |
|
|
Xiaoyu Zhang
|
19089aa431
|
[Diffusion] Refactor diffusion is_cuda check (#17498)
|
2026-01-21 23:02:24 +08:00 |
|
|
Qiaolin Yu
|
4f6f5d25c8
|
Support fa4 decoding (#16034)
|
2026-01-21 22:54:02 +08:00 |
|