Lianmin Zheng
|
075c5a5789
|
Code clean up for fp8 quantization (#16982)
|
2026-01-13 12:38:39 -08:00 |
|
Yuhao Yang
|
a0b4ba9032
|
[diffusion] model: GLM-Image (#16894)
Co-authored-by: jianyingzhu <53300651@qq.com>
|
2026-01-14 02:02:03 +08:00 |
|
Junrong Lin
|
2a7b67adff
|
[CI/NPU] Fix ascend CI issue (#16953)
|
2026-01-13 23:39:12 +08:00 |
|
elvischenv
|
1d811094f8
|
[Misc] Auto download question file for benchmark/mtbench (#17019)
|
2026-01-13 10:34:29 -05:00 |
|
Xiaoyu Zhang
|
2ab3ed3e9e
|
Fix sgl-kernel per_token_quant fp8 kernel scale shared_memory bug (#16886)
|
2026-01-13 23:22:05 +08:00 |
|
Praneth Paruchuri
|
250477d2ac
|
[model-gateway] Optimize L1 cache insertion with incremental hashing and tokenization (#16259)
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: Simo Lin <linsimo.mark@gmail.com>
|
2026-01-13 06:24:25 -08:00 |
|
Praneth Paruchuri
|
af1232b2f2
|
[model-gateway] fix wasm example (#16924)
|
2026-01-13 06:21:47 -08:00 |
|
Mick
|
7a869045b6
|
[diffusion] chore: clean excessive document (#16986)
|
2026-01-13 21:33:50 +08:00 |
|
ahb13
|
888d7e54d1
|
[diffusion] fix: fix compatibility issue with torch.compile and flash attention v4 (#16790)
Co-authored-by: root <root@nimrodb200.tail5cbfe.ts.net>
Co-authored-by: ahb13 <ahb13@qq.com>
|
2026-01-13 21:11:19 +08:00 |
|
qichu-yun
|
3cb1fbaee4
|
[diffusion] fix: fix Qwen-Image-Edit Lightning LoRA alpha/rank scaling (read per-layer *.alpha) (#16935)
|
2026-01-13 21:09:11 +08:00 |
|
DarkSharpness
|
ba9f6d8f26
|
[Refactor] Clean up JIT kernel utilites (#16884)
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: Xiaoyu Zhang <35585791+BBuf@users.noreply.github.com>
|
2026-01-13 17:54:16 +08:00 |
|
Xiaoyu Zhang
|
740d3c0b39
|
[Diffusion] Remove useless dependency in diffusion (#16967)
|
2026-01-13 17:25:53 +08:00 |
|
Hubert Lu
|
8716589826
|
[AMD][Diffusion] support timestep embedding kernel for AMD GPUs (#16766)
|
2026-01-12 22:17:07 -08:00 |
|
fzyzcjy
|
ff3ddb9d9b
|
Support min num routing keys in key-based load balancing policy (#16564)
|
2026-01-12 21:38:03 -08:00 |
|
fzyzcjy
|
9d3018f484
|
Support min load besides random routing key assignment policy in ManualPolicy (#16767)
|
2026-01-12 18:31:18 -08:00 |
|
HuangJi
|
a83484275d
|
[diffusion] perf: optimize linear calculation in SLA (#16648)
|
2026-01-13 09:38:35 +08:00 |
|
Mick
|
47d485f35f
|
[diffusion] fix: fix not respecting dit_layerwise_offload server arg (#16252)
|
2026-01-13 09:29:07 +08:00 |
|
Mick
|
2b42309955
|
[diffusion] UX: provide solutions for OOM (#16940)
|
2026-01-13 09:25:27 +08:00 |
|
James
|
ae0baefb94
|
[NPU] upgrade npu mf_apater plugin (#15853)
|
2026-01-13 09:02:10 +08:00 |
|
fzyzcjy
|
1f0e3d7fd8
|
Support tracking worker routing key loads in gateway (#16765)
|
2026-01-13 08:07:17 +08:00 |
|
Yinghai Lu
|
d3c08fb07c
|
[layers] support zero-dim rmsnorm (#16978)
|
2026-01-12 15:53:19 -08:00 |
|
Simo Lin
|
c6a64e9f69
|
[smg] fix type complexity for workflow run_if (#16981)
|
2026-01-12 15:41:52 -08:00 |
|
Simo Lin
|
e0ac559ae1
|
feat(workflow): add scheduled/delayed steps and conditional branching (#16980)
|
2026-01-12 15:06:12 -08:00 |
|
Simo Lin
|
6620548fd8
|
[model-gateway] make StateStore trait async for external persistence (#16979)
|
2026-01-12 12:55:59 -08:00 |
|
Simo Lin
|
6e158e55b4
|
[model-gateway] improve workflow engine code quality (#16977)
|
2026-01-12 12:14:46 -08:00 |
|
Simo Lin
|
ed729d22b3
|
[model-gateway] refactor workflow engine from type erasure to typed engines (#16973)
|
2026-01-12 10:47:00 -08:00 |
|
Simo Lin
|
fa51b85466
|
[model-gateway] convert workflow system to type-safe workflow data (#16970)
|
2026-01-12 10:06:36 -08:00 |
|
Bhavneek Singh
|
559ff9ecaf
|
Bug: fixed multi_chain_reasoning test (#16192)
|
2026-01-12 09:06:41 -08:00 |
|
Gaoji Liu
|
7b682de870
|
[Model] Support IQuest-Coder-40B-Loop (#16348)
Co-authored-by: yxing <yxing@iquestlab.com>
Co-authored-by: yzhu <yzhu@ubiquant.com>
Co-authored-by: zelong518 <zelonghuang02@gmail.com>
|
2026-01-12 23:44:45 +08:00 |
|
Simo Lin
|
d0092decb1
|
[model-gateway] Fix workflow engine race conditions and add graceful shutdown (#16963)
|
2026-01-12 06:37:39 -08:00 |
|
WenhaoZhang
|
76f69b7753
|
[diffusion] app: add ComfyUI plugin support for SGLang-Diffusion (#15271)
Co-authored-by: niehen6174 <niehen.6174@gmail.com>
Co-authored-by: Mick <mickjagger19@icloud.com>
Co-authored-by: niehen6174 <nihen6174@gmail.com>
|
2026-01-12 21:58:16 +08:00 |
|
khalilzhk
|
9a628744fc
|
[CI] fix piecewise graph test case on ascend (#16933)
|
2026-01-12 20:16:30 +08:00 |
|
chenxu214
|
53dca74f47
|
Bugfix: EagleDraftWorker has not attribute "eagle_use_aux_hidden_state" (#16480)
|
2026-01-12 20:14:35 +08:00 |
|
HuangJi
|
2dadf63562
|
[diffusion] Support I2I/TI2I/I2V/TI2V warmup && T2I/T2V warmup bug fix (#16922)
Co-authored-by: yhyang201 <yhyang201@gmail.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
|
2026-01-12 19:40:37 +08:00 |
|
ybyang
|
aab640c99f
|
add doc for dsv32 cp+pp (#16916)
|
2026-01-12 19:14:07 +08:00 |
|
Liangsheng Yin
|
2b3791ed37
|
Fix wrong kernel selection for int32/int64 indices (#16912)
Co-authored-by: DarkSharpness <2040703891@qq.com>
|
2026-01-12 17:26:57 +08:00 |
|
Xun Sun
|
9f5cd80a8d
|
Re-introduce the unit test of test_mooncake_ep_small (#16019)
|
2026-01-12 17:01:24 +08:00 |
|
YC Tseng
|
b1ee75ae7b
|
[AMD] CI - enable test case for amd ci : triton_attention_kernels , torch_compile_moe (#16559)
|
2026-01-12 00:06:31 -08:00 |
|
Hu Chong
|
f44c63eef7
|
[diffusion] chore: validate sampling params (#16677)
Co-authored-by: root <root@huchong2-0.huchong2.podvm.svc.cluster.local>
|
2026-01-12 16:00:10 +08:00 |
|
Wenyi Xu
|
c54c70ab62
|
[model-gateway] Improve Health Check Logging (#16930)
|
2026-01-11 23:01:29 -08:00 |
|
Adarsh Shirawalmath
|
aab906a3d4
|
[docs] sync diffusion docs to main docs (#16932)
|
2026-01-12 14:49:55 +08:00 |
|
HuangJi
|
feb39f7768
|
[diffusion] model: Support TurboWan2.2-I2V SLA && add CI test for TurboWan (#16536)
|
2026-01-12 13:55:38 +08:00 |
|
fzyzcjy
|
38b30c7b56
|
Tiny refactor age computation in router (#16850)
Co-authored-by: Simo Lin <linsimo.mark@gmail.com>
|
2026-01-11 21:42:43 -08:00 |
|
Hexq0210
|
c581b5ed79
|
[NPU] update feature supported on ascend NPU (#16915)
|
2026-01-12 11:47:58 +08:00 |
|
fzyzcjy
|
a1c48943d7
|
Tiny fix NoAvailableWorkers being a RetryError (#16896)
|
2026-01-11 18:53:17 -08:00 |
|
Liangsheng Yin
|
5b7bed7ca4
|
Decouple grammar logic out of scheduler. (#16820)
|
2026-01-12 10:52:42 +08:00 |
|
chenxu140
|
38a88479c6
|
llama model and llama eagle3 model support dp-attn (#15268)
|
2026-01-12 08:54:56 +08:00 |
|
ybyang
|
503c3d9566
|
[model-gateway]: add qwen coder tool parser support xml format for qwen3 coder and microthinker (#12909)
|
2026-01-11 16:09:41 -08:00 |
|
Liangsheng Yin
|
934ae89abe
|
Tiny fix typo minxin -> mixin (#16908)
|
2026-01-12 00:36:45 +08:00 |
|
Liangsheng Yin
|
cf1426a7b7
|
[CI] reapply max-parallel in stage-b-test-small-1-gpu (#16906)
|
2026-01-11 23:17:38 +08:00 |
|