Liangsheng Yin
|
bf90ea9c5b
|
Unify spec v2's naming manner. (#15990)
|
2025-12-28 14:14:52 +08:00 |
|
fzyzcjy
|
26c5091217
|
Tiny extract PeriodicTask in router (#15988)
|
2025-12-28 14:07:13 +08:00 |
|
fzyzcjy
|
325a4c1945
|
Tiny add smg_manual_policy_cache_entries metric (#15987)
|
2025-12-28 14:07:07 +08:00 |
|
TZHelloWorld
|
0294844f04
|
[fix]deepgemm precompile when warmup (#15891)
|
2025-12-28 13:47:39 +08:00 |
|
Alison Shao
|
0e536600e8
|
Refactor: separate CI-specific weight validation into dedicated module (#15216)
Co-authored-by: Kangyan-Zhou <zky314343421@gmail.com>
|
2025-12-27 20:50:39 -08:00 |
|
Vladislav Nosivskoy
|
d70c265533
|
SGLang Tracing: fix attribute errors (header extraction & bootstrap span closing) (#15693)
Signed-off-by: Vladislav Nosivskoy <vladnosiv@gmail.com>
Co-authored-by: ishandhanani <82981111+ishandhanani@users.noreply.github.com>
|
2025-12-27 22:44:31 -06:00 |
|
Baizhou Zhang
|
656f4d69a1
|
Refactor fp8 nextn layer for DeepSeek nvfp4 checkpoint (#15353)
|
2025-12-28 11:57:09 +08:00 |
|
DarkSharpness
|
8e43980ebb
|
[Feature] JIT Fused QK norm + qk norm clean up (#15835)
|
2025-12-28 11:53:50 +08:00 |
|
Hudson Xing
|
474a4699c5
|
Add correctness validation for decode_attention test (#15806)
|
2025-12-28 11:46:17 +08:00 |
|
Mick
|
b4a00ed2d9
|
[diffusion] chore: clean ComposedPipelineBase (#15937)
|
2025-12-28 11:43:25 +08:00 |
|
fzyzcjy
|
f55d608c89
|
Tiny fix cannot launch nvfp4 checkpoint with bf16 kv cache (#15986)
|
2025-12-28 11:22:20 +08:00 |
|
Ho-Ren (Jack) Chuang
|
349ce2dd19
|
Support kv8 (FP8) with torch_native attention backend (#12596)
Signed-off-by: Ho-Ren (Jack) Chuang <horenchuang@bytedance.com>
|
2025-12-28 10:48:30 +08:00 |
|
Lianmin Zheng
|
183b65190a
|
Clean up logging (#15919)
|
2025-12-27 15:27:12 -08:00 |
|
Ratish P
|
2af955e16c
|
[model-gateway]: remove unnecessary comment (#15947)
|
2025-12-27 13:33:02 -05:00 |
|
Yuhao Yang
|
0cd2b719a5
|
[diffusion] chore: remove useless params (#15925)
|
2025-12-28 01:01:08 +08:00 |
|
Mick
|
39d56196a0
|
[diffusion] logging: log available gpu mem while loading and generating (#15936)
|
2025-12-28 00:34:58 +08:00 |
|
Shangming Cai
|
41addd2e08
|
chore: bump mooncake version to 0.3.8 (#15886)
Signed-off-by: Shangming Cai <csmthu@gmail.com>
|
2025-12-27 23:34:24 +08:00 |
|
Hudson Xing
|
5c393e8153
|
Fix temp_prefill_info assertion error in PP disaggregation mode (#15943)
|
2025-12-27 22:46:55 +08:00 |
|
Simo Lin
|
3645ed0f73
|
[model-gateway] Add PrefixHash load balancing policy for KV cache-aware routing (#15935)
|
2025-12-27 05:58:05 -05:00 |
|
Ratish P
|
ca740a41f3
|
[model-gateway]: fix grpc embedding test (#15934)
|
2025-12-27 05:56:54 -05:00 |
|
Simo Lin
|
0e25aa439b
|
[model-gateway] optimize radix tree memory and reduce allocations (#15933)
|
2025-12-27 02:47:30 -08:00 |
|
jiaming1130
|
60a230b1fd
|
[NPU] Support w4a8 with activation clip (#14736)
Co-authored-by: ZhengdQin <46387172+ZhengdQin@users.noreply.github.com>
|
2025-12-27 16:19:46 +08:00 |
|
Mick
|
aa89c6a7e2
|
[diffusion] refactor: unify model loading and offloading behavior (#15923)
|
2025-12-27 16:18:24 +08:00 |
|
Simo Lin
|
171912a9e3
|
[model-gateway] Add consistent hashing for ManualPolicy routing (#15907)
|
2025-12-26 22:53:03 -08:00 |
|
Ke Bao
|
faecd37ed4
|
Add Mimo-v2-flash model to ci test (#15887)
|
2025-12-27 14:18:08 +08:00 |
|
Liangsheng Yin
|
9ad546d7e8
|
Tiny cleanup the models' name in test_utils (#15920)
|
2025-12-27 14:13:23 +08:00 |
|
Yuhao Yang
|
29ce7b3612
|
[diffusion] chore: remove stepvideo code (#15918)
|
2025-12-27 13:25:05 +08:00 |
|
Lianmin Zheng
|
a8380ded71
|
Add a test case for crash dump (#15905)
|
2025-12-26 19:39:28 -08:00 |
|
Simo Lin
|
4edee6954a
|
[model-gateway] add JWT/OIDC authentication for control plane APIs (#15850)
|
2025-12-26 18:30:00 -08:00 |
|
Douglas Yang
|
67caea6fe4
|
fix: adding deepseek base tests to b200 (#15915)
|
2025-12-26 18:04:25 -08:00 |
|
Zheng Wengang
|
cd3289c7a4
|
[BugFix][VLM] Correct weight loading with tie_word_embeddings == False (#15398)
|
2025-12-26 17:30:50 -08:00 |
|
Simo Lin
|
acddb8e0ec
|
Revert embedding integration tests from 5f3a47d8a (#15914)
|
2025-12-26 20:29:03 -05:00 |
|
Cheng Wan
|
2ec57cefd9
|
hotfix: add type hints to scheduler mixins (#15916)
|
2025-12-26 17:08:11 -08:00 |
|
Cheng Wan
|
988b14ca0e
|
refactor: add type hints to scheduler mixins (#15913)
|
2025-12-26 16:50:07 -08:00 |
|
Lianmin Zheng
|
93495dcac9
|
Revert "[VLM] Refactor load_mm_data to improve performance" (#15911)
|
2025-12-26 13:43:18 -08:00 |
|
Ratish P
|
886e038329
|
[model-gateway]: fix crash in embedding worker health check (#15910)
|
2025-12-26 12:57:13 -08:00 |
|
Muqi Li
|
01bd0d3e8b
|
[Tool Call][DSV32] Streamline function call parameters (#14750)
Signed-off-by: Muqi Li <muqi1029@gmail.com>
|
2025-12-26 11:35:30 -08:00 |
|
Lianmin Zheng
|
43e1bbc0d5
|
Revert "[feat] Init support for webui-I2I" (#15906)
|
2025-12-26 09:53:03 -08:00 |
|
Li Jinliang
|
59b12996fb
|
[diffusion] apps: support I2I tasks in webui (#15778)
|
2025-12-26 23:45:11 +08:00 |
|
Mick
|
b70914969b
|
[diffusion] CI: support returning request id from endpoint (#15844)
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
|
2025-12-26 23:38:03 +08:00 |
|
Xiaoyu Zhang
|
51dbdb2202
|
[diffusion] improve: improve qwen-image-edit performance to align with LightX2V (#15812)
Co-authored-by: Mick <mickjagger19@icloud.com>
|
2025-12-26 22:25:10 +08:00 |
|
Mick
|
8dc6f0fc4d
|
[diffusion] refactor: centralize hardware platform detection and streamline environment variable management (#15842)
|
2025-12-26 22:16:18 +08:00 |
|
Huaixin Chang
|
cf34d0ab32
|
[Fix] assert error in log_prefill_stats (#15881)
Signed-off-by: Chang Huaixin (OpenAnolis) <changhuaixin@linux.alibaba.com>
Co-authored-by: Junjie Mao (Alibaba) <banxing.mjj@alibaba-inc.com>
|
2025-12-26 19:54:35 +08:00 |
|
Prozac614
|
3778c2fc6d
|
[diffusion] CI: fix CI test case skip problem (#15874)
Co-authored-by: Mick <mickjagger19@icloud.com>
|
2025-12-26 19:42:20 +08:00 |
|
fzyzcjy
|
5d421db883
|
Tiny log warn users when tracing is automatically disabled (#15889)
|
2025-12-26 19:00:37 +08:00 |
|
shuwenn
|
fe3d47fc9d
|
fix: warn once per env var key (#15846)
|
2025-12-26 18:41:15 +08:00 |
|
Yi Zhang
|
ef92b4eb88
|
[BUGFIX] fix edge case for qwen3-next (#14209)
|
2025-12-26 17:14:37 +08:00 |
|
Annis
|
73c0c66ff8
|
[diffusion] ZImage support Tensor Parallel (#15849)
|
2025-12-26 14:58:14 +08:00 |
|
chhnb
|
a1e9b4edfa
|
diffusion: support Qwen-Image-Layered (#15817)
Co-authored-by: yhyang201 <yhyang201@gmail.com>
|
2025-12-26 14:57:01 +08:00 |
|
Liangsheng Yin
|
e75657c839
|
[Bug] fix piggyback load report return None bug (#15870)
|
2025-12-26 14:48:45 +08:00 |
|