Cheng Wan
|
6f9d0a89a0
|
[scheduler] fix: correcting extend_logprob_start_len calculation (#15922)
|
2025-12-28 14:57:04 -08:00 |
|
Mick
|
d7a3336ebe
|
[diffusion] fix: fix stages not logged when perf_dump_path is provided (#16016)
|
2025-12-28 23:17:43 +08:00 |
|
Xiaoyu Zhang
|
7d02c8e59f
|
[JIT kernel] CI support jit kernel tests (#15939)
|
2025-12-28 23:11:02 +08:00 |
|
Lianmin Zheng
|
e6d5a213ad
|
Fix metrics (#15998)
|
2025-12-28 05:03:49 -08:00 |
|
Mick
|
9f8e23071a
|
[diffusion] chore: fix default offload setting for image generation model (#15928)
|
2025-12-28 20:45:33 +08:00 |
|
fzyzcjy
|
d90f9bfc4e
|
Temporarily disable temp_prefill_info assertion to unblock CI (#16008)
|
2025-12-28 20:13:06 +08:00 |
|
Mick
|
3881bc8d0b
|
[diffusion] CI: relax threshold by supporting different profiles (#16002)
|
2025-12-28 20:05:07 +08:00 |
|
Baizhou Zhang
|
208e6a9dac
|
[Doc]Update MTP moe backends for EP document (#16013)
|
2025-12-28 19:36:23 +08:00 |
|
Liangsheng Yin
|
be3828a13b
|
Tiny cleanup duplicate code for multi-layer eagle worker. (#16004)
|
2025-12-28 18:08:20 +08:00 |
|
lif
|
5969be2f06
|
Apply fixture-kit mode to MMMUVLMMixin (#15615)
|
2025-12-28 17:22:05 +08:00 |
|
fzyzcjy
|
8fab48952e
|
Tiny fix WASM test errors on machines with many cores (#15992)
|
2025-12-28 17:12:04 +08:00 |
|
fzyzcjy
|
7ccaec6467
|
Add micro benchmarks for manual policy (#15991)
|
2025-12-28 17:11:56 +08:00 |
|
Cheng Wan
|
c457aad54a
|
Update test parameters for deepep_large test (#16001)
|
2025-12-28 00:58:19 -08:00 |
|
Liangsheng Yin
|
c7e7bfa32c
|
Add EAGLE3 test with MMLU dataset. (#15945)
|
2025-12-28 16:07:58 +08:00 |
|
Liangsheng Yin
|
bf90ea9c5b
|
Unify spec v2's naming manner. (#15990)
|
2025-12-28 14:14:52 +08:00 |
|
fzyzcjy
|
26c5091217
|
Tiny extract PeriodicTask in router (#15988)
|
2025-12-28 14:07:13 +08:00 |
|
fzyzcjy
|
325a4c1945
|
Tiny add smg_manual_policy_cache_entries metric (#15987)
|
2025-12-28 14:07:07 +08:00 |
|
TZHelloWorld
|
0294844f04
|
[fix]deepgemm precompile when warmup (#15891)
|
2025-12-28 13:47:39 +08:00 |
|
Alison Shao
|
0e536600e8
|
Refactor: separate CI-specific weight validation into dedicated module (#15216)
Co-authored-by: Kangyan-Zhou <zky314343421@gmail.com>
|
2025-12-27 20:50:39 -08:00 |
|
Vladislav Nosivskoy
|
d70c265533
|
SGLang Tracing: fix attribute errors (header extraction & bootstrap span closing) (#15693)
Signed-off-by: Vladislav Nosivskoy <vladnosiv@gmail.com>
Co-authored-by: ishandhanani <82981111+ishandhanani@users.noreply.github.com>
|
2025-12-27 22:44:31 -06:00 |
|
Baizhou Zhang
|
656f4d69a1
|
Refactor fp8 nextn layer for DeepSeek nvfp4 checkpoint (#15353)
|
2025-12-28 11:57:09 +08:00 |
|
DarkSharpness
|
8e43980ebb
|
[Feature] JIT Fused QK norm + qk norm clean up (#15835)
|
2025-12-28 11:53:50 +08:00 |
|
Hudson Xing
|
474a4699c5
|
Add correctness validation for decode_attention test (#15806)
|
2025-12-28 11:46:17 +08:00 |
|
Mick
|
b4a00ed2d9
|
[diffusion] chore: clean ComposedPipelineBase (#15937)
|
2025-12-28 11:43:25 +08:00 |
|
fzyzcjy
|
f55d608c89
|
Tiny fix cannot launch nvfp4 checkpoint with bf16 kv cache (#15986)
|
2025-12-28 11:22:20 +08:00 |
|
Ho-Ren (Jack) Chuang
|
349ce2dd19
|
Support kv8 (FP8) with torch_native attention backend (#12596)
Signed-off-by: Ho-Ren (Jack) Chuang <horenchuang@bytedance.com>
|
2025-12-28 10:48:30 +08:00 |
|
Lianmin Zheng
|
183b65190a
|
Clean up logging (#15919)
|
2025-12-27 15:27:12 -08:00 |
|
Ratish P
|
2af955e16c
|
[model-gateway]: remove unnecessary comment (#15947)
|
2025-12-27 13:33:02 -05:00 |
|
Yuhao Yang
|
0cd2b719a5
|
[diffusion] chore: remove useless params (#15925)
|
2025-12-28 01:01:08 +08:00 |
|
Mick
|
39d56196a0
|
[diffusion] logging: log available gpu mem while loading and generating (#15936)
|
2025-12-28 00:34:58 +08:00 |
|
Shangming Cai
|
41addd2e08
|
chore: bump mooncake version to 0.3.8 (#15886)
Signed-off-by: Shangming Cai <csmthu@gmail.com>
|
2025-12-27 23:34:24 +08:00 |
|
Hudson Xing
|
5c393e8153
|
Fix temp_prefill_info assertion error in PP disaggregation mode (#15943)
|
2025-12-27 22:46:55 +08:00 |
|
Simo Lin
|
3645ed0f73
|
[model-gateway] Add PrefixHash load balancing policy for KV cache-aware routing (#15935)
|
2025-12-27 05:58:05 -05:00 |
|
Ratish P
|
ca740a41f3
|
[model-gateway]: fix grpc embedding test (#15934)
|
2025-12-27 05:56:54 -05:00 |
|
Simo Lin
|
0e25aa439b
|
[model-gateway] optimize radix tree memory and reduce allocations (#15933)
|
2025-12-27 02:47:30 -08:00 |
|
jiaming1130
|
60a230b1fd
|
[NPU] Support w4a8 with activation clip (#14736)
Co-authored-by: ZhengdQin <46387172+ZhengdQin@users.noreply.github.com>
|
2025-12-27 16:19:46 +08:00 |
|
Mick
|
aa89c6a7e2
|
[diffusion] refactor: unify model loading and offloading behavior (#15923)
|
2025-12-27 16:18:24 +08:00 |
|
Simo Lin
|
171912a9e3
|
[model-gateway] Add consistent hashing for ManualPolicy routing (#15907)
|
2025-12-26 22:53:03 -08:00 |
|
Ke Bao
|
faecd37ed4
|
Add Mimo-v2-flash model to ci test (#15887)
|
2025-12-27 14:18:08 +08:00 |
|
Liangsheng Yin
|
9ad546d7e8
|
Tiny cleanup the models' name in test_utils (#15920)
|
2025-12-27 14:13:23 +08:00 |
|
Yuhao Yang
|
29ce7b3612
|
[diffusion] chore: remove stepvideo code (#15918)
|
2025-12-27 13:25:05 +08:00 |
|
Lianmin Zheng
|
a8380ded71
|
Add a test case for crash dump (#15905)
|
2025-12-26 19:39:28 -08:00 |
|
Simo Lin
|
4edee6954a
|
[model-gateway] add JWT/OIDC authentication for control plane APIs (#15850)
|
2025-12-26 18:30:00 -08:00 |
|
Douglas Yang
|
67caea6fe4
|
fix: adding deepseek base tests to b200 (#15915)
|
2025-12-26 18:04:25 -08:00 |
|
Zheng Wengang
|
cd3289c7a4
|
[BugFix][VLM] Correct weight loading with tie_word_embeddings == False (#15398)
|
2025-12-26 17:30:50 -08:00 |
|
Simo Lin
|
acddb8e0ec
|
Revert embedding integration tests from 5f3a47d8a (#15914)
|
2025-12-26 20:29:03 -05:00 |
|
Cheng Wan
|
2ec57cefd9
|
hotfix: add type hints to scheduler mixins (#15916)
|
2025-12-26 17:08:11 -08:00 |
|
Cheng Wan
|
988b14ca0e
|
refactor: add type hints to scheduler mixins (#15913)
|
2025-12-26 16:50:07 -08:00 |
|
Lianmin Zheng
|
93495dcac9
|
Revert "[VLM] Refactor load_mm_data to improve performance" (#15911)
|
2025-12-26 13:43:18 -08:00 |
|
Ratish P
|
886e038329
|
[model-gateway]: fix crash in embedding worker health check (#15910)
|
2025-12-26 12:57:13 -08:00 |
|