Commit Graph

8653 Commits

Author SHA1 Message Date
Xiaoyu Zhang
62d0280f62 Tiny fix readme (#16654) 2026-01-07 20:41:07 +08:00
Even Zhou
d4b717c01e [NPU] update docs (#16651) 2026-01-07 20:20:01 +08:00
Hudson Xing
98a107d491 Re-enable temp_prefill_info assertion after pairing fix (#16203) 2026-01-07 18:05:17 +08:00
Hubert Lu
b86bbf841e [AMD] Add 8-GPU MX35X test running DSR1-MXFP4 model for AMD CI (#13602) 2026-01-07 01:43:11 -08:00
YC Tseng
48381c3b6d [AMD] suppress warning for amd (#16620) 2026-01-07 01:37:40 -08:00
YC Tseng
8bce085321 [AMD] CI - add 2 pp test cases to performance-test-2-gpu-amd (#16514) 2026-01-06 23:52:46 -08:00
Alison Shao
6b8a9d7058 fix: update AMD CI estimated time for test_torch_compile (#16631) 2026-01-06 23:42:18 -08:00
Shangming Cai
973116e6bb [Doc] Optimize pipeline parallelism doc (#16630)
Signed-off-by: Shangming Cai <csmthu@gmail.com>
2026-01-07 14:52:42 +08:00
Thomas Wang
820e97d6c9 Upgrade aiter version (#16619) 2026-01-06 22:20:42 -08:00
Minglei Zhu
4c85f9d039 Only allocate encoder metadata for encoder-decoder models (#16527) 2026-01-06 22:17:04 -08:00
Baizhou Zhang
7d757d6f17 Clean Some Environment Variables for DeepSeek V32 (#15938) 2026-01-07 14:00:16 +08:00
Douglas Yang
5c04088b3a fix: remove performance testing from nightly dpsk v32 cp single node (#16582) 2026-01-07 13:38:31 +08:00
Chi McIsaac
f066036c8b [diffusion] fix: fix ZImage SP sharding for 5D latents and unpad frames (#16418)
Signed-off-by: Chi <chixie.mcisaac@gmail.com>
2026-01-07 13:24:04 +08:00
Alison Shao
52de807dd7 Migrate profiling tests to test/registered/profiling/ (#16459) 2026-01-06 21:04:48 -08:00
Alison Shao
70933f34f1 Migrate attention unit tests to test/registered/attention/ (#16465) 2026-01-06 20:50:54 -08:00
Alison Shao
ce453fa43b Migrate backends tests to CI registration system (#16468) 2026-01-06 20:31:52 -08:00
fzyzcjy
3be1e734ee [model-gateway] extract header extraction in policy and add (#16566) 2026-01-06 20:18:44 -08:00
Alison Shao
38895a0064 ci: adjust partition counts for stage-b and unit tests (#16617) 2026-01-06 20:18:10 -08:00
Simo Lin
d8b8198192 [smg][ci]: migrate benchmarks to e2e_test/benchmarks/, use parent conftest (#16597) 2026-01-06 20:15:20 -08:00
Yingchun Lai
913b688f21 fix: fill a meaningful tool_index (#16504) 2026-01-06 20:00:09 -08:00
Douglas Yang
951d16c890 fix: adjusting vlm accuracy thresholds (#16593) 2026-01-06 19:41:05 -08:00
Yuan Luo
53846746bf [VLM] Fix CUDA IPC OOM (#16118)
Co-authored-by: luoyuan.luo <luoyuan.luo@antgroup.com>
2026-01-07 11:30:35 +08:00
MOHENOO
534ac384db [HiCacheStorage & PD] fix prefill bootstrap request host memory leaks (#15439)
Co-authored-by: yangjia1 <yangjia1@kingsoft.com>
2026-01-07 11:03:57 +08:00
Yuwei An
2a8d5493f3 PCG Unit Test Adjustment (#16609)
Signed-off-by: Oasis-Git <ayw.sirius19@gmail.com>
2026-01-07 10:57:15 +08:00
Alison Shao
90eac38a12 Migrate FP8/TorchAO tests to test/registered/quant/ (#16453) 2026-01-06 18:27:43 -08:00
Mick
badcd02896 [diffusion] chore: automatically enable dit_layerwise_offload for Wan (#16499) 2026-01-07 10:22:08 +08:00
fzyzcjy
d874c8bba4 Tiny support http headers in bench serving (#16606) 2026-01-07 10:15:17 +08:00
fzyzcjy
9a21d89c5b Tiny add metrics for prefill delayer (#16603) 2026-01-07 09:53:52 +08:00
Hexq0210
4c9ac8566c [NPU] fix command in npu best practice (#16576) 2026-01-07 09:37:27 +08:00
Chang Su
fb5b71d015 [router][openai] Rename prepare_mcp_payload_for_streaming and patch_streaming_response_json (#16596) 2026-01-06 16:33:29 -08:00
Chang Su
05b54b6d7b [router][grpc] Replace Vec<(String, String, String)> with ExtractedToolCall (#16598) 2026-01-06 16:32:59 -08:00
Chang Su
4f443f445a [model-gateway][cleanup] Fix wrong comment in manager.rs (#16601) 2026-01-06 16:32:37 -08:00
Simo Lin
dce8b0606c refactor(e2e): keep only benchmark tests in e2e_http, remove redundant tests (#16594) 2026-01-06 15:05:08 -08:00
Alison Shao
399d5283f8 ci: migrate scheduler tests to test/registered/scheduler/ (#16442) 2026-01-06 14:55:52 -08:00
Alison Shao
2e0527dd74 ci: migrate Debug Utils, Ops, and Rotary Embedding tests to test/registered/ (#16422) 2026-01-06 14:35:57 -08:00
Yingchun Lai
6beb50d612 feat: add .dockerignore to ignore files when build images (#16223) 2026-01-06 14:34:16 -08:00
Kangyan-Zhou
18e2ef09d7 Add v1/models endpoint to diffusion model APIs so that they can be discovered by model gateway (#16425) 2026-01-06 14:28:24 -08:00
Alison Shao
3271e0e76d Remove dllm-test-1-gpu-amd job (followup to DLLM migration) (#16589) 2026-01-06 14:27:37 -08:00
Simo Lin
d415d22daa refactor(e2e): remove old embedding tests migrated to e2e_test/embeddings (#16592) 2026-01-06 14:07:45 -08:00
Simo Lin
a49b9a6420 [model-gateway] add embedding tests (#16583) 2026-01-06 13:24:37 -08:00
Douglas Yang
5349764298 fix: kimi k2 thinking accuracy threshold change (#16585) 2026-01-06 13:18:43 -08:00
Simo Lin
d57d8e7e5f [smg] clean up logs in mcp (should be info instead warn) (#16591) 2026-01-06 12:44:32 -08:00
Alison Shao
0cbd8f3247 ci(test): migrate OpenAI server tests to registered CI system (#16326)
Co-authored-by: Kangyan-Zhou <zky314343421@gmail.com>
2026-01-06 11:09:37 -08:00
Douglas Yang
6e3fff1352 fix: adding retries for server start and increasing hf read timeout (#16523) 2026-01-06 09:53:12 -08:00
Alison Shao
2210155a45 ci: migrate DLLM tests to test/registered/dllm/ (#16420) 2026-01-06 09:44:26 -08:00
Simo Lin
a3656cbb96 [ci] fix url strips in smg ci (#16548)
Co-authored-by: Chang Su <chang.s.su@oracle.com>
2026-01-06 09:23:58 -08:00
Chang Su
21da2dc1ce [grpc] Unify ResponsesContext and HarmonyResponsesContext (#16549) 2026-01-06 07:28:06 -08:00
fzyzcjy
ed307a40bf Tiny add --gsp-ordered (#16575) 2026-01-06 22:43:52 +08:00
Ke Bao
02722b9113 Fix evict swa for overlap scheduler and page size > 1 (#16507) 2026-01-06 22:29:40 +08:00
fzyzcjy
f959250f76 Tiny support sglang_routing_keys_active in engine (#16570) 2026-01-06 22:10:10 +08:00