Commit Graph

9885 Commits

Author SHA1 Message Date
Liangsheng Yin
75da784d48 Tiny simplify draft worker init. (#16446) 2026-01-09 11:20:29 +08:00
Liangsheng Yin
77d3566555 Tiny fix wording about CI preemption. (#16773) 2026-01-09 11:08:17 +08:00
Yongfei Xu
05dfef92a1 [DeepSeek 3.2] Support and optimize pipeline parallelis when context pipeline enabled (#16380)
Co-authored-by: ybyang <ybyang7@iflytek.com>
2026-01-09 11:01:49 +08:00
Simo Lin
7460240737 [model-gateway] release 0.3.1 (#16254) 2026-01-08 17:49:37 -08:00
triple-mu
f7f5c3896d [diffusion] model: wan tp+usp optimize (#16720)
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: Xiaoyu Zhang <35585791+BBuf@users.noreply.github.com>
2026-01-09 09:40:31 +08:00
fzyzcjy
9e3a032ad6 [smg] cleanup router RAII guards (#16560) 2026-01-08 16:39:53 -08:00
Simo Lin
1bc7aa5801 [smg] update gRPC proto to match upstream changes (#16764)
Co-authored-by: Chang Su <chang.s.su@oracle.com>
2026-01-08 16:33:09 -08:00
Simo Lin
8726d30cb2 [smg] Add Nemotron Nano V3 reasoning parser support (#16763) 2026-01-08 16:29:24 -08:00
Douglas Yang
a1b243d76f fix: extend cpu only install dependency timeout to 20 mins (#16759) 2026-01-08 16:08:21 -08:00
Alison Shao
a979927727 Skip causal_conv1d test with padded batches due to Triton kernel bug (#16715) 2026-01-08 15:13:13 -08:00
Simo Lin
ee71e773e1 [smg] Work around sglang's notorious orphan process problem (#16756) 2026-01-08 14:41:03 -08:00
Simo Lin
55a8dd0095 [grpc] Fix protobuf compilation in isolated build environments (#16754) 2026-01-08 13:09:01 -08:00
Simo Lin
cf24232100 fix(e2e): prevent potential hangs in model pool subprocess handling (#16752) 2026-01-08 12:35:56 -08:00
Simo Lin
9d03af916a [smg][ci] delete old chat completion integration tests and workflow step (#16751) 2026-01-08 11:31:54 -08:00
Liangsheng Yin
064ae3419e Adjust the cancel PR workflows for better preemption. (#16749) 2026-01-09 03:25:41 +08:00
Simo Lin
49305fa1c1 [smg][ci] migrate function calling tests to new infrastructure (#16748) 2026-01-08 11:08:01 -08:00
YC Tseng
4e999404c3 [AMD] Fix CI - unit-test-backend-1-gpu-amd-mi35x and unit-test-backend-2-gpu-amd, stage-b-test-small-1-gpu-amd (#16675)
Co-authored-by: Bingxu Chen <bingxche@amd.com>
2026-01-08 10:16:27 -08:00
Simo Lin
fbc24886dd [smg][ci] migrate validation tests to new infrastructure (#16746) 2026-01-08 09:26:31 -08:00
Chang Su
16880235d1 [grpc] Auto-generate protobuf files during wheel build (#16409) 2026-01-08 09:09:54 -08:00
Yi Zhong
cda35611d4 [perf] Add two stream norm for Olmo3 speedup 5% (#13681)
Signed-off-by: Vincent Zhong <207368749+vincentzed@users.noreply.github.com>
Co-authored-by: b8zhong <b8zhong@uwaterloo.ca>
2026-01-08 17:01:35 +00:00
Simo Lin
8a45a9c6a9 [smg][ci] fix model pool GPU cleanup and add startup reliability improvements (#16745) 2026-01-08 08:55:18 -08:00
Simo Lin
aecd5f5f3e [smg][ci] migrate reasoning_content tests to new infrastructure (#16741) 2026-01-08 08:25:39 -08:00
Mohammad Miadh Angkad
05ab110e02 [Performance] Force split_k=1 for MXFP4 Triton kernels on Hopper (#16014)
Signed-off-by: Mohammad Miadh Angkad <MAngkad.BSDSBA2027@aim.edu>
2026-01-08 23:52:22 +08:00
Simo Lin
c8dc4d2d1f [smg][ci] migrate enable_thinking tests to new infrastructure (#16739) 2026-01-08 06:57:45 -08:00
cheng peng
82a8d77bc0 [Diffusion] model: fix zimage tp (#16719)
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
2026-01-08 22:47:21 +08:00
Xiaoyu Zhang
294ff71d18 [Diffusion] Avoid cpu2gpu sync in flashinfer rope and apply flashinfer rope to wanvideo (#16668)
Co-authored-by: Mick <mickjagger19@icloud.com>
2026-01-08 22:44:38 +08:00
Simo Lin
f52ae586b6 Remove migrated e2e_grpc/basic tests (#16738) 2026-01-08 06:30:45 -08:00
Simo Lin
2f8a36347c [smg][ci] migrate chat completions tests to new infrastructure and build wheel once and share via artifact (#16709) 2026-01-08 06:29:23 -08:00
fzyzcjy
b6e8a0d851 Add file size hints in bitwise model file verifier (#16735) 2026-01-08 22:28:52 +08:00
luoyuyan
fb7609f1dd Fix FP8 MoE NaN with DeepGEMM on Blackwell (#16622) 2026-01-08 22:24:12 +08:00
yuhao
d2ea44f775 VLM: enhance VL embedding model with video input support and revise warm-up strategy (#16635)
Co-authored-by: Mick <mickjagger19@icloud.com>
2026-01-08 22:12:01 +08:00
Hexq0210
20ca2c6e1e [NPU] update model and features supported (#16733) 2026-01-08 21:50:42 +08:00
fzyzcjy
83abecd0c2 Support pre-generating and using expected checksums (#16730) 2026-01-08 20:26:13 +08:00
fzyzcjy
d54f0a10b4 Support bitwise weight checksum verifier (#16729) 2026-01-08 20:19:25 +08:00
Lianmin Zheng
fb04e7e3c8 [Auto Sync] Update schedule_batch.py, common.py, eagle_info... (20260105) (#16519)
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: cctry <shiyang@x.ai>
2026-01-08 02:35:46 -08:00
Douglas Yang
1e5de05e35 fix: adding timeout for install dependencies (#16706) 2026-01-08 00:30:41 -08:00
chenxu214
7dd679cbb9 [NPU][Bugfix] Fix qwen3 error when enable-dp-lm-head (#16115) 2026-01-08 15:15:43 +08:00
YC Tseng
3d51ae18a1 [AMD] Turn on AMD CI if rocm.Dockerfile changed (#16634) 2026-01-07 22:51:53 -08:00
Bingxu Chen
f9c0426692 [AMD CI] re-enable testcases missed when migrating ci test files (#16535)
Co-authored-by: michael-amd <michael.zhang@amd.com>
Co-authored-by: yctseng0211 <yctseng@amd.com>
2026-01-07 22:43:48 -08:00
陈一涵
48b8dcd42e [jit kernel] support dtype as a cpp template parameter (#16452) 2026-01-08 13:54:33 +08:00
Fan Lin
41b434a7e6 [diffusion] endpoint: add API endpoint to query loaded LoRA adapters information (#16533) 2026-01-08 13:51:26 +08:00
Hubert Lu
4935344fcd [AMD] Fix aiter page-size handling, DeepSeek MLA tuple inputs, and HiCache/FA3 decode-backend override (#16531) 2026-01-07 21:14:32 -08:00
Alison Shao
63cc97f4ef ci: migrate 2-GPU tests to test/registered/ (#16529) 2026-01-07 20:28:16 -08:00
Alan Kao
ab7d5829cd [AMD] Add pip install / wheel build support for ROCm sgl-kernel (#15627) 2026-01-07 20:18:29 -08:00
hw-csong
261860e17b [NPU][Bugfix] move free_page logics to cpu (#16608) 2026-01-08 12:00:18 +08:00
Yuwei An
154740bd4d Disable PCG TP Unittest (#16693)
Signed-off-by: Oasis-Git <ayw.sirius19@gmail.com>
2026-01-07 19:59:47 -08:00
MarcoDWei
1c09cbe3ed [Build] Enable full kernel in aarch64 wheel (#16155) 2026-01-07 19:40:03 -08:00
Yuhao Yang
e14f5ec8a8 [diffusion] refactor: eliminate redundant parameters in req (#16505)
Co-authored-by: Mick <mickjagger19@icloud.com>
2026-01-08 11:14:03 +08:00
Liangsheng Yin
8867d24879 Tiny adjust cancel PR workflow. (#16697) 2026-01-08 11:13:46 +08:00
siyu
6b3f93c4dd vlm: support SGLANG_MM_SKIP_COMPUTE_HASH for bypassing multimodal feature hashing (#16555) 2026-01-08 11:10:00 +08:00