chenchenghao/sglang
1
0
Fork 0
Code Issues Pull Requests Actions 11 Packages Projects Releases Wiki Activity
9,885 Commits 1 Branch 0 Tags
cc63c99f112f781605017db018fced686cdc94de
Commit Graph

9885 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Chang Su
7bc13c906c [grpc] update api to scheduler in grpc request manager (#16350) 2026-01-03 10:54:31 -08:00
fzyzcjy
877c8e3a96 Tiny refactor router test contexts (#16340) 2026-01-03 09:44:10 -08:00
fzyzcjy
66dfb8c156 Tiny fix non-PD router http header missing whitelist (#16339) 
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
 2026-01-03 09:43:02 -08:00
Chi McIsaac
dcacc492d0 [diffusion] fix: fix RuntimeError in SageAttention3 on Blackwell with Qwen-Image (#16335) 
Co-authored-by: qimcis <qimcis@users.noreply.github.com>
Co-authored-by: Mick <mickjagger19@icloud.com>
 2026-01-03 22:12:53 +08:00
fzyzcjy
87ef05e2e1 Support simple schedule simulator (#16344) 2026-01-03 22:05:40 +08:00
fzyzcjy
b65c9889a0 Fix incorrect running batch size in prefill stats (#15941) 2026-01-03 20:49:54 +08:00
fzyzcjy
c7c0d97fc6 Tiny support whitelisted headers in request logging (#16342) 2026-01-03 20:10:58 +08:00
shengzhaotian
6bc5a52fd2 [NPU] Adapt qwen3-next W8A8 on NPU (#16164) 2026-01-03 19:41:20 +08:00
Mick
2c09de343e [diffusion] improve: skip loading vision module for text encoders (#16304) 2026-01-03 19:30:45 +08:00
Mick
38d48de93d [diffusion] CI: simplify warmup (#16303) 
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
 2026-01-03 18:09:38 +08:00
fzyzcjy
7f2fa2167b Tiny add --log-requests-target (#16338) 2026-01-03 17:28:27 +08:00
Xiaoyu Zhang
d0fb24ee7b [Diffusion] Flux2 tp support (#16219) 
Co-authored-by: Mick <mickjagger19@icloud.com>
 2026-01-03 17:02:27 +08:00
Simo Lin
65b0b5b248 fix(logging): use Display format for model_id instead of Debug (#16337) 2026-01-03 00:21:39 -08:00
Siyuan Chen
9a414b164c [Performance] Optimze the performance of Qwen25VL (#15640) 
Co-authored-by: Xinyuan Tong <115166877+JustinTong0323@users.noreply.github.com>
 2026-01-02 23:15:36 -08:00
Alison Shao
5b4f790200 [diffusion] CI: add CI validation for diffusion model downloads (#16311) 2026-01-03 14:12:45 +08:00
Chang Su
d8ac5eecf7 [model-gateway] bug fix on module name (#16332) 2026-01-02 21:56:18 -08:00
Teng Ma
bdde949619 [HiCache] Add PP Support with suffix pp rank (#15175) 
Co-authored-by: Xuchun Shang <xuchun.shang@gmail.com>
Co-authored-by: ybyang <10629930+whybeyoung@users.noreply.github.com>
Co-authored-by: Shangming Cai <csmthu@gmail.com>
 2026-01-03 13:49:21 +08:00
Chang Su
b23e7ed13c refactor(gateway): shorten logging targets from sgl_model_gateway to smg (#16328) 2026-01-02 21:12:33 -08:00
fzyzcjy
9821fae5c6 Tiny add explanations to realtime token metric labels (#16009) 2026-01-03 12:36:55 +08:00
siyu
078d96213a [FEAT] optimize tensor zmq transfer for multimodal inputs (#13592) 
Co-authored-by: Shangming Cai <csmthu@gmail.com>
Co-authored-by: Yuhao Yang <47235274+yhyang201@users.noreply.github.com>
 2026-01-03 12:23:23 +08:00
Douglas Yang
8b111b20c3 feature: improvements to CI failure monitor (#16272) 2026-01-02 20:09:41 -08:00
b8zhong
74a166cb86 [Fix] Only add SM90 and SM100 to check for auto-enabling TRT Allreduce Fusion (#16283) 2026-01-03 11:43:17 +08:00
triple-mu
888e126ac9 [diffusion] comment: fix typo (#16257) 
Co-authored-by: Mick <mickjagger19@icloud.com>
 2026-01-03 11:42:04 +08:00
Baizhou Zhang
bb23a8fe77 [Tiny]Remove progress bar for fp8 ue8m0 quant when unneeded (#16177) 2026-01-03 10:54:12 +08:00
sunxxuns
8b869e326c [AMD] feat: add DLLM support for AMD GPUs with LLaDA2 testing (#15560) 2026-01-03 10:41:11 +08:00
Alison Shao
6256936d09 Fix: Allow build-wheels to run when target_stage is set (#16324) 2026-01-02 17:58:11 -08:00
Lianmin Zheng
62f73a8c81 [Auto Sync] Update engine.py (20260102) (#16317) 
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
 2026-01-02 17:29:40 -08:00
Ke Bao
7c1b4b1c4c Support swa allocator page size > 1 (#16296) 2026-01-03 08:49:47 +08:00
Simo Lin
31ed68e7c1 [model-gateway] address embedding similarity threshold in ut (#16321) 2026-01-02 16:46:55 -08:00
Chang Su
24c91001cf [model-gateway] code clean up in tokenizer register step workflow (#16316) 2026-01-02 16:05:10 -08:00
Chang Su
c4edcac6d7 refactor(core): remove get_by_model_fast alias in worker_registry (#16313) 2026-01-02 16:04:23 -08:00
Chang Su
e93433892b refactor(steps): consolidate duplicate strip_protocol function (#16318) 2026-01-02 16:02:42 -08:00
Chang Su
a2d4f58a96 fix(http): use 504 Gateway Timeout for upstream timeouts (#16320) 2026-01-02 16:01:44 -08:00
Chang Su
f66b091699 refactor(http): improve pd_types.rs documentation and style (#16319) 2026-01-02 16:01:11 -08:00
Chang Su
2f623368ab refactor(core): use idiomatic .min() in calculate_delay (#16314) 2026-01-02 15:46:13 -08:00
Chang Su
bd9a2ced47 refactor(core): use thiserror for WorkerError (#16315) 2026-01-02 15:33:07 -08:00
Chang Su
0ca417d9ae chore(core): remove unused serde_json import in worker.rs (#16312) 2026-01-02 15:31:41 -08:00
sunxxuns
30cfb687fa fixed amd multimodal CI failures caused by refactor in #15812 #15813 (#16287) 2026-01-02 14:55:42 -08:00
Chenxi Li
b7c7e03d93 Fix crash dump replay script for image data replay (#16277) 2026-01-02 13:42:22 -08:00
Alison Shao
f0195627a9 Fix sgl-kernel jobs to skip when target_stage is specified (#16308) 2026-01-02 12:49:26 -08:00
Simo Lin
d401d23876 [model-gateway] Add embedding correctness test comparing against HuggingFace (#16092) 
Co-authored-by: Chang Su <chang.s.su@oracle.com>
 2026-01-02 10:58:20 -08:00
Alison Shao
17041f4673 Enable /rerun-stage slash command to work on fork PRs (#16128) 2026-01-02 10:36:12 -08:00
Baizhou Zhang
f07e76b229 Multiple refactors of DeepSeek V32 and context parallel (#16305) 2026-01-03 02:21:22 +08:00
Xiaoyu Zhang
1cfd2b2ded [diffusion] chore: remove redundant ulysses nccl warmup (#16301) 2026-01-03 00:19:35 +08:00
Yongfei Xu
0d244116d2 [DeepSeek v3.2] opt Context Parallelism: support fused moe, multi batch and fp8 kvcache (#13959) 2026-01-02 23:49:14 +08:00
Changyi Yang
0eae831797 [diffusion] fix: Increase text length from 256 to 1024 in Qwen-Image (#16248) 
Co-authored-by: Mick <mickjagger19@icloud.com>
 2026-01-02 23:25:31 +08:00
Ke Bao
c483a5f45f Tiny adjust hybrid swa handling (#16292) 2026-01-02 23:11:23 +08:00
Mick
f26f6c2c99 [diffusion] fix: make lora compatible with layerwise-offload (#16298) 
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
 2026-01-02 22:33:26 +08:00
roikoren755
b021332339 [NemotronH] Add latent MoE support (#16227) 
Signed-off-by: Roi Koren <roik@nvidia.com>
 2026-01-02 22:08:58 +08:00
Mick
5062537b67 [diffusion] feat: support lightweight e2e warmup for benchmarking (#16213) 2026-01-02 20:10:27 +08:00