chenchenghao/sglang
1
0
Fork 0
Code Issues Pull Requests Actions 12 Packages Projects Releases Wiki Activity
9,885 Commits 1 Branch 0 Tags
cc63c99f112f781605017db018fced686cdc94de
Commit Graph

9885 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Netanel Haber
e75299a111 Fix issues/16714: Revert comment out of tl.debug_barrier() in causal_conv1d_triton (#16899) 
Co-authored-by: Yi Zhang <1109276519@qq.com>
 2026-01-14 17:26:48 +08:00
roikoren755
72bacc88c8 [NemotronH] Use ReplicatedLinear for fc1_latent_proj (#16569) 
Signed-off-by: Roi Koren <roik@nvidia.com>
 2026-01-14 17:08:27 +08:00
shaharmor98
ba625c2d90 Feat/support nemotron h mtp (#17013) 
Signed-off-by: Shahar Mor <smor@nvidia.com>
 2026-01-14 16:30:35 +08:00
Michael
b025cff441 [AMD] Add AMD CI registration (1-gpu unit test) to nightly CI. (#16941) 2026-01-13 23:41:45 -08:00
HuangJi
030496eb06 [diffusion] fix: fix --warmup-resolutions' conflict with CacheDiT (#16962) 2026-01-14 14:44:10 +08:00
sglang-bot
c86ca12875 chore: bump sgl-kernel version to 0.3.21 (#16888) 
Co-authored-by: sglang-bot <sglang-bot@users.noreply.github.com>
 2026-01-14 13:27:49 +08:00
shuwenn
cd33694585 feat: add --admin-api-key for finer-grained endpoint auth (#15908) 
Co-authored-by: Simo Lin <linsimo.mark@gmail.com>
 2026-01-13 20:21:55 -08:00
Alison Shao
c5e363e8e0 test: split Qwen3 Next tests and disable PCG tests due to intermittent failures (#16989) 2026-01-13 20:18:42 -08:00
Alison Shao
9479eca75d [CI] Fix max_parallel for scheduled runs (#17046) 2026-01-13 20:16:32 -08:00
Mick
a5348eac4c [diffusion] chore: avoid raising error when output resolution is not optimal (#17030) 2026-01-14 11:36:27 +08:00
Mick
9524040220 [diffusion] chore: refactor warmup logic (#17027) 2026-01-14 11:35:06 +08:00
ybyang
2122fea3c4 Update deepseekV32 Cp doc (#17054) 2026-01-14 11:19:26 +08:00
Liangsheng Yin
e2c8a50b38 fix grammar timeout sync across tp ranks. (#16898) 2026-01-14 10:26:31 +08:00
Lianmin Zheng
a4825ed588 Fix kernel type annotations for fp8 quant and logging (#16994) 2026-01-13 18:14:32 -08:00
Hubert Lu
afe285f7bd [AMD] enable CUDA graph for NSA backend and fix NSA FP8 fused RMSNorm group quant (#16841) 
Co-authored-by: wufann <715544327@qq.com>
 2026-01-13 17:36:01 -08:00
Ziwen Zhao
cf25852a1d [model-gateway] add --disable-health-check option to skip worker health probes (#17002) 2026-01-13 17:28:32 -08:00
Tony Lu
5938c3b06a [model-gateway] HA - Lightweight State Layer + gRPC Mesh (#14108) 
Signed-off-by: Kun(llfl) <i@imux.top>
Signed-off-by: Tony Lu <tonylu@linux.alibaba.com>
Co-authored-by: Kun(llfl) <i@imux.top>
 2026-01-13 17:03:39 -08:00
Alison Shao
b880607108 Add 5090 dry run stage to PR test workflow (#17022) 2026-01-13 14:12:33 -08:00
Byron Hsu
339915ce2b [logprob] Fix logprob + streaming for long concurrent decode by caching already processed logprob (#17005) 
Co-authored-by: root <root@memx-cge-29-sr1.xpop.twttr.net>
 2026-01-13 12:39:14 -08:00
Lianmin Zheng
075c5a5789 Code clean up for fp8 quantization (#16982) 2026-01-13 12:38:39 -08:00
Yuhao Yang
a0b4ba9032 [diffusion] model: GLM-Image (#16894) 
Co-authored-by: jianyingzhu <53300651@qq.com>
 2026-01-14 02:02:03 +08:00
Junrong Lin
2a7b67adff [CI/NPU] Fix ascend CI issue (#16953) 2026-01-13 23:39:12 +08:00
elvischenv
1d811094f8 [Misc] Auto download question file for benchmark/mtbench (#17019) 2026-01-13 10:34:29 -05:00
Xiaoyu Zhang
2ab3ed3e9e Fix sgl-kernel per_token_quant fp8 kernel scale shared_memory bug (#16886) 2026-01-13 23:22:05 +08:00
Praneth Paruchuri
250477d2ac [model-gateway] Optimize L1 cache insertion with incremental hashing and tokenization (#16259) 
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: Simo Lin <linsimo.mark@gmail.com>
 2026-01-13 06:24:25 -08:00
Praneth Paruchuri
af1232b2f2 [model-gateway] fix wasm example (#16924) 2026-01-13 06:21:47 -08:00
Mick
7a869045b6 [diffusion] chore: clean excessive document (#16986) 2026-01-13 21:33:50 +08:00
ahb13
888d7e54d1 [diffusion] fix: fix compatibility issue with torch.compile and flash attention v4 (#16790) 
Co-authored-by: root <root@nimrodb200.tail5cbfe.ts.net>
Co-authored-by: ahb13 <ahb13@qq.com>
 2026-01-13 21:11:19 +08:00
qichu-yun
3cb1fbaee4 [diffusion] fix: fix Qwen-Image-Edit Lightning LoRA alpha/rank scaling (read per-layer *.alpha) (#16935) 2026-01-13 21:09:11 +08:00
DarkSharpness
ba9f6d8f26 [Refactor] Clean up JIT kernel utilites (#16884) 
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: Xiaoyu Zhang <35585791+BBuf@users.noreply.github.com>
 2026-01-13 17:54:16 +08:00
Xiaoyu Zhang
740d3c0b39 [Diffusion] Remove useless dependency in diffusion (#16967) 2026-01-13 17:25:53 +08:00
Hubert Lu
8716589826 [AMD][Diffusion] support timestep embedding kernel for AMD GPUs (#16766) 2026-01-12 22:17:07 -08:00
fzyzcjy
ff3ddb9d9b Support min num routing keys in key-based load balancing policy (#16564) 2026-01-12 21:38:03 -08:00
fzyzcjy
9d3018f484 Support min load besides random routing key assignment policy in ManualPolicy (#16767) 2026-01-12 18:31:18 -08:00
HuangJi
a83484275d [diffusion] perf: optimize linear calculation in SLA (#16648) 2026-01-13 09:38:35 +08:00
Mick
47d485f35f [diffusion] fix: fix not respecting dit_layerwise_offload server arg (#16252) 2026-01-13 09:29:07 +08:00
Mick
2b42309955 [diffusion] UX: provide solutions for OOM (#16940) 2026-01-13 09:25:27 +08:00
James
ae0baefb94 [NPU] upgrade npu mf_apater plugin (#15853) 2026-01-13 09:02:10 +08:00
fzyzcjy
1f0e3d7fd8 Support tracking worker routing key loads in gateway (#16765) 2026-01-13 08:07:17 +08:00
Yinghai Lu
d3c08fb07c [layers] support zero-dim rmsnorm (#16978) 2026-01-12 15:53:19 -08:00
Simo Lin
c6a64e9f69 [smg] fix type complexity for workflow run_if (#16981) 2026-01-12 15:41:52 -08:00
Simo Lin
e0ac559ae1 feat(workflow): add scheduled/delayed steps and conditional branching (#16980) 2026-01-12 15:06:12 -08:00
Simo Lin
6620548fd8 [model-gateway] make StateStore trait async for external persistence (#16979) 2026-01-12 12:55:59 -08:00
Simo Lin
6e158e55b4 [model-gateway] improve workflow engine code quality (#16977) 2026-01-12 12:14:46 -08:00
Simo Lin
ed729d22b3 [model-gateway] refactor workflow engine from type erasure to typed engines (#16973) 2026-01-12 10:47:00 -08:00
Simo Lin
fa51b85466 [model-gateway] convert workflow system to type-safe workflow data (#16970) 2026-01-12 10:06:36 -08:00
Bhavneek Singh
559ff9ecaf Bug: fixed multi_chain_reasoning test (#16192) 2026-01-12 09:06:41 -08:00
Gaoji Liu
7b682de870 [Model] Support IQuest-Coder-40B-Loop (#16348) 
Co-authored-by: yxing <yxing@iquestlab.com>
Co-authored-by: yzhu <yzhu@ubiquant.com>
Co-authored-by: zelong518 <zelonghuang02@gmail.com>
 2026-01-12 23:44:45 +08:00
Simo Lin
d0092decb1 [model-gateway] Fix workflow engine race conditions and add graceful shutdown (#16963) 2026-01-12 06:37:39 -08:00
WenhaoZhang
76f69b7753 [diffusion] app: add ComfyUI plugin support for SGLang-Diffusion (#15271) 
Co-authored-by: niehen6174 <niehen.6174@gmail.com>
Co-authored-by: Mick <mickjagger19@icloud.com>
Co-authored-by: niehen6174 <nihen6174@gmail.com>
 2026-01-12 21:58:16 +08:00