chenchenghao/sglang
1
0
Fork 0
Code Issues Pull Requests Actions 12 Packages Projects Releases Wiki Activity
9,885 Commits 1 Branch 0 Tags
cc63c99f112f781605017db018fced686cdc94de
Commit Graph

9885 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Lianmin Zheng
25e97380e3 Fix CUDA version handling in ci_install_deepep.sh (#14854) 2025-12-10 16:52:30 -08:00
Alison Shao
b6523a4f72 fix: restrict cache validation behaviors to CI only (#14849) 2025-12-10 16:03:53 -08:00
b8zhong
c51efb8b84 fix fp8 gemm nightly CI (#14844) 
Co-authored-by: Brayden Zhong <b8zhong@users.noreply.github.com>
 2025-12-10 15:57:51 -08:00
Simo Lin
bcc5483ed7 [model-gateway] fix import order in oai conversation (#14851) 2025-12-10 15:36:42 -08:00
Simo Lin
ccf2602773 [model-gateway] code clean up on oai router (#14850) 2025-12-10 15:34:27 -08:00
Binyao Jiang
a4992873d4 Treat unittest SkipTest exception as pass instead of as failure (#14847) 2025-12-10 15:28:21 -08:00
michael-amd
c97ce39181 [AMD] Add model to AMD nightly test (#14442) 2025-12-10 11:59:44 -08:00
Simo Lin
c032b559a8 [model-gateway] adds default implementations to RouterTrait in mod.rs (#14841) 2025-12-10 11:46:35 -08:00
b8zhong
da9b801eb7 fix lora target all + csgmv backend (#14796) 2025-12-10 11:42:51 -08:00
Siyuan Chen
0e54a69548 [bugfix] qwen25-VL support lora (#14638) 2025-12-10 11:38:51 -08:00
Praneth Paruchuri
e99ee0c695 [model-gateway] Fix incompatible metric comparison in PowerOfTwo policy (#14823) 2025-12-10 11:15:38 -08:00
Yuhao Yang
c1bd5ee8c5 Revert transformers to 4.57.1 (#14801) 2025-12-10 11:04:36 -08:00
Yineng Zhang
ef1ab2302a [Auto Sync] Update tool_chat_template_deepseekv31.jinja (20251210) (#14837) 
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: Jue Wang <zjuwangjue@gmail.com>
 2025-12-10 10:56:24 -08:00
Mick
d659873762 [diffusion] CI: use unified sampling_params for CI (#14045) 2025-12-11 01:18:56 +08:00
Mick
6c5ebc0ef7 [diffusion] parallel: pad tokens for video models under sp (#14833) 2025-12-11 01:15:37 +08:00
Ke Bao
5b5571a8da Apply back moe_sum_reduce for fused_marlin_moe (#14829) 2025-12-11 00:39:41 +08:00
Alison Shao
1698c2341b [CI] Reduce stage-b auto-partition from 4 to 2 (#14769) 
Co-authored-by: Liangsheng Yin <lsyincs@gmail.com>
 2025-12-11 01:32:33 +09:00
fzyzcjy
3d82c0f17f [model-gateway] support engine response http status statistics in router (#14712) 2025-12-10 08:30:53 -08:00
fzyzcjy
617e9b3bf8 [model-gateway] support customizing Prometheus duration buckets (#14716) 2025-12-10 08:30:03 -08:00
Li Jinliang
83e35a7c29 [diffusion] doc: fix tiny typo in multimodal_gen/README.md (#14830) 2025-12-11 00:27:25 +08:00
Simo Lin
2543666c8e [model-gateway] add anthropic message api spec (#14834) 2025-12-10 08:26:51 -08:00
Alison Shao
f732f8ea57 Fix CI registry scan to only check test/registered directory (#14812) 2025-12-11 01:09:03 +09:00
Liangsheng Yin
503880dbbe [CI] fix UT success check in test_eagle_infer_beta_dp_attention.py (#14831) 2025-12-11 01:00:50 +09:00
liupeng374
b8cfa02c01 [NPU] bug fix for mtp and w4a8 (#14806) 2025-12-10 22:55:13 +08:00
fzyzcjy
d85fecb536 Tiny fix incorrect worker removal command (#14822) 2025-12-10 22:29:39 +08:00
fzyzcjy
6634f67bd5 Fix router keep nonzero metrics after worker is deleted (#14819) 2025-12-10 22:29:30 +08:00
fzyzcjy
5eccaf7737 Support HTTP response status code prometheus metrics (#14710) 2025-12-10 22:28:57 +08:00
Wenyi Xu
d7f6320bb8 [model-gateway] Dynamically Populate Tool Call Parser Choices (#14807) 2025-12-10 06:04:22 -08:00
ybyang
766476f52a [SMG-GO] implement a Go SGLang Model Gateway - OpenAI Compatible API Server (#14770) 2025-12-10 06:03:28 -08:00
Xiaoyu Zhang
12b7a4fab0 [diffusion] performance: refactor diffusion fuse qkv and apply to qwen-image (#14793) 2025-12-10 18:55:41 +08:00
Yuhao Yang
02f1e81e2d Revert "fix: checking if tokenizer is in cache before downloading from HF" (#14808) 2025-12-10 01:14:35 -08:00
Prozac614
908c7186af [diffusion] CI: Add LoRA support to diffusion server configuration and test cases (#14697) 2025-12-10 16:51:47 +08:00
Yuan Luo
03836d85d2 [GLM-4.6V] Support Pipeline Parallelism for GLM-4.6V & GLM-4.1V (#14720) 
Co-authored-by: luoyuan.luo <luoyuan.luo@antgroup.com>
 2025-12-10 16:40:12 +08:00
Mick
87dbdddc93 [diffusion] profile: early exit when enough steps are captured to reduce the size of the trace file (#14803) 2025-12-10 16:11:22 +08:00
b8zhong
56e5c07424 fix b200 fa4 ci (#14788) 2025-12-10 00:03:43 -08:00
yrk111222
6c9c8da64d fix: add missing logic for SGLANG_USE_MODELSCOPE variable (#14794) 2025-12-10 15:49:34 +08:00
Peng Zhang
21028b5507 [RL] support weight reload for low-bit rollout (#9650) 
Co-authored-by: Hecate0821 <hec4te0821@gmail.com>
Co-authored-by: eternally-z <zzywzj@gmail.com>
Co-authored-by: Wilboludriver <wilbolu@outlook.com>
Co-authored-by: Wilbolu <81792854+Wilboludriver@users.noreply.github.com>
Co-authored-by: Ke Bao <ispobaoke@gmail.com>
 2025-12-10 15:44:01 +08:00
b8zhong
b0a25d0913 fix b200 ci (#14786) 2025-12-09 23:08:41 -08:00
Yuhao Yang
793c98afaf handling incomplete rope_scaling config ci after transformers upgrade (#14784) 2025-12-09 22:56:16 -08:00
TomerBN-Nvidia
b1cbfce612 fix server args bug (#14725) 2025-12-09 21:05:05 -08:00
Alison Shao
b0f531ad28 Fix VLM accuracy thresholds for nightly tests (#14777) 2025-12-09 20:59:23 -08:00
Alison Shao
01835998e1 fix: race condition between validation and download locks (#14761) 2025-12-09 20:36:54 -08:00
Lianmin Zheng
4285e99da7 [Auto Sync] Update data_parallel_controller.py, detokenizer... (20251209) (#14759) 
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
 2025-12-09 18:38:38 -08:00
ShawnY112358
f077436831 [fix] Fix issues for in-flight weight updates (#14064) 
Co-authored-by: 赵晨阳 <zhaochen20@outlook.com>
 2025-12-09 18:12:19 -08:00
Alison Shao
5e8f544d1b Disable 8-gpu-b200 runner in PR tests (#14768) 2025-12-09 17:47:54 -08:00
Douglas Yang
c8d74feb06 fix: adding rate limit warning at verify token permission stage (#14756) 2025-12-09 17:21:04 -08:00
Liangsheng Yin
cbc7dcdaa7 Re-add the API serving timing metrics. (#14744) 
Signed-off-by: zhanghaotong <zhanghaotong.zht@antgroup.com>
Co-authored-by: zhanghaotong <zhanghaotong.zht@antgroup.com>
 2025-12-10 10:17:48 +09:00
MingxuZh
a6dc7d2932 [ci]: Enable the new hf API (#14687) 2025-12-09 17:07:51 -08:00
Simo Lin
390406c46c [model-gateway] release gateway 0.2.4 (#14763) 2025-12-09 16:34:29 -08:00
Ethan (Yusheng) Su
0c63fb9420 [Feature] Add LoRA support for embedding layers (#14177) 
Co-authored-by: Baizhou Zhang <sobereddiezhang@gmail.com>
Co-authored-by: Beichen-Ma <bm685@cornell.edu>
 2025-12-09 15:53:33 -08:00