chenchenghao/sglang
1
0
Fork 0
Code Issues Pull Requests Actions 11 Packages Projects Releases Wiki Activity
8,557 Commits 1 Branch 0 Tags
c35eb0fdee490f9844dad08fc3fe97cb4a124ee6
Commit Graph

8557 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Lianmin Zheng
c35eb0fdee [Auto Sync] Update loader.py (20260105) (#16478) 
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: xiuyuli-xai <xiuyu@x.ai>
 2026-01-05 01:34:30 -08:00
fzyzcjy
7f35c46efb Tiny add sglang:http_requests_active metric (#16479) 2026-01-05 17:20:31 +08:00
DarkSharpness
da2f8cc33f [minor] reduce 1 unnecessary add (#16474) 2026-01-05 01:00:56 -08:00
fzyzcjy
4308c25b47 Super tiny move test folder (#16447) 2026-01-05 16:29:26 +08:00
fzyzcjy
4d737db857 Tiny fix prefill delayer not support non-fcfs schedule policy (#16471) 2026-01-05 16:28:54 +08:00
fzyzcjy
9d6029fb92 Fix TokenizerManager bottleneck for offline generation (#16456) 2026-01-05 16:28:25 +08:00
Qi Yuhang
dcfb92ddbc [diffusion] fix: fix using the sub-optimal fa kernel (#16382) 2026-01-05 16:25:41 +08:00
Netanel Haber
bebd625ba1 EVS Framework: Support NemotronH_Nano_VL_V2 (#14051) 2026-01-05 16:18:07 +08:00
Praneth Paruchuri
b12258bfaa [model-gateway] Optimize HTTP Router Fan-out: Replace Serial Execution with Concurrent Streams (#16042) 2026-01-04 23:38:45 -08:00
Lianmin Zheng
012dc5866d [Auto Sync] Update scheduler.py (20260104) (#16424) 
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: Hanming Lu <69857889+hanming-lu@users.noreply.github.com>
Co-authored-by: Hanming Lu <hanming@x.ai>
Co-authored-by: Jie Ren <no-replay@github.com>
 2026-01-04 23:32:56 -08:00
Simo Lin
7f6a678f8f [model-gateway] add GPU allocator and model pool infrastructure for parallel E2E tests (#16460) 2026-01-04 23:30:32 -08:00
Simo Lin
399ca037b1 [bug] fix lint blocking ci (#16464) 2026-01-04 22:57:33 -08:00
Kangyan-Zhou
d93f37a625 Add harvenstar to CI_PERMISSIONS.json 2026-01-04 22:35:26 -08:00
Simo Lin
e6fe092dcc [model-gateway] rename py_test to e2e_test (#16454) 2026-01-04 22:24:34 -08:00
Ratish P
f02d82211a [model-gateway]: move PD configuration conflict checks to model gateway (#16088) 2026-01-05 14:16:07 +08:00
Yuhao Yang
10174e1114 Revert "[grpc] update api to scheduler in grpc request manager" (#16387) 2026-01-04 22:05:39 -08:00
Yuhao Yang
2138ff48c6 Revert "[FEAT] optimize tensor zmq transfer for multimodal inputs" (#16386) 2026-01-04 22:05:26 -08:00
Simo Lin
e53160bb31 [model-gateway] reorganize integration tests into logical subdirectories (#16451) 2026-01-04 21:49:20 -08:00
Xiaoyu Zhang
4ea6a11c83 [CI] Fail wheel build when sgl-kernel artifacts are missing (#16450) 2026-01-04 21:46:40 -08:00
Simo Lin
2181bc9e51 [model-gateway] Delete Python integration_mock tests (#16448) 2026-01-04 21:34:06 -08:00
Xiaoyu Zhang
520c048d55 [diffusion] CI: add script for automatically generation ci perf baseline (#16389) 2026-01-05 13:18:35 +08:00
yudian0504
561a3e04f6 remove redundant mamba_cache clearing actions (#16180) 2026-01-05 13:02:07 +08:00
Simo Lin
f84487af59 [model-gateway] : Rust integration tests for integration_mock replacement (#16441) 2026-01-04 21:01:47 -08:00
Huapeng Zhou
078270473a [Doc] Default lora backend: csgmv (#16444) 2026-01-05 12:45:49 +08:00
fzyzcjy
c63e9cb29e Super tiny fix CI (#16437) 2026-01-04 20:34:49 -08:00
YAMY
12cde0df99 [SPEC_V2] Fix Acclen drop when enabling DP Attention for Spec-Overlap (#16310) 2026-01-05 11:39:23 +08:00
Liangsheng Yin
a7fd810842 Allow editable install without .git with add fallback version in pyproject.toml (#16435) 2026-01-05 11:17:20 +08:00
Kangyan-Zhou
ca80c19b55 Revert "[diffusion] feat: support warmup with resolutions" (#16433) 2026-01-04 18:44:05 -08:00
fzyzcjy
1e7b326482 Super tiny fix main code (#16432) 2026-01-05 10:34:25 +08:00
CHEN Xi
e267ca0beb [diffusion] doc: document LoRA support in CLI (#16375) 2026-01-05 10:20:30 +08:00
Mick
9a8ba3c189 [diffusion] feat: support warmup with resolutions (#16330) 2026-01-05 10:16:26 +08:00
Xiaoyu Zhang
0fee6bc632 [JIT kernel] Apply jit per_tensor_quant_fp8 kernel (#15836) 2026-01-05 10:15:00 +08:00
Simo Lin
0ff3747ca1 [model-gateway]: move unit tests to bindings/python/tests/ (#16430) 2026-01-04 18:10:35 -08:00
Alison Shao
f8411ded6e ci: migrate 1-GPU model tests to test/registered/models/ (#16414) 2026-01-04 18:08:01 -08:00
fzyzcjy
249c356331 Super tiny update tokenizer benchmark (#16429) 2026-01-05 09:14:52 +08:00
fzyzcjy
12df16607b Tiny speed up kimi detokenizer by 10x (#16427) 2026-01-05 09:12:05 +08:00
Douglas Yang
55d112dc79 fix: enable multi-threading for h200 tests (#16413) 2026-01-04 14:43:53 -08:00
Douglas Yang
a1ed247fd7 feature: add runner online count to failure monitor (#16408) 2026-01-04 13:24:04 -08:00
Douglas Yang
87699d48eb fix: only publish trace from tp 0 (#16411) 2026-01-04 12:17:08 -08:00
Alison Shao
52c604342c chore: print test list at beginning and end of run_suite.py (#16334) 
Co-authored-by: Mick <mickjagger19@icloud.com>
 2026-01-04 11:52:52 -08:00
Alison Shao
ff0f370f85 ci: migrate MoE tests to test/registered/moe/ (#16127) 2026-01-04 11:51:12 -08:00
Alison Shao
26f9e20755 ci: migrate quantization kernel tests to test/registered/quant/ (#16323) 2026-01-04 11:49:29 -08:00
Yingchun Lai
828cd8936f Introduce sgl-kernel Dockerfile (#14066) 2026-01-04 11:19:08 -08:00
Simo Lin
4436dc0f6c [model-gateway] improve lock contention and allocation in middleware (#16405) 2026-01-04 10:40:07 -08:00
Simo Lin
cf6800f6cc [model-gateway] optimize Vec and HashMap allocations in responses api (#16406) 2026-01-04 10:07:55 -08:00
fzyzcjy
f16606d6f6 Super tiny code cleanup (#16401) 2026-01-04 23:00:09 +08:00
fzyzcjy
387fad2f74 Tiny add detokenization benchmarks (#16400) 2026-01-04 22:53:38 +08:00
Ke Bao
76bc07a335 Move swa memory pool to a seperate file (#16347) 2026-01-04 22:39:30 +08:00
Ke Bao
b328cd20bb Skip local attn init metadata for mimo swa model (#16349) 2026-01-04 22:38:36 +08:00
Hexq0210
bf32cd8397 [npu] update model and feature supported for ascend npu (#16390) 2026-01-04 21:50:20 +08:00