chenchenghao/sglang
1
0
Fork 0
Code Issues Pull Requests Actions 11 Packages Projects Releases Wiki Activity
9,885 Commits 1 Branch 0 Tags
cc63c99f112f781605017db018fced686cdc94de
Commit Graph

9885 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Douglas Yang
c80c0e0fc0 fix: adding multi-threading for kimi weights loading in pr test (#16538) 2026-01-05 20:10:13 -08:00
fzyzcjy
c105a3124b Support multi-round conversations in bench_serving (#6135) 2026-01-06 11:59:39 +08:00
Chang Su
4cf2bbd084 [router] Remove deadcode and add note for unused API completeness methods (#16528) 2026-01-05 19:53:28 -08:00
Alison Shao
d7b706be94 ci: migrate HiCache 1-GPU tests to test/registered/hicache/ (#16416) 2026-01-05 19:38:21 -08:00
Alison Shao
4a9537a495 ci: migrate Mamba/Layers tests to test/registered/layers/mamba/ (#16419) 2026-01-05 19:12:47 -08:00
Mick
ca922d4b05 [diffusion] feat: support warmup with resolutions (#16434) 2026-01-06 10:32:18 +08:00
Simo Lin
402a0bd6dc [model-gateway] Add model scope support and LRU eviction for GPU-constrained environments (#16525) 2026-01-05 18:28:07 -08:00
Douglas Yang
76c71d1d34 fix: unimplemented methods in BaseIndexerMetadata (#16520) 2026-01-06 10:26:42 +08:00
zhangheng
2d02c150dc [3/N][Sparse With Hicache]: Init sparse coordinator (#16086) 
Co-authored-by: 晟海 <huangtingwei.htw@antgroup.com>
Co-authored-by: Zhiqiang Xie <xiezhq@stanford.edu>
 2026-01-05 17:51:04 -08:00
Chang Su
b98bd9a5fb [model-gateway] Tighten visibility in modules and remove unused re-exports (#16524) 2026-01-05 17:38:50 -08:00
ShirakSyouya
ce694b2b9e Fix the problem where Qwen3VL raises an "object has no attribute 'mod… (#15677) 2026-01-06 08:45:13 +08:00
Lianmin Zheng
6c0fb189f8 [Auto Sync] Update tokenizer_manager.py (20260105) (#16477) 
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: Wangfan Fu <wangfan@x.ai>
 2026-01-05 14:06:03 -08:00
Binyao Jiang
9a9f996f8d [FP8] Fix weight_scale shape to match with x_scale shape for per-tensor quant under torch.compile (#16356) 2026-01-05 13:55:26 -08:00
Simo Lin
4221b7c573 [model-gateway] refactor e2e test infrastructure and add router CI (#16513) 2026-01-05 13:50:59 -08:00
yctseng0211
c371df2f25 [AMD] Fix CI and add retry logic for git clone timeout (#15663) 
Co-authored-by: Bingxu Chen <bingxche@amd.com>
 2026-01-05 12:37:52 -08:00
Chang Su
1751c75b5d [model-gateway] Tighten visibility across data_connector and grpc module (#16516) 2026-01-05 12:31:32 -08:00
realWeilai
23849eba7b [model-gateway] fix tokenizer encode in golang bindings (#16482) 2026-01-05 11:40:09 -08:00
Chang Su
51541404f8 [grpc] Refactor openai module (#16511) 2026-01-05 11:39:33 -08:00
Jonah Bernard
45ef834412 Add MoE Integration Tests For CUTLASS Coverage (#16280) 2026-01-05 11:26:11 -08:00
Chang Su
5a2b1ed407 [grpc] Refactor grpc/regular/responses (#16509) 2026-01-05 10:21:34 -08:00
Chang Su
454dc9e242 [model-gateway][grpc] Refactor harmony/responses.rs (#16508) 2026-01-05 10:21:05 -08:00
fzyzcjy
1e41069ad1 Fix age bucket rendering issue (#16492) 2026-01-05 09:29:14 -08:00
Simo Lin
2b4d6d813b [model-gateway][e2e_test]: Create directory structure and backends config (#16469) 2026-01-05 08:01:53 -08:00
Yi Zhang
a3914e3b3f [Bugfix] fix some memory computation bugs for qwen3next with mtp (#16138) 2026-01-05 23:24:21 +08:00
Shangming Cai
130f60ee78 Add CODEOWNERS for scheduler_pp_mixin.py (#16481) 2026-01-05 21:12:20 +08:00
Raayan Dhar
4397cda7dc feat: raise error in PD when page sizes are mismatched (#14474) 
Signed-off-by: Raayan Dhar raayan.dhar@gmail.com <raayan.dhar@gmail.com>
Signed-off-by: raayandhar <raayan.dhar@gmail.com>
Co-authored-by: Shangming Cai <csmthu@gmail.com>
 2026-01-05 19:54:01 +08:00
Bingxu Chen
d56fd10cb6 [AMD CI] fix sglang version detection in daily docker image release and init container (#16367) 
https://github.com/sgl-project/sglang/actions/runs/20711245259/job/59453869006?pr=16367 to be fixed in https://github.com/sgl-project/sglang/pull/15663
 2026-01-05 03:22:39 -08:00
Hexq0210
abb06be946 [NPU] Fixed link redirection issue. (#16475) 2026-01-05 19:03:29 +08:00
Lianmin Zheng
c35eb0fdee [Auto Sync] Update loader.py (20260105) (#16478) 
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: xiuyuli-xai <xiuyu@x.ai>
 2026-01-05 01:34:30 -08:00
fzyzcjy
7f35c46efb Tiny add sglang:http_requests_active metric (#16479) 2026-01-05 17:20:31 +08:00
DarkSharpness
da2f8cc33f [minor] reduce 1 unnecessary add (#16474) 2026-01-05 01:00:56 -08:00
fzyzcjy
4308c25b47 Super tiny move test folder (#16447) 2026-01-05 16:29:26 +08:00
fzyzcjy
4d737db857 Tiny fix prefill delayer not support non-fcfs schedule policy (#16471) 2026-01-05 16:28:54 +08:00
fzyzcjy
9d6029fb92 Fix TokenizerManager bottleneck for offline generation (#16456) 2026-01-05 16:28:25 +08:00
Qi Yuhang
dcfb92ddbc [diffusion] fix: fix using the sub-optimal fa kernel (#16382) 2026-01-05 16:25:41 +08:00
Netanel Haber
bebd625ba1 EVS Framework: Support NemotronH_Nano_VL_V2 (#14051) 2026-01-05 16:18:07 +08:00
Praneth Paruchuri
b12258bfaa [model-gateway] Optimize HTTP Router Fan-out: Replace Serial Execution with Concurrent Streams (#16042) 2026-01-04 23:38:45 -08:00
Lianmin Zheng
012dc5866d [Auto Sync] Update scheduler.py (20260104) (#16424) 
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: Hanming Lu <69857889+hanming-lu@users.noreply.github.com>
Co-authored-by: Hanming Lu <hanming@x.ai>
Co-authored-by: Jie Ren <no-replay@github.com>
 2026-01-04 23:32:56 -08:00
Simo Lin
7f6a678f8f [model-gateway] add GPU allocator and model pool infrastructure for parallel E2E tests (#16460) 2026-01-04 23:30:32 -08:00
Simo Lin
399ca037b1 [bug] fix lint blocking ci (#16464) 2026-01-04 22:57:33 -08:00
Kangyan-Zhou
d93f37a625 Add harvenstar to CI_PERMISSIONS.json 2026-01-04 22:35:26 -08:00
Simo Lin
e6fe092dcc [model-gateway] rename py_test to e2e_test (#16454) 2026-01-04 22:24:34 -08:00
Ratish P
f02d82211a [model-gateway]: move PD configuration conflict checks to model gateway (#16088) 2026-01-05 14:16:07 +08:00
Yuhao Yang
10174e1114 Revert "[grpc] update api to scheduler in grpc request manager" (#16387) 2026-01-04 22:05:39 -08:00
Yuhao Yang
2138ff48c6 Revert "[FEAT] optimize tensor zmq transfer for multimodal inputs" (#16386) 2026-01-04 22:05:26 -08:00
Simo Lin
e53160bb31 [model-gateway] reorganize integration tests into logical subdirectories (#16451) 2026-01-04 21:49:20 -08:00
Xiaoyu Zhang
4ea6a11c83 [CI] Fail wheel build when sgl-kernel artifacts are missing (#16450) 2026-01-04 21:46:40 -08:00
Simo Lin
2181bc9e51 [model-gateway] Delete Python integration_mock tests (#16448) 2026-01-04 21:34:06 -08:00
Xiaoyu Zhang
520c048d55 [diffusion] CI: add script for automatically generation ci perf baseline (#16389) 2026-01-05 13:18:35 +08:00
yudian0504
561a3e04f6 remove redundant mamba_cache clearing actions (#16180) 2026-01-05 13:02:07 +08:00