fzyzcjy
|
c12567274a
|
Tiny change bench-serving to use routing key header (#15827)
|
2025-12-25 21:29:49 +08:00 |
|
Yingchun Lai
|
bb9e6cdf9e
|
[MiMoV2Flash] fix: respect --swa-full-tokens-ratio arg (#15488)
|
2025-12-25 21:02:56 +08:00 |
|
roikoren755
|
de03b0cd30
|
[Nemotron 3 Nano] Add triton MoE configs (#15815)
Signed-off-by: Roi Koren <roik@nvidia.com>
|
2025-12-25 19:31:20 +08:00 |
|
Mick
|
2a8a785634
|
[diffusion] log: avoid logging in hot path if unnecessary (#15818)
|
2025-12-25 18:42:52 +08:00 |
|
Liangsheng Yin
|
f4e835af2f
|
Cleanup ModelRunner (#15802)
|
2025-12-25 18:13:30 +08:00 |
|
Xiaoyu Zhang
|
e6ce16a4c2
|
[diffusion] feat: support TP for Flux.1.dev (#15666)
Co-authored-by: Mick <mickjagger19@icloud.com>
|
2025-12-25 18:00:44 +08:00 |
|
Xiaoyu Zhang
|
de2f2880b5
|
[JIT sgl-kernel] Jit support per tensor quant (#15709)
|
2025-12-25 16:24:37 +08:00 |
|
zhangheng
|
a89e85e739
|
[1/N][Sparse With Hicache]: Add Sparse Interface (#14741)
Co-authored-by: 晟海 <huangtingwei.htw@antgroup.com>
Co-authored-by: huangtingwei <141888744+huangtingwei9988@users.noreply.github.com>
Co-authored-by: MagicYang1573 <1328657938@qq.com>
|
2025-12-25 00:12:47 -08:00 |
|
Ke Bao
|
cbf9f13493
|
Adjust server args for Mimo-v2-flash model (#15803)
Co-authored-by: Liangsheng Yin <lsyincs@gmail.com>
|
2025-12-25 16:04:39 +08:00 |
|
Yi Zhang
|
eb3da9c1dd
|
fuse ssm state store into chunk_gated_delta_rule_fwd_h (#15409)
|
2025-12-25 16:03:15 +08:00 |
|
Alison Shao
|
72a980c6d5
|
ci: migrate MLA tests to test/registered/mla/ (#15798)
|
2025-12-24 23:29:30 -08:00 |
|
fzyzcjy
|
ccf2330b28
|
Tiny fix missing record_router_upstream_response (#15811)
|
2025-12-25 15:20:43 +08:00 |
|
Yuan Luo
|
b9af8d2eb9
|
[VLM] Support apply qk norm in multi cuda streams (#15720)
Co-authored-by: luoyuan.luo <luoyuan.luo@antgroup.com>
|
2025-12-25 14:35:07 +08:00 |
|
Prozac614
|
10a9573efd
|
[diffusion] CI: add tests to validate the size, extension, and format of output images/videos. (#15736)
|
2025-12-25 14:00:22 +08:00 |
|
Prozac614
|
49ab72f837
|
[diffusion] fix: remove unused LoRA application logic from RowParallelLinearWithLoRA class in linear.py (#15801)
|
2025-12-25 13:43:38 +08:00 |
|
R0CKSTAR
|
8865424f14
|
[diffusion] refactor: refactor attention backend checking to use backend enum (#15555)
Signed-off-by: Xiaodong Ye <yeahdongcn@gmail.com>
|
2025-12-25 11:51:40 +08:00 |
|
Liangsheng Yin
|
b311c43d13
|
Clarify None handling in sglang's environ (#15770)
|
2025-12-25 11:40:17 +08:00 |
|
Huaixin Chang
|
0c39730b18
|
DP: support piggyback server load report (#11469)
Signed-off-by: Chang Huaixin (OpenAnolis) <changhuaixin@linux.alibaba.com>
|
2025-12-25 11:35:05 +08:00 |
|
fzyzcjy
|
45adad37d0
|
Add manual routing policy for router (#15586)
|
2025-12-25 11:27:36 +08:00 |
|
fzyzcjy
|
1ba897f330
|
Tiny refactor select_workers API for future passing more information (#15596)
|
2025-12-25 10:31:10 +08:00 |
|
satyamk7054
|
38dd4fbb66
|
Add overlap scheduling for embeddings code path (#14032)
Co-authored-by: Satyam Kumar <satyamk@linkedin.com>
|
2025-12-24 18:24:18 -08:00 |
|
Lianmin Zheng
|
ecd2d09a6c
|
Fix code sync scripts (#15787)
|
2025-12-24 16:13:23 -08:00 |
|
Lianmin Zheng
|
92ddc46824
|
[Auto Sync] Update server_args.py (20251223) (#15700)
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: Stefan He <hebiaobuaa@gmail.com>
|
2025-12-24 14:55:14 -08:00 |
|
Simo Lin
|
5454d2a7ae
|
[model-gateway] release smg 0.3.0 (#15781)
|
2025-12-24 13:23:57 -08:00 |
|
Chenxi Li
|
17b38f88bc
|
Add LoRA metrics for potential auto scaling (#15149)
|
2025-12-24 12:13:52 -08:00 |
|
Xinyuan Tong
|
ae434f7821
|
Move limit-mm-data-per-request to make code clean (#15775)
Signed-off-by: Xinyuan Tong <xinyuantong.cs@gmail.com>
|
2025-12-24 10:59:39 -08:00 |
|
Simo Lin
|
643aeefe6d
|
[model-gateway] Fix logging module name, parse endpoint context, and tokenizer factory (#15782)
|
2025-12-24 10:54:48 -08:00 |
|
ゆり
|
186a56f6e2
|
fix(monitoring): update Grafana dashboard metrics prefix from sglang: to sglang_ (#15758)
|
2025-12-24 10:43:51 -08:00 |
|
Douglas Yang
|
17e65466de
|
fix: nightly fix b200 gpqa (#15745)
|
2025-12-24 10:29:45 -08:00 |
|
Praneth Paruchuri
|
370bd27f3a
|
[model-gateway] Implement Zero-Copy Vision Tensor Access (#15750)
|
2025-12-24 09:15:44 -08:00 |
|
Simo Lin
|
b27b5a834e
|
[bug] fix code formatting which blocks ci (#15780)
|
2025-12-24 09:14:13 -08:00 |
|
Simo Lin
|
2f7c629235
|
[model-gateway] Fix IGW routing and optimize RouterManager (#15741)
|
2025-12-24 11:28:53 -05:00 |
|
Mayyyy
|
2fb3160598
|
[NPU] Bug fix in device detect (#14137)
|
2025-12-25 00:18:39 +08:00 |
|
Liwansi
|
8bf7f240b6
|
[NPU]qwen3 pp bugfix (#15390)
|
2025-12-25 00:14:40 +08:00 |
|
Mick
|
2c5679f314
|
[diffusion] refactor: unify the profiling api for all executors (#15718)
|
2025-12-24 23:26:09 +08:00 |
|
Liangsheng Yin
|
159b128357
|
Tiny add flush for CI crash locating (#15769)
|
2025-12-24 22:47:10 +08:00 |
|
fzyzcjy
|
9338f63f7d
|
Add request counter in addition to existing response counter (#15768)
|
2025-12-24 22:22:38 +08:00 |
|
fzyzcjy
|
8196998a03
|
Tiny add num retracted tokens metric (#15653)
|
2025-12-24 22:15:23 +08:00 |
|
fzyzcjy
|
aa21c6e3f1
|
Super tiny code cleanup (#15652)
|
2025-12-24 22:15:00 +08:00 |
|
fzyzcjy
|
fd4a558e71
|
Add metrics for having prefill and decode in different ranks (#15752)
|
2025-12-24 21:35:35 +08:00 |
|
fzyzcjy
|
b3b818fd86
|
Tiny unify realtime_tokens_total metric (#15747)
|
2025-12-24 21:29:43 +08:00 |
|
Liangsheng Yin
|
d5fbbfd988
|
Retry removing wrong logic about max total token in spec decoding (#15748)
|
2025-12-24 21:13:26 +08:00 |
|
fzyzcjy
|
e245cac0c5
|
Support JSON format request logging for easier parsing (#15743)
|
2025-12-24 19:52:43 +08:00 |
|
fzyzcjy
|
c6a6ba4368
|
Tiny refactor request logger (#15740)
|
2025-12-24 19:51:26 +08:00 |
|
fzyzcjy
|
d6108166bc
|
Fix smg_http_requests_total semantics (#15655)
|
2025-12-24 17:41:01 +08:00 |
|
vincentzed
|
ddb3970eb4
|
Tiny env cleanup in deepgemm (#15706)
Signed-off-by: vincentzed <207368749+vincentzed@users.noreply.github.com>
|
2025-12-24 00:58:46 -08:00 |
|
Arthur Cheng
|
f65fa04748
|
[model-gateway]Enable IGW mode with gRPC router and auto enable IGW when service discovery is turned on (#15459)
|
2025-12-24 00:27:58 -08:00 |
|
Lee Nau
|
7e027691c8
|
update benchmark README to use --fp8-gemm-backend instead of env var (#15689)
|
2025-12-23 23:23:31 -08:00 |
|
Liangsheng Yin
|
cb719c74ad
|
[2/N] clean duplicate code of logprob processing in spec. (#15593)
|
2025-12-24 15:21:13 +08:00 |
|
Lianmin Zheng
|
ff903a7eea
|
Simplify server args (#15704)
|
2025-12-23 22:46:12 -08:00 |
|