 b8zhong
|
d36f6f043c
|
[Fix] flashinfer_trtllm intermediate_size assertion with Qwen3 + TP=8 (#16824)
|
2026-01-17 09:24:05 +08:00 |
|
|
Baizhou Zhang
|
a04675892e
|
Update flashinfer to 0.6.1 (#15551)
|
2026-01-17 00:48:30 +08:00 |
|
|
Raghav Ravishankar
|
daea51385d
|
Add AFMoE model implementation (#13216)
|
2026-01-16 20:35:42 +08:00 |
|
|
|
3355b6e21b
|
feat: add request queued timeout (#17143)
Co-authored-by: qiuxuan.lzw <qiuxuan.lzw@alibaba-inc.com>
Co-authored-by: Xiaoyu Zhang <35585791+BBuf@users.noreply.github.com>
|
2026-01-16 17:55:09 +08:00 |
|
|
Zhiqiang Xie
|
d9ed80b9f1
|
fix AMD CI failure of NUMA binding (#17184)
|
2026-01-16 00:21:04 -08:00 |
|
|
shuwenn
|
8ec160ed46
|
feature: support uvicorn access log filter(disable logging /metrics) (#15513)
|
2026-01-15 20:00:06 -08:00 |
|
|
JinYan SuandZhiqiang Xie
|
72e2f70ef7
|
feat(hicache): support numa detect to reduce long tail latency (#11028)
Co-authored-by: Zhiqiang Xie <xiezhq@stanford.edu>
|
2026-01-15 14:11:49 -08:00 |
|
|
|
5af84c8af5
|
[AMD][Quantization] Add int4fp8_moe online quantization on ROCm (#7392)
Co-authored-by: Dehua Tang <dehtang@amd.com>
Co-authored-by: HAI <hixiao@gmail.com>
Co-authored-by: YC Tseng <yctseng@amd.com>
|
2026-01-14 01:44:40 -08:00 |
|
|
shuwennandSimo Lin
|
cd33694585
|
feat: add --admin-api-key for finer-grained endpoint auth (#15908)
Co-authored-by: Simo Lin <linsimo.mark@gmail.com>
|
2026-01-13 20:21:55 -08:00 |
|
|
Lianmin Zheng
|
075c5a5789
|
Code clean up for fp8 quantization (#16982)
|
2026-01-13 12:38:39 -08:00 |
|
|
Yibo Cai
|
2f4a6addf3
|
[cpu/arm64] support run sglang on arm64 cpu (#14867)
|
2026-01-11 04:27:19 -08:00 |
|
|
Yuan Luoandluoyuan.luo
|
d1ec93e3ac
|
Optimize layernorm_gated for Qwen3-Next (#16397)
Co-authored-by: luoyuan.luo <luoyuan.luo@antgroup.com>
|
2026-01-10 20:55:31 +08:00 |
|
|
fzyzcjy
|
dae6a4092a
|
Tiny add scheduler status logging (#16872)
|
2026-01-10 20:12:24 +08:00 |
|
|
fzyzcjy
|
641830c1c2
|
Tiny extract file logging utils (#16870)
|
2026-01-10 20:02:37 +08:00 |
|
|
fzyzcjy
|
1f9d4795a9
|
Tiny add gauge histogram abstraction for engine and router (#16848)
|
2026-01-10 11:45:25 +08:00 |
|
|
fzyzcjy
|
b6e8a0d851
|
Add file size hints in bitwise model file verifier (#16735)
|
2026-01-08 22:28:52 +08:00 |
|
|
fzyzcjy
|
83abecd0c2
|
Support pre-generating and using expected checksums (#16730)
|
2026-01-08 20:26:13 +08:00 |
|
|
fzyzcjy
|
d54f0a10b4
|
Support bitwise weight checksum verifier (#16729)
|
2026-01-08 20:19:25 +08:00 |
|
|
fzyzcjy
|
f959250f76
|
Tiny support sglang_routing_keys_active in engine (#16570)
|
2026-01-06 22:10:10 +08:00 |
|
|
fzyzcjy
|
7f35c46efb
|
Tiny add sglang:http_requests_active metric (#16479)
|
2026-01-05 17:20:31 +08:00 |
|
|
fzyzcjy
|
12df16607b
|
Tiny speed up kimi detokenizer by 10x (#16427)
|
2026-01-05 09:12:05 +08:00 |
|
|
Douglas Yang
|
16e00651dd
|
fix: health check adding test delays (#16381)
|
2026-01-04 00:28:32 -08:00 |
|
|
fzyzcjy
|
1b2b95d8d1
|
Super tiny cleanup unused function (#16376)
|
2026-01-04 15:08:12 +08:00 |
|
|
Yuan Luoandluoyuan.luo
|
5f3eb377e0
|
[VLM] Support request level max_dynamic_patch for OpenAI request (#16268)
Co-authored-by: luoyuan.luo <luoyuan.luo@antgroup.com>
|
2026-01-04 13:04:43 +08:00 |
|
|
fzyzcjy
|
c7c0d97fc6
|
Tiny support whitelisted headers in request logging (#16342)
|
2026-01-03 20:10:58 +08:00 |
|
|
fzyzcjy
|
7f2fa2167b
|
Tiny add --log-requests-target (#16338)
|
2026-01-03 17:28:27 +08:00 |
|
|
DarkSharpness
|
f6f7af4068
|
[Refactor] Clean up custom op (#15995)
|
2026-01-01 21:41:56 +08:00 |
|
|
Vitaly Tuzov
|
1048803c1f
|
Reworked fast_pos_embed_interpolate() using torch (#10959)
|
2025-12-30 14:45:34 +08:00 |
|
|
Lianmin Zheng
|
183b65190a
|
Clean up logging (#15919)
|
2025-12-27 15:27:12 -08:00 |
|
|
shuwenn
|
fe3d47fc9d
|
fix: warn once per env var key (#15846)
|
2025-12-26 18:41:15 +08:00 |
|
|
|
b6702d72cf
|
feat: log request when e2e latency exceeds the specified value (#15759)
Co-authored-by: qiuxuan.lzw <qiuxuan.lzw@alibaba-inc.com>
Co-authored-by: Xiaoyu Zhang <35585791+BBuf@users.noreply.github.com>
|
2025-12-25 23:12:35 +08:00 |
|
|
Yuan Luoandluoyuan.luo
|
b9af8d2eb9
|
[VLM] Support apply qk norm in multi cuda streams (#15720)
Co-authored-by: luoyuan.luo <luoyuan.luo@antgroup.com>
|
2025-12-25 14:35:07 +08:00 |
|
|
Mayyyy
|
2fb3160598
|
[NPU] Bug fix in device detect (#14137)
|
2025-12-25 00:18:39 +08:00 |
|
|
fzyzcjy
|
9338f63f7d
|
Add request counter in addition to existing response counter (#15768)
|
2025-12-24 22:22:38 +08:00 |
|
|
fzyzcjy
|
fd4a558e71
|
Add metrics for having prefill and decode in different ranks (#15752)
|
2025-12-24 21:35:35 +08:00 |
|
|
fzyzcjy
|
e245cac0c5
|
Support JSON format request logging for easier parsing (#15743)
|
2025-12-24 19:52:43 +08:00 |
|
|
fzyzcjy
|
c6a6ba4368
|
Tiny refactor request logger (#15740)
|
2025-12-24 19:51:26 +08:00 |
|
|
Lianmin Zheng
|
cf81737693
|
Add kv_transfer_total_mb to metrics (#15667)
|
2025-12-23 11:16:55 -08:00 |
|
|
fzyzcjy
|
d5431ff894
|
Tiny add stuck simulation (#15613)
|
2025-12-22 17:00:18 +08:00 |
|
|
fzyzcjy
|
454a2544f2
|
Support soft watchdog for tokenizer/detokenizer/dp-controller processes (#15607)
|
2025-12-22 16:59:16 +08:00 |
|
|
Mayyyy
|
2c5a446006
|
[NPU]Fix for ipc handle with npu (#14138)
|
2025-12-19 22:39:04 +08:00 |
|
|
fzyzcjy
|
c5f4e20f2f
|
Support GPU execution time breakdown by forward mode metrics (#15396)
|
2025-12-18 22:18:17 +08:00 |
|
|
fzyzcjyandgemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
|
2c196f95a7
|
Tiny fix unknown route in prometheus metrics (#15404)
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
|
2025-12-18 22:17:46 +08:00 |
|
|
Lianmin Zheng
|
d1f0063262
|
Clean up __init__ function of the scheduler and event loop for PD (#15298)
|
2025-12-18 01:35:14 -08:00 |
|
|
Liangsheng Yinandgemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
|
8b0a68f1bf
|
Monkey patch deepseek-ocr's v_head_dim (#15384)
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
|
2025-12-18 16:28:07 +08:00 |
|
|
Yuhao Yang
|
3d42b7e7b0
|
unified management of environment variables for vlm cuda ipc transport (#14501)
|
2025-12-18 12:28:06 +08:00 |
|
|
elvischenv
|
9970ee34e8
|
Mistral Large 3 NVFP4 TRTLLM MoE support (#15049)
|
2025-12-18 11:11:42 +08:00 |
|
|
Liangsheng Yin
|
0c00220795
|
tiny unify environ usage (#15335)
|
2025-12-17 23:31:43 +08:00 |
|
|
fzyzcjy
|
9d04b570bc
|
Tiny dump native stacktraces in watchdog (#15222)
|
2025-12-17 21:20:41 +08:00 |
|
|
XDaoHongandZhengdQin
|
4733fcff1f
|
[Feature] npu support enable_torch_compile for torchair backend (#13410)
Co-authored-by: ZhengdQin <zhengdqin@gmail.com>
|
2025-12-16 09:23:51 +08:00 |
|