 Yuan Luoandluoyuan.luo
|
53846746bf
|
[VLM] Fix CUDA IPC OOM (#16118)
Co-authored-by: luoyuan.luo <luoyuan.luo@antgroup.com>
|
2026-01-07 11:30:35 +08:00 |
|
|
fzyzcjy
|
9a21d89c5b
|
Tiny add metrics for prefill delayer (#16603)
|
2026-01-07 09:53:52 +08:00 |
|
|
Ke Bao
|
02722b9113
|
Fix evict swa for overlap scheduler and page size > 1 (#16507)
|
2026-01-06 22:29:40 +08:00 |
|
|
Ke Bao
|
3aa11ca722
|
Remove hybrid_kvcache_ratio in server args (#16399)
|
2026-01-06 13:13:13 +08:00 |
|
|
|
6c0fb189f8
|
[Auto Sync] Update tokenizer_manager.py (20260105) (#16477)
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: Wangfan Fu <wangfan@x.ai>
|
2026-01-05 14:06:03 -08:00 |
|
|
fzyzcjy
|
4d737db857
|
Tiny fix prefill delayer not support non-fcfs schedule policy (#16471)
|
2026-01-05 16:28:54 +08:00 |
|
|
fzyzcjy
|
9d6029fb92
|
Fix TokenizerManager bottleneck for offline generation (#16456)
|
2026-01-05 16:28:25 +08:00 |
|
|
Netanel Haber
|
bebd625ba1
|
EVS Framework: Support NemotronH_Nano_VL_V2 (#14051)
|
2026-01-05 16:18:07 +08:00 |
|
|
|
012dc5866d
|
[Auto Sync] Update scheduler.py (20260104) (#16424)
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: Hanming Lu <69857889+hanming-lu@users.noreply.github.com>
Co-authored-by: Hanming Lu <hanming@x.ai>
Co-authored-by: Jie Ren <no-replay@github.com>
|
2026-01-04 23:32:56 -08:00 |
|
|
Yuhao Yang
|
2138ff48c6
|
Revert "[FEAT] optimize tensor zmq transfer for multimodal inputs" (#16386)
|
2026-01-04 22:05:26 -08:00 |
|
|
Ke Bao
|
76bc07a335
|
Move swa memory pool to a seperate file (#16347)
|
2026-01-04 22:39:30 +08:00 |
|
|
Yuan Luoandluoyuan.luo
|
5f3eb377e0
|
[VLM] Support request level max_dynamic_patch for OpenAI request (#16268)
Co-authored-by: luoyuan.luo <luoyuan.luo@antgroup.com>
|
2026-01-04 13:04:43 +08:00 |
|
|
fzyzcjy
|
e797f0c570
|
Support offline generation scenario for prefill delayer (#16363)
|
2026-01-04 11:05:10 +08:00 |
|
|
fzyzcjy
|
5d4b7c78bf
|
Fix memory leak in prefill delayer (#16358)
|
2026-01-04 10:11:18 +08:00 |
|
|
fzyzcjy
|
2337b1bbb0
|
Refactor and fix prefill delayer (scheduler enhancer) (#16269)
|
2026-01-04 07:15:06 +08:00 |
|
|
fzyzcjy
|
b65c9889a0
|
Fix incorrect running batch size in prefill stats (#15941)
|
2026-01-03 20:49:54 +08:00 |
|
|
fzyzcjy
|
c7c0d97fc6
|
Tiny support whitelisted headers in request logging (#16342)
|
2026-01-03 20:10:58 +08:00 |
|
|
fzyzcjy
|
7f2fa2167b
|
Tiny add --log-requests-target (#16338)
|
2026-01-03 17:28:27 +08:00 |
|
|
|
bdde949619
|
[HiCache] Add PP Support with suffix pp rank (#15175)
Co-authored-by: Xuchun Shang <xuchun.shang@gmail.com>
Co-authored-by: ybyang <10629930+whybeyoung@users.noreply.github.com>
Co-authored-by: Shangming Cai <csmthu@gmail.com>
|
2026-01-03 13:49:21 +08:00 |
|
|
|
078d96213a
|
[FEAT] optimize tensor zmq transfer for multimodal inputs (#13592)
Co-authored-by: Shangming Cai <csmthu@gmail.com>
Co-authored-by: Yuhao Yang <47235274+yhyang201@users.noreply.github.com>
|
2026-01-03 12:23:23 +08:00 |
|
|
Yongfei Xu
|
0d244116d2
|
[DeepSeek v3.2] opt Context Parallelism: support fused moe, multi batch and fp8 kvcache (#13959)
|
2026-01-02 23:49:14 +08:00 |
|
|
Ke Bao
|
c483a5f45f
|
Tiny adjust hybrid swa handling (#16292)
|
2026-01-02 23:11:23 +08:00 |
|
|
Qiaolin Yu
|
dd93e4451c
|
Support returning customized info (#16144)
|
2026-01-02 15:32:18 +08:00 |
|
|
Lianmin Zheng
|
e4c1e441af
|
Fix deprecation warning of sre_parse for python 3.13 (#16247)
|
2025-12-31 21:25:09 -08:00 |
|
|
Feng Su
|
57d2ba9203
|
SGLang Tracing: Supports propagating trace headers through sgl.Engine… (#15814)
Signed-off-by: Feng Su <sufeng@linux.alibaba.com>
|
2025-12-31 15:19:53 -08:00 |
|
|
Cheng Wan
|
2b461c15b4
|
Update logprob_start_len handling in scheduler (#16240)
|
2025-12-31 14:11:24 -08:00 |
|
|
siyu
|
abdf65d4f3
|
Fix OOM by offloading multimodal features to CPU after embedding (#16018)
|
2025-12-31 23:02:34 +08:00 |
|
|
Hudson Xing
|
8a9ca41fda
|
Move log_prefill_stats_late to correct location in PP mode (#15946)
|
2025-12-31 12:00:24 +08:00 |
|
|
|
00e607111a
|
[Auto Sync] Update request_metrics_exporter.py (20251230) (#16183)
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: Scott Lee <scottjlee@users.noreply.github.com>
|
2025-12-30 11:09:41 -08:00 |
|
|
Liangsheng Yin
|
ba67e006a7
|
Refactor speculative algorithm registry. (#16168)
|
2025-12-31 01:24:22 +08:00 |
|
|
Ke Bao
|
b973202526
|
Split tp model worker init (#16165)
|
2025-12-30 23:36:03 +08:00 |
|
|
Mufeez Amjad
|
cbff7ad985
|
dp-attention: add follow_bootstrap_room + auto load-balance; drop decode_round_robin (#16110)
|
2025-12-30 22:33:06 +08:00 |
|
|
Ke Bao
|
b3817fa93b
|
Split model_worker init function (#16160)
|
2025-12-30 21:39:11 +08:00 |
|
|
Gaoji Liuandliugaoji.lgj
|
7518dc3532
|
feat(SpecEagleV2): add standalone_worker_v2 (#12625)
Co-authored-by: liugaoji.lgj <liugaoji.lgj@alibaba-inc.com>
|
2025-12-30 17:55:04 +08:00 |
|
|
Shangming Cai
|
db3821a9ef
|
[PP] Add a minimum chunk value for PP dynamic chunking (#16140)
Signed-off-by: Shangming Cai <csmthu@gmail.com>
|
2025-12-30 16:35:39 +08:00 |
|
|
Liangsheng Yin
|
c2601f0d21
|
Fix wrong assigning extend_input_len_per_req with eagle. (#16129)
|
2025-12-30 15:51:53 +08:00 |
|
|
Cheng Wan
|
5fb734f1a5
|
Enhance comments in set_extend_input_len method (#16130)
|
2025-12-29 20:47:33 -08:00 |
|
|
Cheng Wan
|
60f1ca6925
|
Refactor: Moving extend_logprob_start_len calculation out of prepare_for_extend (#16105)
|
2025-12-30 12:38:33 +08:00 |
|
|
cklxx
|
d48723b77d
|
Clamp logprob tokens with model vocab size (#14414)
|
2025-12-29 20:37:07 +08:00 |
|
|
Xuchun Shang
|
4ab66d956f
|
[HiCache] Fix deadlock when creating new group (#15805)
Signed-off-by: Xuchun Shang <xuchun.shang@gmail.com>
|
2025-12-29 17:13:04 +08:00 |
|
|
Cheng Wan
|
6f9d0a89a0
|
[scheduler] fix: correcting extend_logprob_start_len calculation (#15922)
|
2025-12-28 14:57:04 -08:00 |
|
|
Lianmin Zheng
|
e6d5a213ad
|
Fix metrics (#15998)
|
2025-12-28 05:03:49 -08:00 |
|
|
fzyzcjy
|
d90f9bfc4e
|
Temporarily disable temp_prefill_info assertion to unblock CI (#16008)
|
2025-12-28 20:13:06 +08:00 |
|
|
Liangsheng Yin
|
bf90ea9c5b
|
Unify spec v2's naming manner. (#15990)
|
2025-12-28 14:14:52 +08:00 |
|
|
Lianmin Zheng
|
183b65190a
|
Clean up logging (#15919)
|
2025-12-27 15:27:12 -08:00 |
|
|
Lianmin Zheng
|
a8380ded71
|
Add a test case for crash dump (#15905)
|
2025-12-26 19:39:28 -08:00 |
|
|
Cheng Wan
|
2ec57cefd9
|
hotfix: add type hints to scheduler mixins (#15916)
|
2025-12-26 17:08:11 -08:00 |
|
|
Cheng Wan
|
988b14ca0e
|
refactor: add type hints to scheduler mixins (#15913)
|
2025-12-26 16:50:07 -08:00 |
|
|
Yi Zhang
|
ef92b4eb88
|
[BUGFIX] fix edge case for qwen3-next (#14209)
|
2025-12-26 17:14:37 +08:00 |
|
|
Liangsheng Yin
|
e75657c839
|
[Bug] fix piggyback load report return None bug (#15870)
|
2025-12-26 14:48:45 +08:00 |
|