 penguin_wwy
|
93f75778be
|
[RL] Add destroy process group api (#9979)
|
2025-09-19 00:31:56 +08:00 |
|
|
AlphaBabyandfujianhao.fjh
|
4039c626e2
|
fix deepep assert when PD disaggregation == null (#8274)
Co-authored-by: fujianhao.fjh <fujianhao.fjh@antgroup.com>
|
2025-09-19 00:31:01 +08:00 |
|
|
Yi Zhang
|
db71c38fcd
|
Scale kkt after reduction (#10604)
|
2025-09-18 20:51:40 +08:00 |
|
|
Shangming Cai
|
a13dd1e492
|
[PD] Improve disaggregation common backend and refactor mooncake backend (#10273)
Signed-off-by: Shangming Cai <csmthu@gmail.com>
|
2025-09-17 22:58:07 -07:00 |
|
|
Xuchun ShangandTeng Ma
|
1ccd59c715
|
[HICache] introduce evict policy (#10190)
Signed-off-by: Xuchun Shang <xuchun.shang@linux.alibaba.com>
Co-authored-by: Teng Ma <sima.mt@alibaba-inc.com>
|
2025-09-18 11:10:20 +08:00 |
|
|
sogalin
|
c32fb7a24d
|
[ROCm] Fix fp8 quantization accuracy issue. (#10558)
|
2025-09-17 17:44:59 -07:00 |
|
|
Shu Wang
|
1ba137e98f
|
Enable trtllm mla prefix extend (#10526)
|
2025-09-17 16:44:11 -07:00 |
|
|
Kevin Xiang LiandXiang Li
|
de28f8e741
|
vlm: remove redundant d2h movement of mm feature tensors (#9987)
Co-authored-by: Xiang (Kevin) Li <lik@nvidia.com>
|
2025-09-17 15:00:39 -07:00 |
|
|
Ziming Huang
|
b73ac629cd
|
[BugFix] Fix incorrect hidden_states_tensor in pd disaggregation + eagle (#9976)
|
2025-09-17 10:37:14 -07:00 |
|
|
Liangsheng Yin
|
5ccf0b03bd
|
[bench] Fix random seed in bench_one_batch_server (#10548)
|
2025-09-17 19:30:32 +08:00 |
|
|
Yichen YanandjiapingW
|
4f9e71df3c
|
Remove duplicated code (#10545)
Co-authored-by: jiapingW <56055330+jiapingW@users.noreply.github.com>
|
2025-09-16 20:48:22 -07:00 |
|
|
Shu Wang
|
124097fc5b
|
enable prefix cache with dp (#10459)
|
2025-09-16 18:26:58 -07:00 |
|
|
kyleliang-nv
|
e1d45bc280
|
Fix decord dependency for aarch64 docker build (#10529)
|
2025-09-16 17:34:37 -07:00 |
|
|
harrisonlimh
|
14fdd52740
|
feat: add priority based scheduling with priority based request acceptance and preemption (#8746)
|
2025-09-16 17:10:10 -07:00 |
|
|
Lianmin Zhengandgithub-actions[bot] <github-actions[bot]@users.noreply.github.com>
|
f949ad5794
|
[Auto Sync] Update activation.py, chunk_cache.py, utils.py (20250917) (#10538)
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
|
2025-09-16 17:06:43 -07:00 |
|
|
|
c49484a658
|
[Auto Sync] Update scheduler_profiler_mixin.py, rpd_utils.p... (20250916) (#10494)
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: cctry <shiyang@x.ai>
|
2025-09-16 17:02:20 -07:00 |
|
|
cicirori
|
a2f7218a2e
|
support using fa4 on deepseek on blackwell (#9928)
|
2025-09-16 16:16:06 -07:00 |
|
|
fzyzcjy
|
311de47bb7
|
[2/2] Speed up trtllm_mla attention backend (#10474)
|
2025-09-16 15:49:22 -07:00 |
|
|
gongwei-130
|
373080ea6c
|
skip vision_model for lora (#10530)
|
2025-09-16 12:34:42 -07:00 |
|
|
Zaili Wang
|
925dbb3218
|
[CPU] fix CPU backend sel. issue for Llama4 (#10511)
|
2025-09-16 02:57:45 -07:00 |
|
|
fzyzcjy
|
8df7353af3
|
Support sgl-router parallel_batch in bench_one_batch_server (#10506)
|
2025-09-16 02:52:57 -07:00 |
|
|
Yineng Zhang
|
c0c6f543e4
|
chore: upgrade sgl-kernel 0.3.10 (#10500)
|
2025-09-16 02:00:53 -07:00 |
|
|
Shangming Cai
|
edd6a07bc0
|
Minor fix lint introduced by #10466 (#10507)
Signed-off-by: Shangming Cai <csmthu@gmail.com>
|
2025-09-16 01:38:25 -07:00 |
|
|
cao1zhg
|
b6dd4bcb81
|
feat: update support for qwen3next model (#10466)
|
2025-09-16 16:09:56 +08:00 |
|
|
b8zhong
|
b2435be682
|
Cache the result of is_blackwell platform check (#10498)
|
2025-09-15 22:30:28 -07:00 |
|
|
Liangsheng Yin
|
fa5d0bf6a5
|
Remove wrong imports from sglang.python (#10493)
|
2025-09-15 22:12:21 -07:00 |
|
|
brayden-haiandBaizhou Zhang
|
80572c8345
|
[ModelOpt] Respect kv_cache_quant_algo in ModelOpt checkpoints (#10336)
Co-authored-by: Baizhou Zhang <sobereddiezhang@gmail.com>
|
2025-09-15 20:16:49 -07:00 |
|
|
ykwdandTeng Ma
|
4bb08f6e07
|
[Hicache] Evaluate Per-Round Metrics in Multiturn Bench (#10203)
Co-authored-by: Teng Ma <sima.mt@alibaba-inc.com>
|
2025-09-15 19:34:40 -07:00 |
|
|
|
ec272dda9c
|
Temporay work-around for rocm 7.0.0 alpha with enabling data-parallel issue (#10434)
Co-authored-by: wunhuang <wunhuang@amd.com>
Co-authored-by: Sai Enduri <saimanas.enduri@amd.com>
|
2025-09-15 19:08:04 -07:00 |
|
|
scut-cbqandparkeychen
|
a220c14f81
|
fix crash of DeepSeek-V3 update_weights_from_disk (#8863)
Co-authored-by: parkeychen <parkeychen@tencent.com>
|
2025-09-16 09:45:15 +08:00 |
|
|
Lianmin Zhengandcctry
|
31fb19a0a2
|
[Auto Sync] Update registry.py (20250915) (#10484)
Co-authored-by: cctry <shiyang@x.ai>
|
2025-09-15 17:34:28 -07:00 |
|
|
Lifu Huang
|
3f41b48c40
|
[2/2] Introduce Chunked-SGMV kernels and corresponding LoRA backend for improved performance (#10286)
|
2025-09-15 16:04:03 -07:00 |
|
|
Liangsheng Yin
|
c3c26f76b3
|
[Env] minimal version for organizing envs (#10479)
|
2025-09-16 03:51:25 +08:00 |
|
|
Liangsheng Yin
|
2cf811a9da
|
Fix --dataset-path in bench_one_batch_server (#10475)
|
2025-09-16 02:55:02 +08:00 |
|
|
Praneth Paruchuri
|
a45d9a4ee8
|
model: support solar (#8189)
|
2025-09-16 02:21:13 +08:00 |
|
|
Jonas
|
28c79dc84a
|
fix: gpt-oss streaming dropping normal content when tools are provided but not used (#9657)
|
2025-09-15 11:02:32 -07:00 |
|
|
Kevin Tuan
|
1fcccda4b2
|
fix(internvl): fix accuracy issue of normalization (#10375)
|
2025-09-16 01:56:01 +08:00 |
|
|
Yingchun Lai
|
b1721edbac
|
[PD metrics] Add latency Histogram metrics of each stage for generate requests (#8710)
|
2025-09-16 01:52:49 +08:00 |
|
|
Yineng Zhang
|
86a32bb5cd
|
chore: bump v0.5.3rc0 (#10468)
|
2025-09-15 03:55:18 -07:00 |
|
|
Yineng Zhang
|
5afd036533
|
feat: support pip install sglang (#10465)
|
2025-09-15 03:09:17 -07:00 |
|
|
fzyzcjy
|
059c13de5c
|
Fix trtllm_moe wrong correction bias (#10440)
|
2025-09-15 01:02:05 -07:00 |
|
|
Lianmin Zheng
|
50dc0c1e9c
|
Run tests based on labels (#10456)
|
2025-09-15 00:29:20 -07:00 |
|
|
Jimmy_L
|
76becc1dbc
|
Add rtx5880 moe triton (#10439)
|
2025-09-15 00:12:10 -07:00 |
|
|
Jimmy
|
3795b6a43f
|
fix(server_args): Skip chunked_prefill_size validation when disaggregation mode is decode (#10358)
|
2025-09-15 12:13:35 +08:00 |
|
|
Mick
|
0549f21c60
|
fix: fix max_new_tokens uninitialized error (#9343)
|
2025-09-15 12:06:55 +08:00 |
|
|
Vincent Zhong
|
0b14159fc4
|
Add reasoning examples for GPT-OSS in Markdown examples (#9626)
|
2025-09-15 11:27:40 +08:00 |
|
|
Yingchun Lai
|
fc2c3a3d8e
|
metrics: support customer labels specified in request header (#10143)
|
2025-09-14 20:00:08 -07:00 |
|
|
fzyzcjy
|
010181388c
|
Tiny fix wrong naming (#10437)
|
2025-09-14 19:24:41 -07:00 |
|
|
Cheng Wan
|
4844fac91d
|
Refactor TopK to ensure readability and extensibility (#9338)
|
2025-09-14 19:16:25 -07:00 |
|
|
Liangsheng Yin
|
305c9e8c2d
|
[4/N]DP refactor: support watching mode get_load and shortest queue strategy (#10201)
|
2025-09-15 10:06:08 +08:00 |
|