YAMY
|
1f2b84d28d
|
Fix NSA Bug in Centralize NSA Dispatch Logic (#14245)
|
2025-12-01 13:18:18 -08:00 |
|
Simo Lin
|
e7d6027e4a
|
[model-gateway] add ModelCard support to WorkerMetadata (#14243)
|
2025-12-01 13:04:09 -08:00 |
|
ishandhanani
|
07821352fb
|
Revert "Skip weight loading in deepgemm compilation" (#14241)
|
2025-12-01 12:59:09 -08:00 |
|
Byron Hsu
|
edbeaf3b88
|
[MM][style] rename inputs_embeds to input_embeds for consistency (#14240)
|
2025-12-01 11:36:51 -08:00 |
|
Kangyan-Zhou
|
d9dca28247
|
Update pr-test.yml to fix unknown job name deepep-8-gpu
|
2025-12-01 10:02:29 -08:00 |
|
Simo Lin
|
9325f94534
|
[model-gateway] add ModelCard and ProviderType for model configuration (#14237)
|
2025-12-01 09:47:51 -08:00 |
|
Kangyan-Zhou
|
41b7aab848
|
Disable Deepep 8 GPU tests (#14152)
|
2025-12-01 09:37:38 -08:00 |
|
Sulfur6-L8972
|
491f4fe8e1
|
Modify git tag for DeepGemm in sgl-kernel. (#14179)
|
2025-12-01 09:01:22 -08:00 |
|
sglang-bot
|
34035d8cd9
|
chore: bump sgl-kernel version to 0.3.18.post2 (#14229)
|
2025-12-02 00:50:40 +08:00 |
|
Simo Lin
|
92ca629582
|
[model-gateway] add ModelType bitflags and Endpoint enum for worker (#14230)
|
2025-12-01 08:14:44 -08:00 |
|
Chang Su
|
ec92d7f14e
|
[model-gateway] fix v1/models response format to be oai compatible (#13693)
Co-authored-by: Simo Lin <linsimo.mark@gmail.com>
|
2025-12-01 07:20:38 -08:00 |
|
Simo Lin
|
79b389da6b
|
[model-gateway] refactor oai router 1/n (#14228)
|
2025-12-01 07:16:35 -08:00 |
|
Xiaoyu Zhang
|
3de09aadbc
|
Add new moe wna16 marlin gemm (#14122)
|
2025-12-01 23:07:53 +08:00 |
|
liupeng374
|
2e8f54e61e
|
[spec-overlap] bugfix for pd disaggregation and npu (#14088)
Co-authored-by: Even Zhou <even.y.zhou@outlook.com>
|
2025-12-01 22:58:20 +08:00 |
|
Wenyi Xu
|
e55731b6e8
|
[model-gateway] Avoid logging MCP connection token (#13887)
|
2025-12-01 04:44:31 -08:00 |
|
fzyzcjy
|
45264554f3
|
Super tiny fix typo (#14219)
|
2025-12-01 20:19:17 +08:00 |
|
Lianmin Zheng
|
c4293f59ac
|
Change PR test schedule to run every 6 hours (#14218)
|
2025-12-01 03:50:58 -08:00 |
|
Liangsheng Yin
|
a2423052f6
|
Add cuda event based on waiting value (#14214)
|
2025-12-01 18:51:44 +08:00 |
|
Lianmin Zheng
|
bc3d2a85af
|
[Minor] update docs (#14212)
|
2025-12-01 02:33:58 -08:00 |
|
fzyzcjy
|
d815d00248
|
Tiny call cudaProfilerStart only on first rank in node (#14211)
|
2025-12-01 18:18:45 +08:00 |
|
Xiaoyu Zhang
|
fa9021b21f
|
fix: Increase FlashInfer workspace size for Qwen3VL models (#14173)
|
2025-12-01 17:54:23 +08:00 |
|
Xiaoyu Zhang
|
9c80072845
|
Add peak output tokens per second in bench_serving (#14165)
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
|
2025-12-01 17:47:54 +08:00 |
|
Yuan Luo
|
630a693081
|
[VLM] Boost Memory Pool based CUDA IPC (#14123)
Co-authored-by: luoyuan.luo <luoyuan.luo@antgroup.com>
|
2025-12-01 17:17:46 +08:00 |
|
Mick
|
7ce8faae28
|
[diffusion] refactor: remove hard-code of instanceof on PipelineConfig (#14186)
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
|
2025-12-01 16:35:34 +08:00 |
|
fzyzcjy
|
de153cf76a
|
Fix speculative decoding error when retracting (#14180)
|
2025-12-01 15:30:13 +08:00 |
|
fzyzcjy
|
f4a0c5c76b
|
Try to remove wrong logic about max total token in spec decoding (#14167)
|
2025-12-01 15:29:58 +08:00 |
|
Binyao Jiang
|
0f8e53947d
|
[Piecewise] Use same global graph memory pool as the main cuda graph … (#14044)
Co-authored-by: Stefan He <hebiaobuaa@gmail.com>
Co-authored-by: BBuf <1182563586@qq.com>
|
2025-11-30 23:04:10 -08:00 |
|
fzyzcjy
|
e8ba5a668c
|
Support profiling only prefill or decode without the other (#14182)
|
2025-12-01 14:46:30 +08:00 |
|
fzyzcjy
|
a2960bdd6b
|
Super tiny allow millisecond precision in logging (#14183)
|
2025-12-01 14:46:09 +08:00 |
|
fzyzcjy
|
487c8d4df3
|
Tiny add several args to bench serving (#14181)
|
2025-12-01 14:45:47 +08:00 |
|
fzyzcjy
|
f87b8eab23
|
Tiny fix transform_scale_ue8m0 wrong output in some scenarios (#14003)
|
2025-12-01 14:45:27 +08:00 |
|
Minglei Zhu
|
e8542db558
|
[piecewise] move piecewise_cuda_graph_runner init to model_runner initialize (#14034)
Co-authored-by: Stefan He <hebiaobuaa@gmail.com>
Co-authored-by: Binyao Jiang <byjiang1996@gmail.com>
|
2025-11-30 22:16:04 -08:00 |
|
Lianmin Zheng
|
6df1e8d628
|
[Auto Sync] Update backend.py (20251130) (#14153)
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: Stefan He <hebiaobuaa@gmail.com>
Co-authored-by: Byron Hsu <byronhsu1230@gmail.com>
|
2025-11-30 22:15:02 -08:00 |
|
Richard Chen
|
4addb60274
|
Pull Request Instructions: RL and Training Framework Integrations (#14187)
Co-authored-by: zhaochenyang20 <zhaochenyang20@gmail.com>
|
2025-11-30 21:58:54 -08:00 |
|
qichu-yun
|
bd0e690857
|
[Feature] Enable PTPC FP8 for compressed tensors moe (aiter kernel) (#12181)
|
2025-11-30 21:54:28 -08:00 |
|
Byron Hsu
|
0825d7f4c6
|
[piecewise] Refactor VLM to support input embed buffer and remove external embedder hack (#14155)
|
2025-11-30 21:43:09 -08:00 |
|
Yuhao Yang
|
0b9dbea593
|
[diffusion] chore: improve z-image (#14104)
|
2025-12-01 12:26:17 +08:00 |
|
Uranus
|
982db4ebac
|
Feat: GLM-4.6 supports shared experts fusion (#13873)
Signed-off-by: UranusSeven <109661872+UranusSeven@users.noreply.github.com>
Co-authored-by: Kevin-XiongC <kevin_xiong1997@outlook.com>
Co-authored-by: Mingyi Jin <jinmingyi1998@sina.cn>
|
2025-12-01 11:33:18 +08:00 |
|
Teng Ma
|
f5f3a5d98c
|
[PD] Support json file configuration for Transfer Engine (#14059)
Co-authored-by: Shangming Cai <csmthu@gmail.com>
|
2025-12-01 10:47:33 +08:00 |
|
ooapex
|
f138ae5789
|
[model-gateway] support VL models in router (#14140)
|
2025-11-30 17:50:22 -08:00 |
|
YAMY
|
decb48965d
|
[DeepSeekV3.2] Enable pure TP & Partial DP Attention (#13646)
|
2025-11-30 15:59:23 -08:00 |
|
Fan Yin
|
c72f0756d2
|
Fix: fix flashmla fp8 kv cache acc error (#13841)
Co-authored-by: ybyang <ybyang7@iflytek.com>
|
2025-11-30 13:38:19 -08:00 |
|
Baizhou Zhang
|
f1115cf58d
|
Revert "[Minor]Raise Error when deepep num dispatch token per rank is smaller than cuda graph bs" (#14171)
|
2025-11-30 12:49:46 -08:00 |
|
Fan Yin
|
412160f4c1
|
[sgl-kernel] fix b200 kernel ci (#13907)
Co-authored-by: HydraQYH <qyh820@outlook.com>
|
2025-11-30 10:15:37 -08:00 |
|
Baizhou Zhang
|
7b03cc6482
|
[Minor]Raise Error when deepep num dispatch token per rank is smaller than cuda graph bs (#14065)
|
2025-11-30 10:11:42 -08:00 |
|
Hank Han
|
9872a677b4
|
[ci]fix deepep import error on H20 action (#14166)
|
2025-11-30 09:42:57 -08:00 |
|
Dongjoo Seo
|
c15c864b6f
|
Fix LMCache unit test and init bug (#14005)
Signed-off-by: DongDongJu <commisori28@gmail.com>
|
2025-11-30 23:57:32 +08:00 |
|
PiteXChen
|
dc7bdc7329
|
bugfix[schedule]: Excessive preemption occurs when preempting running requests to schedule new prefill requests. (#12494)
Signed-off-by: CLFutureX <chenyongqyl@163.com>
|
2025-11-30 22:29:26 +08:00 |
|
Liangsheng Yin
|
0a9d64530d
|
Support grammar + spec + reasoning (#14163)
|
2025-11-30 21:19:57 +08:00 |
|
fzyzcjy
|
340c613ab5
|
Support numactl bind for CPU and memory before process starts (#14156)
|
2025-11-30 17:00:33 +08:00 |
|