 b8zhong
|
a076ec1a7a
|
Revert "fix llama4 kv cache layout" (#12437)
|
2025-10-30 22:33:37 -07:00 |
|
|
Keyang Ru
|
72b5f3d0bb
|
[ci] install released version router (#12410)
|
2025-10-30 21:59:08 -07:00 |
|
|
bppps
|
2f766f381d
|
[Bugfix]: distinguish processors for deepseek_vl2 and deepseek_ocr to p… (#12384)
|
2025-10-30 21:51:30 -07:00 |
|
|
elvischenv
|
069e490bcb
|
feat: support trtllm_mha FP8 query attention kernel (#12307)
|
2025-10-30 21:39:35 -07:00 |
|
|
Yuhong Guo
|
ab95d35fcb
|
feat: Add Non-intrusive Tensor Dumping for Model Inference (#10566)
|
2025-10-31 12:04:48 +08:00 |
|
|
b8zhongandBrayden Zhong
|
34c286b811
|
Fix the shared expert & routed expert overlap in Llama 4 (#12405)
Co-authored-by: Brayden Zhong <b8zhong@users.noreply.github.com>
|
2025-10-30 20:14:49 -07:00 |
|
|
Liangsheng Yin
|
9416ee60dd
|
Reserved abortion API when retracting (#12425)
|
2025-10-31 10:56:05 +08:00 |
|
|
Liangsheng Yin
|
d4a09ec9dc
|
[CI] fix tests' time estimation (#12401)
|
2025-10-30 19:20:35 -07:00 |
|
|
Johnsonms
|
662725b936
|
[DeepSeekV32] Bug fix to ensure page_table and result in same type (#12300)
|
2025-10-30 18:56:51 -07:00 |
|
|
Xinyuan TongandCursor Agent
|
82cfcd3bb8
|
[Refactor] tuning_fused_moe for MLLM and small refactor (#11224)
Co-authored-by: Cursor Agent <cursoragent@cursor.com>
|
2025-10-31 08:54:14 +08:00 |
|
|
lpc0220
|
6c1a3f0cb2
|
enable cudaProfilerApi for one batch benchmarking (#11116)
|
2025-10-30 15:43:59 -07:00 |
|
|
Simo Lin
|
6237754842
|
[router] 0.2.2 release (#12399)
|
2025-10-30 14:40:13 -07:00 |
|
|
Keyang Ru
|
96ac24c09e
|
[router] web_search_preview tool basic implementation (#12290)
|
2025-10-30 14:37:28 -07:00 |
|
|
Kaixi Hou
|
c0d02cf4d1
|
[NVIDIA] Add CI workloads for GB200 (#12242)
|
2025-10-30 14:32:03 -07:00 |
|
|
popsiclexu
|
7d121448b2
|
[Bug fix][PD Dissaggregation] fix prefill hanging issue with PP and DP Attention, (#12368)
|
2025-10-30 14:22:47 -07:00 |
|
|
Lianmin Zheng
|
6a63a9852e
|
minor code sync (#12403)
|
2025-10-30 12:49:31 -07:00 |
|
|
Keyang Ru
|
4d2f17bd0b
|
[router] Function call support for openai router Responses API (#12386)
|
2025-10-30 12:45:10 -07:00 |
|
|
Lianmin Zheng
|
7cd716f776
|
Update news section in README.md (#12409)
|
2025-10-30 12:41:21 -07:00 |
|
|
Baizhou Zhang
|
b7fdde4bb4
|
[ci] Fix ci_install_deepep (#12375)
|
2025-10-30 11:39:14 -07:00 |
|
|
Keyang Ru
|
69bf801173
|
[router] Fix safety_identifier missing (#12404)
|
2025-10-30 10:40:50 -07:00 |
|
|
Xiaoyu Zhang
|
d8fcbaa38d
|
[CI Monitor] Fix ci_monitor perf analyzer bug (#12281)
|
2025-10-30 09:47:12 -07:00 |
|
|
rongfu.leng
|
2cf3d0f89f
|
[router] use safety_identifier replace user on chat history storage (#12185)
|
2025-10-30 08:47:22 -07:00 |
|
|
Chen1022
|
1ed1abfd45
|
feat: add EP support in tuning (#12012)
|
2025-10-30 07:58:50 -07:00 |
|
|
Chang Suandybyang
|
ecb9fa14e6
|
[docker] clean up main dockerfile for router and dev configurations (#12364)
Co-authored-by: ybyang <ybyang7@iflytek.com>
|
2025-10-30 07:46:09 -07:00 |
|
|
Simo Lin
|
700daa3463
|
[router] harmony responses api streaming support (#12395)
|
2025-10-30 07:30:48 -07:00 |
|
|
Fan Yin
|
39cee0fed2
|
[sgl-kernel] upd deepgemm hash to rebased commit (#11960)
|
2025-10-30 07:19:00 -07:00 |
|
|
Xiaoyu Zhang
|
04e5b6faa7
|
Revert "Triton fused_moe_kernel support ep moe tuning" (#12377)
|
2025-10-30 07:12:06 -07:00 |
|
|
Even Zhouandliupeng374
|
ce6b17c0f9
|
[Feature] Support DeepSeek MTP on NPU (#11897)
Co-authored-by: liupeng374 <liupeng374@huawei.com>
|
2025-10-30 21:56:56 +08:00 |
|
|
Even Zhou
|
cafebef154
|
[NPU] bugfix for Qwen3-Next and performance update (#11969)
|
2025-10-30 21:52:16 +08:00 |
|
|
Liangsheng Yin
|
73dfd2dfb1
|
[Test] Enhance radix cache test for spec cases (#12394)
|
2025-10-30 18:46:28 +08:00 |
|
|
fzyzcjy
|
df5192cffa
|
Enable fast silu-and-mul-and-quant fused kernel (#11806)
|
2025-10-30 18:15:39 +08:00 |
|
|
JensenFire
|
78c43d8847
|
[Feature] Initial eagle3 support for Deepseek-like models (#12319)
|
2025-10-30 17:26:09 +08:00 |
|
|
Kangyan-Zhou
|
7e28c67d19
|
Fix DeepSeek chat templates to handle tool call arguments type checking (#11700) (#12123)
|
2025-10-30 16:39:25 +08:00 |
|
|
Tanjiro
|
3edba9bcc0
|
[fix] added image token as prefix for deepseek-ocr (#12358)
|
2025-10-30 16:37:03 +08:00 |
|
|
Xuchun Shang
|
e5ec976402
|
[Bug fix][PP] fix deadlock with tie_word_embeddings (#12362)
Signed-off-by: Xuchun Shang <xuchun.shang@gmail.com>
|
2025-10-30 01:03:28 -07:00 |
|
|
Baizhou Zhang
|
621dfb8886
|
Import flash_mla from sgl-kernel (#12135)
|
2025-10-29 23:54:21 -07:00 |
|
|
fzyzcjy
|
fb52d35f63
|
Super tiny fix AMD ci (#12378)
|
2025-10-29 23:25:18 -07:00 |
|
|
Kangyan-ZhouandClaude
|
2b71531a70
|
Allow benchmarking tool to handle empty response (#12174)
Co-authored-by: Claude <noreply@anthropic.com>
|
2025-10-29 20:26:23 -07:00 |
|
|
fzyzcjy
|
25c5049870
|
Super tiny add tag for benchmark scripts (#12340)
|
2025-10-30 11:19:14 +08:00 |
|
|
Makcum888e
|
8e2ac2e628
|
[NPU] fix pp_size>1 (#12195)
|
2025-10-30 11:18:36 +08:00 |
|
|
Yuan Luoandluoyuan.luo
|
17a57fd862
|
[Perf] Optimize multimodal mm_inputs process in scheduler (#11910)
Co-authored-by: luoyuan.luo <luoyuan.luo@antgroup.com>
|
2025-10-30 10:48:10 +08:00 |
|
|
Teng Ma
|
32438eba45
|
[Ckpt Engine] feat: new sglang entrypoint support for update (#12216)
|
2025-10-30 10:39:27 +08:00 |
|
|
FlyPandaandherta
|
fed02a49c2
|
[bugfix] fix deepseekvl2 and deepseek_ocr model type conflict (#12050)
Co-authored-by: herta <herta@pplabs.org>
|
2025-10-29 18:54:32 -07:00 |
|
|
Simo LinandChang Su
|
03b3e89aea
|
[router] Harmony Pipeline: Chat Completion & Responses API with MCP Support (#12153)
Co-authored-by: Chang Su <chang.s.su@oracle.com>
|
2025-10-29 18:52:56 -07:00 |
|
|
Trevor Morris
|
9ff9fa7f95
|
Fuse wk and weight_proj in Indexer for DeepSeekV3.2-FP4 (#12094)
|
2025-10-29 18:42:56 -07:00 |
|
|
b8zhong
|
7ed8ba05cb
|
[CI] Add Llama 3.1 8B FP4 to B200 CI (#12182)
|
2025-10-29 14:56:41 -07:00 |
|
|
Stefan He
|
df08f346ce
|
Fix Duplicate Classmethod in spec_info.py (#12354)
|
2025-10-29 13:57:10 -07:00 |
|
|
Chang Su
|
db15148c8a
|
[router] update router docker to use maturin and build from local (#12350)
|
2025-10-29 13:00:57 -07:00 |
|
|
Simo Lin
|
5259becd3c
|
[bug] fix router installation to include additional dependency (#12348)
|
2025-10-29 12:45:18 -07:00 |
|
|
AichenF
|
ed1044ac1b
|
support cutlass fp4 kernel in sm120 (#11737)
|
2025-10-29 12:25:16 -07:00 |
|