Keyang Ru
|
74243dffa2
|
Revert "[router] web_search_preview tool basic implementation" (#12716)
|
2025-11-05 18:57:39 -08:00 |
|
Keyang Ru
|
4ea4c48bb0
|
Revert "[ci] fix permission" (#12732)
|
2025-11-05 18:26:29 -08:00 |
|
Zaili Wang
|
cf5d27e30a
|
[CPU] Upgrade default PT version to 2.9 (#12611)
|
2025-11-05 18:16:35 -08:00 |
|
Baizhou Zhang
|
9ec6031d70
|
[chore]Remove dockerfile from target file of bump kernel version (#12728)
|
2025-11-05 18:01:19 -08:00 |
|
Keyang Ru
|
a5affb0caf
|
[ci] fix permission (#12729)
|
2025-11-05 17:43:48 -08:00 |
|
Keyang Ru
|
5925d3d719
|
fix labeler (#12718)
|
2025-11-05 17:34:56 -08:00 |
|
Keyang Ru
|
7ef1964a66
|
[router] add basic ci tests for gpt-oss model support (#12651)
Co-authored-by: Chang Su <chang.s.su@oracle.com>
|
2025-11-05 15:45:11 -08:00 |
|
Keyang Ru
|
b0476a0642
|
[router][quick fix] Add minimal option for reasoning effort in spec (#12711)
|
2025-11-05 15:43:19 -08:00 |
|
Chang Su
|
ffba61a100
|
[router][grpc] Make harmony parser checks recipient first before channel (#12713)
|
2025-11-05 15:33:52 -08:00 |
|
Chang Su
|
3c219eb0e4
|
[misc] Change sync-labels to false (#12714)
|
2025-11-05 15:33:33 -08:00 |
|
Kangyan-Zhou
|
1ffdcdc430
|
Revert "Commented out b200 tests due to runner shortage (#12609)" (#12712)
|
2025-11-05 15:09:49 -08:00 |
|
Lianmin Zheng
|
c7d57d5bb3
|
Fix CI and style (#12658)
|
2025-11-05 15:08:15 -08:00 |
|
Keyang Ru
|
80802c4cc6
|
[router][ci] speed up python binding to 1.5 min (#12673)
|
2025-11-05 14:52:33 -08:00 |
|
Chang Su
|
83b104ee8c
|
[misc] Add labeler for automatic labeling (#12710)
|
2025-11-05 14:44:43 -08:00 |
|
Kaixi Hou
|
141278048e
|
[NVIDIA] Fix unit test of MoE and add it to nightly ci (#12709)
|
2025-11-05 14:33:18 -08:00 |
|
Shu Wang
|
82f39dc11d
|
Add mm_fp4 trtllm backend (#12406)
|
2025-11-05 14:31:46 -08:00 |
|
Atream
|
627bac649c
|
Support Expert Deferral Mechanism in KTransformers (#12586)
Co-authored-by: Chen Hongtao <56470055+chenht2022@users.noreply.github.com>
Co-authored-by: chenht2022 <cht22@mails.tsinghua.edu.cn>
|
2025-11-05 13:41:52 -08:00 |
|
wyx
|
3651cfbf62
|
[router] fix: validate HTTP status codes in health check (#12631)
|
2025-11-05 13:37:17 -08:00 |
|
Morpheus Guo
|
c8547ecddd
|
Enable Aiter Attention for VL model (#12699)
Co-authored-by: yuechguo <yuechguo@amd.com>
|
2025-11-05 13:01:23 -08:00 |
|
Mick
|
7bc1dae095
|
WIP: initial multimodal-gen support (#12484)
Co-authored-by: yhyang201 <yhyang201@gmail.com>
Co-authored-by: yizhang2077 <1109276519@qq.com>
Co-authored-by: Xinyuan Tong <xinyuantong.cs@gmail.com>
Co-authored-by: ispobock <ispobaoke@gmail.com>
Co-authored-by: JiLi <leege233@gmail.com>
Co-authored-by: CHEN Xi <78632976+RubiaCx@users.noreply.github.com>
Co-authored-by: laixin <xielx@shanghaitech.edu.cn>
Co-authored-by: SolitaryThinker <wlsaidhi@gmail.com>
Co-authored-by: jzhang38 <a1286225768@gmail.com>
Co-authored-by: BrianChen1129 <yongqichcd@gmail.com>
Co-authored-by: Kevin Lin <42618777+kevin314@users.noreply.github.com>
Co-authored-by: Edenzzzz <wtan45@wisc.edu>
Co-authored-by: rlsu9 <r3su@ucsd.edu>
Co-authored-by: Jinzhe Pan <48981407+eigensystem@users.noreply.github.com>
Co-authored-by: foreverpiano <pianoqwz@qq.com>
Co-authored-by: RandNMR73 <notomatthew31@gmail.com>
Co-authored-by: PorridgeSwim <yz3883@columbia.edu>
Co-authored-by: Jiali Chen <90408393+gary-chenjl@users.noreply.github.com>
|
2025-11-05 12:28:52 -08:00 |
|
Chang Su
|
4fe53e5888
|
[router][grpc] Support streaming parsing with Tool Choice in chat completions API (#12677)
|
2025-11-05 12:12:21 -08:00 |
|
Lianmin Zheng
|
fb2e816e83
|
Fix server args for gpt oss so users can override the moe runner backend (#12696)
|
2025-11-05 11:36:59 -08:00 |
|
Baizhou Zhang
|
7c45b8b4bb
|
[CI] Fix qwen3-vl lora nightly ci (#12708)
|
2025-11-05 11:00:13 -08:00 |
|
Kangyan-Zhou
|
ba5b68236f
|
Commented out b200 tests due to runner shortage (#12609)
|
2025-11-05 10:47:43 -08:00 |
|
bigmoyan
|
508d2f7aa2
|
add Kimi k2 reasoning parser (#12702)
Signed-off-by: wangzhengtao <wangzhengtao@msh.team>
|
2025-11-06 00:37:54 +08:00 |
|
Yuxuan Zhang
|
a889c85459
|
[Grammar Fix] GLM-4-MOE self.first_k_dense_replace is undefined. (#12455)
|
2025-11-06 00:03:45 +08:00 |
|
Yuhong Guo
|
4d84f886e7
|
Refactor --debug-tensor-dump-layers to list (#12691)
|
2025-11-05 03:30:01 -08:00 |
|
yinghui
|
dc4f541823
|
fix trtllm_mla attention backend when disabling cuda graph. (#12687)
|
2025-11-05 01:35:02 -08:00 |
|
zejunchen-zejun
|
0648eb482d
|
[Profiler] Add SGLANG_PROFILE_RECORD_SHAPES for recording shapes when profiling (#11641)
Signed-off-by: zejunchen-zejun <zejun.chen@amd.com>
Co-authored-by: HAI <hixiao@gmail.com>
|
2025-11-04 23:41:46 -08:00 |
|
yinghui
|
b88fab3111
|
fix: add seed bench_serving to cache key, remove redundant function definition. (#12680)
|
2025-11-04 23:39:11 -08:00 |
|
Hubert Lu
|
3694266051
|
Expand and update test coverage for AMD CI (#10044)
|
2025-11-04 22:15:13 -08:00 |
|
Chang Su
|
9f5e701879
|
[router][grpc] Implement tool_choice support for Responses API (#12668)
|
2025-11-04 21:43:42 -08:00 |
|
Glen Liu
|
cbf23dbbfa
|
[Feature] add --lora-request-distribution arg to bench_serving.py and support skewed and distinct workloads (#12175)
|
2025-11-04 21:41:40 -08:00 |
|
Kangyan-Zhou
|
6dade6c3b5
|
Fix VLLM dependency test (#12670)
|
2025-11-04 20:49:58 -08:00 |
|
Yingchun Lai
|
b419e20c5b
|
[Dockerfile] Speed up docker image building (#8784)
|
2025-11-04 20:26:18 -08:00 |
|
ai-easy-cpu
|
48641435d6
|
fix typo of args description in sglang.profiler (#12486)
Co-authored-by: AI-bot-easy <litchys0123@outlook.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
|
2025-11-04 20:15:13 -08:00 |
|
Liangsheng Yin
|
44b1b394a4
|
[PD-Disagg] Check finish after pop tranferred (#12638)
|
2025-11-05 11:18:09 +08:00 |
|
Kaixi Hou
|
0711d1509b
|
[NVIDIA] Fix cutedsl backend of MoE (#12353)
|
2025-11-04 18:54:55 -08:00 |
|
sglang-bot
|
09938e1f82
|
chore: bump SGLang version to 0.5.4.post3 (#12639)
|
2025-11-04 18:32:11 -08:00 |
|
Nicolas Castet
|
2340798353
|
Register allgather/reducescatter buffers with symm memory (#12572)
|
2025-11-04 17:11:36 -08:00 |
|
Chang Su
|
1357ab025a
|
[router][grpc] Emit OutputItemDone event and store output item array (#12656)
|
2025-11-04 17:01:03 -08:00 |
|
soaringk
|
44da737770
|
[fix] Handle escaped characters in GLM tool call parser to prevent double serialization (#12456)
|
2025-11-04 16:48:14 -08:00 |
|
alisonshao
|
fb9582c4e1
|
Add multi-GPU configurations to nightly-test.yml (#12585)
|
2025-11-04 16:46:30 -08:00 |
|
Baizhou Zhang
|
d22d044734
|
Revert "Enable memory saver for hybrid model" (#12648)
|
2025-11-04 16:22:06 -08:00 |
|
Chang Su
|
887742a1e7
|
[router][grpc] Fix index issues in reasoning content and missing streaming events (#12650)
|
2025-11-04 15:38:43 -08:00 |
|
Kaixi Hou
|
34f7564df0
|
[NVIDIA] Fix wrong symmetric sizes for fp4 cases (#12640)
|
2025-11-04 14:19:37 -08:00 |
|
Johnsonms
|
1cfbbc42d8
|
[Bug] Fix NSA Backend KV-Buffer Shape Mismatch in DeepSeek-V3.2 (#12645)
|
2025-11-04 13:57:32 -08:00 |
|
Lianmin Zheng
|
55dfb539cf
|
[Auto Sync] Update scheduler_metrics_mixin.py, collector.py (20251104) (#12647)
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: SangBin Cho <rkooo567@gmail.com>
|
2025-11-04 13:56:14 -08:00 |
|
Baizhou Zhang
|
42889acbd0
|
[hotfix] Fix deepep w4a8 bug (#12642)
|
2025-11-04 13:55:59 -08:00 |
|
Trevor Morris
|
211f4070e5
|
fix: Lazy import mooncake-ep to fix extra gpu contexts being created (#12641)
|
2025-11-04 12:28:36 -08:00 |
|