Jimmy
|
88a2a34041
|
[Fix]HTTP Stream raise exception (#11904)
|
2025-11-07 03:23:12 +08:00 |
|
Teng Ma
|
78c58621d2
|
[mem pool] bugfix: wrong position for self.device in Mamba (#12684)
|
2025-11-07 03:05:42 +08:00 |
|
Mattheliu
|
c3bb348dad
|
[Docs] fix dead links in multiple documentation pages (#12764)
|
2025-11-06 10:49:32 -08:00 |
|
gaopengff
|
4e234b4cf9
|
[Intel XPU]Update pytorch xpu to 2.9 (#12363)
|
2025-11-06 10:34:23 -08:00 |
|
gaopengff
|
4cc725ac1c
|
[Intel]Add 'intel_xpu' attention backend for llama4 (#11051)
|
2025-11-06 10:33:41 -08:00 |
|
Chang Su
|
2cb42dc184
|
[router][grpc] Add more mcp test cases to responses api (#12749)
|
2025-11-06 10:20:00 -08:00 |
|
sglang-bot
|
0c006b8809
|
chore: bump SGLang version to 0.5.5 (#12739)
|
2025-11-07 00:46:19 +08:00 |
|
Ke Bao
|
cd135bfe30
|
Update dsv3 quantization auto setting for sm100 (#12778)
|
2025-11-06 22:39:13 +08:00 |
|
Xiaoyu Zhang
|
fc84b0730c
|
[Refactor] Refactor fused_moe_triton tuning tools: extract shared utils, add EP/MLLM support, reduce overhead (#12440)
Co-authored-by: xu-yfei <xu-yfei@users.noreply.github.com>
Co-authored-by: Yongfei Xu <xuyongfei.xyf@antgroup.com>
|
2025-11-06 20:54:42 +08:00 |
|
Keyang Ru
|
8be0e1bc9c
|
fix ci (#12760)
|
2025-11-06 00:21:11 -08:00 |
|
Amit Prakash
|
8e1d6756d5
|
docs: document video-capable multimodal models (#12565)
|
2025-11-06 00:06:19 -08:00 |
|
jiapingW
|
0da30dbc20
|
fix qwen3-omni audio length < 30s (#12674)
Co-authored-by: canghua <canghua.wjp@alibaba-inc.com>
|
2025-11-06 00:05:28 -08:00 |
|
yinghui
|
58095cb00a
|
Add timing metrics for requests (#12646)
Co-authored-by: Scott Lee <scottjlee@users.noreply.github.com>
|
2025-11-05 23:07:16 -08:00 |
|
Yuan Luo
|
fd3034da75
|
[VLM] Optimize qwen_vl preprocess_video (#12240)
Co-authored-by: luoyuan.luo <luoyuan.luo@antgroup.com>
Co-authored-by: 羽癫 <yudian.zy@antgroup.com>
|
2025-11-06 14:55:01 +08:00 |
|
Binyao Jiang
|
fbbe16faab
|
[GDN] Fuse b.sigmoid(), fused_gdn_gating and unsqueeze into one kernel: up to 0.85% e2e speedup (#12508)
|
2025-11-05 22:52:04 -08:00 |
|
Yi Zhang
|
6a1a64fa41
|
[BUGFIX] fix output_ids in abort (#12737)
|
2025-11-05 22:51:47 -08:00 |
|
Yi Zhang
|
e2715cf871
|
fix mamba prefix cache leak caused by abort (#12693)
|
2025-11-05 22:51:03 -08:00 |
|
Keyang Ru
|
74630ba310
|
[router][ci] Disable cache (#12752)
|
2025-11-05 22:49:03 -08:00 |
|
Mick
|
73e9a2ef5c
|
fix: tiny fix cli (#12744)
|
2025-11-06 14:45:50 +08:00 |
|
Chang Su
|
837b08eb2e
|
[router][grpc] Support mixin tool calls in Responses API (#12736)
|
2025-11-05 21:29:45 -08:00 |
|
Baizhou Zhang
|
bb6a21cd99
|
[Fix]Tiny fix in Dockerfile (#12748)
|
2025-11-05 21:04:33 -08:00 |
|
b8zhong
|
32ec68faf9
|
keep attention backend document up to date (#12741)
|
2025-11-05 20:41:20 -08:00 |
|
Baizhou Zhang
|
3c0a6df82d
|
[chore] Fix triton installation for cu13 image (#12742)
|
2025-11-05 20:20:18 -08:00 |
|
Atream
|
2104d20eba
|
Temporarily fix missing routed_scaling_factor for CompressedTensorsWNA16MoEMethod (#12738)
|
2025-11-06 12:01:03 +08:00 |
|
YAMY
|
f235498eca
|
DeepSeek-V3.2: Add Adaptive MHA Attention Pathway for Short-Sequence Prefill (#11892)
|
2025-11-05 19:33:26 -08:00 |
|
alisonshao
|
149dc9aab1
|
Add nightly test multi gpu configs (#12721)
|
2025-11-05 19:30:19 -08:00 |
|
Baizhou Zhang
|
9a954982de
|
[chore] SGLang tag management in Dockerfile (#12734)
|
2025-11-05 19:03:26 -08:00 |
|
gongwei-130
|
97be66c358
|
fix sgl-kernel version (#12723)
|
2025-11-05 19:01:03 -08:00 |
|
Keyang Ru
|
74243dffa2
|
Revert "[router] web_search_preview tool basic implementation" (#12716)
|
2025-11-05 18:57:39 -08:00 |
|
Keyang Ru
|
4ea4c48bb0
|
Revert "[ci] fix permission" (#12732)
|
2025-11-05 18:26:29 -08:00 |
|
Zaili Wang
|
cf5d27e30a
|
[CPU] Upgrade default PT version to 2.9 (#12611)
|
2025-11-05 18:16:35 -08:00 |
|
Baizhou Zhang
|
9ec6031d70
|
[chore]Remove dockerfile from target file of bump kernel version (#12728)
|
2025-11-05 18:01:19 -08:00 |
|
Keyang Ru
|
a5affb0caf
|
[ci] fix permission (#12729)
|
2025-11-05 17:43:48 -08:00 |
|
Keyang Ru
|
5925d3d719
|
fix labeler (#12718)
|
2025-11-05 17:34:56 -08:00 |
|
Keyang Ru
|
7ef1964a66
|
[router] add basic ci tests for gpt-oss model support (#12651)
Co-authored-by: Chang Su <chang.s.su@oracle.com>
|
2025-11-05 15:45:11 -08:00 |
|
Keyang Ru
|
b0476a0642
|
[router][quick fix] Add minimal option for reasoning effort in spec (#12711)
|
2025-11-05 15:43:19 -08:00 |
|
Chang Su
|
ffba61a100
|
[router][grpc] Make harmony parser checks recipient first before channel (#12713)
|
2025-11-05 15:33:52 -08:00 |
|
Chang Su
|
3c219eb0e4
|
[misc] Change sync-labels to false (#12714)
|
2025-11-05 15:33:33 -08:00 |
|
Kangyan-Zhou
|
1ffdcdc430
|
Revert "Commented out b200 tests due to runner shortage (#12609)" (#12712)
|
2025-11-05 15:09:49 -08:00 |
|
Lianmin Zheng
|
c7d57d5bb3
|
Fix CI and style (#12658)
|
2025-11-05 15:08:15 -08:00 |
|
Keyang Ru
|
80802c4cc6
|
[router][ci] speed up python binding to 1.5 min (#12673)
|
2025-11-05 14:52:33 -08:00 |
|
Chang Su
|
83b104ee8c
|
[misc] Add labeler for automatic labeling (#12710)
|
2025-11-05 14:44:43 -08:00 |
|
Kaixi Hou
|
141278048e
|
[NVIDIA] Fix unit test of MoE and add it to nightly ci (#12709)
|
2025-11-05 14:33:18 -08:00 |
|
Shu Wang
|
82f39dc11d
|
Add mm_fp4 trtllm backend (#12406)
|
2025-11-05 14:31:46 -08:00 |
|
Atream
|
627bac649c
|
Support Expert Deferral Mechanism in KTransformers (#12586)
Co-authored-by: Chen Hongtao <56470055+chenht2022@users.noreply.github.com>
Co-authored-by: chenht2022 <cht22@mails.tsinghua.edu.cn>
|
2025-11-05 13:41:52 -08:00 |
|
wyx
|
3651cfbf62
|
[router] fix: validate HTTP status codes in health check (#12631)
|
2025-11-05 13:37:17 -08:00 |
|
Morpheus Guo
|
c8547ecddd
|
Enable Aiter Attention for VL model (#12699)
Co-authored-by: yuechguo <yuechguo@amd.com>
|
2025-11-05 13:01:23 -08:00 |
|
Mick
|
7bc1dae095
|
WIP: initial multimodal-gen support (#12484)
Co-authored-by: yhyang201 <yhyang201@gmail.com>
Co-authored-by: yizhang2077 <1109276519@qq.com>
Co-authored-by: Xinyuan Tong <xinyuantong.cs@gmail.com>
Co-authored-by: ispobock <ispobaoke@gmail.com>
Co-authored-by: JiLi <leege233@gmail.com>
Co-authored-by: CHEN Xi <78632976+RubiaCx@users.noreply.github.com>
Co-authored-by: laixin <xielx@shanghaitech.edu.cn>
Co-authored-by: SolitaryThinker <wlsaidhi@gmail.com>
Co-authored-by: jzhang38 <a1286225768@gmail.com>
Co-authored-by: BrianChen1129 <yongqichcd@gmail.com>
Co-authored-by: Kevin Lin <42618777+kevin314@users.noreply.github.com>
Co-authored-by: Edenzzzz <wtan45@wisc.edu>
Co-authored-by: rlsu9 <r3su@ucsd.edu>
Co-authored-by: Jinzhe Pan <48981407+eigensystem@users.noreply.github.com>
Co-authored-by: foreverpiano <pianoqwz@qq.com>
Co-authored-by: RandNMR73 <notomatthew31@gmail.com>
Co-authored-by: PorridgeSwim <yz3883@columbia.edu>
Co-authored-by: Jiali Chen <90408393+gary-chenjl@users.noreply.github.com>
|
2025-11-05 12:28:52 -08:00 |
|
Chang Su
|
4fe53e5888
|
[router][grpc] Support streaming parsing with Tool Choice in chat completions API (#12677)
|
2025-11-05 12:12:21 -08:00 |
|
Lianmin Zheng
|
fb2e816e83
|
Fix server args for gpt oss so users can override the moe runner backend (#12696)
|
2025-11-05 11:36:59 -08:00 |
|