 Yi Zhongandb8zhong
|
cda35611d4
|
[perf] Add two stream norm for Olmo3 speedup 5% (#13681)
Signed-off-by: Vincent Zhong <207368749+vincentzed@users.noreply.github.com>
Co-authored-by: b8zhong <b8zhong@uwaterloo.ca>
|
2026-01-08 17:01:35 +00:00 |
|
|
Mohammad Miadh Angkad
|
05ab110e02
|
[Performance] Force split_k=1 for MXFP4 Triton kernels on Hopper (#16014)
Signed-off-by: Mohammad Miadh Angkad <MAngkad.BSDSBA2027@aim.edu>
|
2026-01-08 23:52:22 +08:00 |
|
|
fzyzcjy
|
b6e8a0d851
|
Add file size hints in bitwise model file verifier (#16735)
|
2026-01-08 22:28:52 +08:00 |
|
|
luoyuyan
|
fb7609f1dd
|
Fix FP8 MoE NaN with DeepGEMM on Blackwell (#16622)
|
2026-01-08 22:24:12 +08:00 |
|
|
yuhaoandMick
|
d2ea44f775
|
VLM: enhance VL embedding model with video input support and revise warm-up strategy (#16635)
Co-authored-by: Mick <mickjagger19@icloud.com>
|
2026-01-08 22:12:01 +08:00 |
|
|
fzyzcjy
|
83abecd0c2
|
Support pre-generating and using expected checksums (#16730)
|
2026-01-08 20:26:13 +08:00 |
|
|
fzyzcjy
|
d54f0a10b4
|
Support bitwise weight checksum verifier (#16729)
|
2026-01-08 20:19:25 +08:00 |
|
|
|
fb04e7e3c8
|
[Auto Sync] Update schedule_batch.py, common.py, eagle_info... (20260105) (#16519)
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: cctry <shiyang@x.ai>
|
2026-01-08 02:35:46 -08:00 |
|
|
chenxu214
|
7dd679cbb9
|
[NPU][Bugfix] Fix qwen3 error when enable-dp-lm-head (#16115)
|
2026-01-08 15:15:43 +08:00 |
|
|
陈一涵
|
48b8dcd42e
|
[jit kernel] support dtype as a cpp template parameter (#16452)
|
2026-01-08 13:54:33 +08:00 |
|
|
Hubert Lu
|
4935344fcd
|
[AMD] Fix aiter page-size handling, DeepSeek MLA tuple inputs, and HiCache/FA3 decode-backend override (#16531)
|
2026-01-07 21:14:32 -08:00 |
|
|
Alison Shao
|
63cc97f4ef
|
ci: migrate 2-GPU tests to test/registered/ (#16529)
|
2026-01-07 20:28:16 -08:00 |
|
|
hw-csong
|
261860e17b
|
[NPU][Bugfix] move free_page logics to cpu (#16608)
|
2026-01-08 12:00:18 +08:00 |
|
|
siyu
|
6b3f93c4dd
|
vlm: support SGLANG_MM_SKIP_COMPUTE_HASH for bypassing multimodal feature hashing (#16555)
|
2026-01-08 11:10:00 +08:00 |
|
|
Junrong Lin
|
eec7dbd31e
|
remove redundant max_running_reqs calculation in r3 (#16629)
|
2026-01-08 09:45:21 +08:00 |
|
|
Baizhou Zhang
|
38dc5839dd
|
[1/n]deepseek_v2.py Refactor: attention backend handlers and forward method definition (#16306)
|
2026-01-08 09:22:31 +08:00 |
|
|
Harish
|
156d97b219
|
Fix KeyError when logprobs=false in completions endpoint (#16095)
|
2026-01-07 15:49:02 -08:00 |
|
|
b8zhongandBrayden Zhong
|
24b30f7757
|
MoE Refactor: Refactor fp8.py -> flashinfer_trllm.py (#15151)
Co-authored-by: Brayden Zhong <b8zhong@users.noreply.github.com>
|
2026-01-07 15:35:00 -08:00 |
|
|
Michael
|
3e73e12458
|
Revert "Add SwapAB Optimization for triton fused_moe_kernel on SM90." (#16676)
|
2026-01-07 11:24:47 -08:00 |
|
|
Insideyyy
|
ee4d2287ab
|
Add SwapAB Optimization for triton fused_moe_kernel on SM90. (#15712)
|
2026-01-07 23:45:35 +08:00 |
|
|
Yi ZhangandHanming Lu
|
7fc12e0bfa
|
support page size large than 64 for mamba radix cache (#16657)
Co-authored-by: Hanming Lu <hanming@x.ai>
|
2026-01-07 22:52:24 +08:00 |
|
|
|
fd16c91cb8
|
Handle Marlin weight restoration and shape recording (QAT INT4 Rollout Part1) (#15238)
Co-authored-by: Gao016 <yngao016@163.com>
Co-authored-by: yefei12 <xjtu_yefeichen@163.com>
Co-authored-by: yzlnew <yzlnew@gmail.com>
Co-authored-by: Peng Zhang <aniz1905@gmail.com>
|
2026-01-07 21:11:24 +08:00 |
|
|
Hudson Xing
|
98a107d491
|
Re-enable temp_prefill_info assertion after pairing fix (#16203)
|
2026-01-07 18:05:17 +08:00 |
|
|
YC Tseng
|
48381c3b6d
|
[AMD] suppress warning for amd (#16620)
|
2026-01-07 01:37:40 -08:00 |
|
|
Minglei Zhu
|
4c85f9d039
|
Only allocate encoder metadata for encoder-decoder models (#16527)
|
2026-01-06 22:17:04 -08:00 |
|
|
Baizhou Zhang
|
7d757d6f17
|
Clean Some Environment Variables for DeepSeek V32 (#15938)
|
2026-01-07 14:00:16 +08:00 |
|
|
Yingchun Lai
|
913b688f21
|
fix: fill a meaningful tool_index (#16504)
|
2026-01-06 20:00:09 -08:00 |
|
|
Yuan Luoandluoyuan.luo
|
53846746bf
|
[VLM] Fix CUDA IPC OOM (#16118)
Co-authored-by: luoyuan.luo <luoyuan.luo@antgroup.com>
|
2026-01-07 11:30:35 +08:00 |
|
|
MOHENOOandyangjia1
|
534ac384db
|
[HiCacheStorage & PD] fix prefill bootstrap request host memory leaks (#15439)
Co-authored-by: yangjia1 <yangjia1@kingsoft.com>
|
2026-01-07 11:03:57 +08:00 |
|
|
fzyzcjy
|
9a21d89c5b
|
Tiny add metrics for prefill delayer (#16603)
|
2026-01-07 09:53:52 +08:00 |
|
|
Alison ShaoandKangyan-Zhou
|
0cbd8f3247
|
ci(test): migrate OpenAI server tests to registered CI system (#16326)
Co-authored-by: Kangyan-Zhou <zky314343421@gmail.com>
|
2026-01-06 11:09:37 -08:00 |
|
|
Ke Bao
|
02722b9113
|
Fix evict swa for overlap scheduler and page size > 1 (#16507)
|
2026-01-06 22:29:40 +08:00 |
|
|
fzyzcjy
|
f959250f76
|
Tiny support sglang_routing_keys_active in engine (#16570)
|
2026-01-06 22:10:10 +08:00 |
|
|
lw9527andXinyuan Tong
|
2724b1100b
|
fix double Unicode escape issue in streaming tool_calls parameters (#13518)
Co-authored-by: Xinyuan Tong <115166877+JustinTong0323@users.noreply.github.com>
|
2026-01-05 23:47:26 -08:00 |
|
|
|
fba785c459
|
use aync load for encoder_server (#15456)
Signed-off-by: liuanqi <liuanqi6@xiaomi.com>
Co-authored-by: Yuhao Yang <47235274+yhyang201@users.noreply.github.com>
Co-authored-by: liuanqi <liuanqi6@xiaomi.com>
|
2026-01-06 14:31:52 +08:00 |
|
|
Ke Bao
|
3aa11ca722
|
Remove hybrid_kvcache_ratio in server args (#16399)
|
2026-01-06 13:13:13 +08:00 |
|
|
|
2d02c150dc
|
[3/N][Sparse With Hicache]: Init sparse coordinator (#16086)
Co-authored-by: 晟海 <huangtingwei.htw@antgroup.com>
Co-authored-by: Zhiqiang Xie <xiezhq@stanford.edu>
|
2026-01-05 17:51:04 -08:00 |
|
|
ShirakSyouya
|
ce694b2b9e
|
Fix the problem where Qwen3VL raises an "object has no attribute 'mod… (#15677)
|
2026-01-06 08:45:13 +08:00 |
|
|
|
6c0fb189f8
|
[Auto Sync] Update tokenizer_manager.py (20260105) (#16477)
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: Wangfan Fu <wangfan@x.ai>
|
2026-01-05 14:06:03 -08:00 |
|
|
Binyao Jiang
|
9a9f996f8d
|
[FP8] Fix weight_scale shape to match with x_scale shape for per-tensor quant under torch.compile (#16356)
|
2026-01-05 13:55:26 -08:00 |
|
|
Yi Zhang
|
a3914e3b3f
|
[Bugfix] fix some memory computation bugs for qwen3next with mtp (#16138)
|
2026-01-05 23:24:21 +08:00 |
|
|
Raayan DharandShangming Cai
|
4397cda7dc
|
feat: raise error in PD when page sizes are mismatched (#14474)
Signed-off-by: Raayan Dhar raayan.dhar@gmail.com <raayan.dhar@gmail.com>
Signed-off-by: raayandhar <raayan.dhar@gmail.com>
Co-authored-by: Shangming Cai <csmthu@gmail.com>
|
2026-01-05 19:54:01 +08:00 |
|
|
|
c35eb0fdee
|
[Auto Sync] Update loader.py (20260105) (#16478)
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: xiuyuli-xai <xiuyu@x.ai>
|
2026-01-05 01:34:30 -08:00 |
|
|
fzyzcjy
|
7f35c46efb
|
Tiny add sglang:http_requests_active metric (#16479)
|
2026-01-05 17:20:31 +08:00 |
|
|
DarkSharpness
|
da2f8cc33f
|
[minor] reduce 1 unnecessary add (#16474)
|
2026-01-05 01:00:56 -08:00 |
|
|
fzyzcjy
|
4d737db857
|
Tiny fix prefill delayer not support non-fcfs schedule policy (#16471)
|
2026-01-05 16:28:54 +08:00 |
|
|
fzyzcjy
|
9d6029fb92
|
Fix TokenizerManager bottleneck for offline generation (#16456)
|
2026-01-05 16:28:25 +08:00 |
|
|
Netanel Haber
|
bebd625ba1
|
EVS Framework: Support NemotronH_Nano_VL_V2 (#14051)
|
2026-01-05 16:18:07 +08:00 |
|
|
|
012dc5866d
|
[Auto Sync] Update scheduler.py (20260104) (#16424)
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: Hanming Lu <69857889+hanming-lu@users.noreply.github.com>
Co-authored-by: Hanming Lu <hanming@x.ai>
Co-authored-by: Jie Ren <no-replay@github.com>
|
2026-01-04 23:32:56 -08:00 |
|
|
Yuhao Yang
|
10174e1114
|
Revert "[grpc] update api to scheduler in grpc request manager" (#16387)
|
2026-01-04 22:05:39 -08:00 |
|