 Yineng Zhang
|
fab0f6e77d
|
chore: bump v0.5.0rc2 (#9203)
|
2025-08-14 16:11:16 -07:00 |
|
|
Yineng Zhang
|
27985c27aa
|
feat: update model config (#9202)
|
2025-08-14 15:15:27 -07:00 |
|
|
Yineng Zhang
|
ac474869d4
|
chore: upgrade transformers 4.55.2 (#9197)
|
2025-08-14 13:51:02 -07:00 |
|
|
Adarsh Shirawalmath
|
0b1e04f083
|
[VLM] Improving multimodal tensor hash kernel (#9008)
|
2025-08-14 13:45:55 -07:00 |
|
|
Chengxing Xie
|
c1c7dc4534
|
feat: Add model version tracking with API endpoints and response metadata (#8795)
|
2025-08-14 12:13:46 -07:00 |
|
|
|
2cc9eeab01
|
[4/n]decouple quantization implementation from vLLM dependency (#9191)
Co-authored-by: AniZpZ <aniz1905@gmail.com>
Co-authored-by: Yineng Zhang <me@zhyncs.com>
|
2025-08-14 12:05:46 -07:00 |
|
|
Xiaoyu Zhang
|
63d82a776a
|
refine mxfp4 shuffling log (#9194)
|
2025-08-14 10:57:29 -07:00 |
|
|
Yuan Luoandluoyuan.luo
|
53dcc750b6
|
[sgl-kernel] Support FlashInfer top_k_top_p_sampling_from_logits (#9060)
Co-authored-by: luoyuan.luo <luoyuan.luo@antgroup.com>
|
2025-08-14 10:56:36 -07:00 |
|
|
Yuan Luoandluoyuan.luo
|
432f2053dd
|
[sgl-kernel] 1/N Refactor sglang cutlass 3x - gemm fp8 blockwise sm90 (#8913)
Co-authored-by: luoyuan.luo <luoyuan.luo@antgroup.com>
|
2025-08-14 10:55:54 -07:00 |
|
|
Yineng Zhang
|
1fea998a45
|
chore: bump sgl-kernel v0.3.5 (#9185)
|
2025-08-14 03:20:48 -07:00 |
|
|
|
5aa1ebd242
|
[2/n]decouple quantization implementation from vLLM dependency (#8112)
Co-authored-by: walker-ai <yiyun.wyt@antgroup.com>
Co-authored-by: leoneo <1320612015@qq.com>
|
2025-08-14 03:19:03 -07:00 |
|
|
eigenandYineng Zhang
|
4dbf43601d
|
fix: zero_init buffer (#9065)
Co-authored-by: Yineng Zhang <me@zhyncs.com>
|
2025-08-14 02:39:09 -07:00 |
|
|
lukec
|
3d6be1fbce
|
add w8a8-fp8-block-wise H20-3e triton config (#8018)
|
2025-08-13 23:15:09 -07:00 |
|
|
Jun Liu
|
4063234c1a
|
Add H200 fused MoE kernel configs for DeepSeek-V3 in triton 3.3.1 (#7687)
|
2025-08-13 23:14:09 -07:00 |
|
|
Tommy Yang
|
83feef5b2c
|
Add H20 fused MoE kernel configs for Dpsk & Qwen3 (#7631)
|
2025-08-13 23:13:22 -07:00 |
|
|
Brayden Zhong
|
2871eacc05
|
Add Triton Fused MoE kernel config for E=16 on B200 (#7004)
|
2025-08-13 23:12:27 -07:00 |
|
|
forestlee95
|
ac15bdc194
|
Add H200 fused MoE kernel tuning configs for Qwen3-Coder-480B-A35B-Instruct (#8852)
|
2025-08-13 23:11:11 -07:00 |
|
|
Li Hui
|
d6451c3f65
|
Add A800 fused MoE kernel tuning configs for GLM4.5 and GLM4.5-Air (#8808)
|
2025-08-13 23:03:17 -07:00 |
|
|
henryg
|
841810f227
|
[Perf] Tunings for SM100 FP8 CUTLASS kernel (#8818)
|
2025-08-13 21:59:22 -07:00 |
|
|
pansichengandZhiqiang Xie
|
733446dd36
|
fix io group (#9154)
Co-authored-by: Zhiqiang Xie <xiezhq@stanford.edu>
|
2025-08-14 12:46:42 +08:00 |
|
|
wxzhoucs
|
4c22897a66
|
Feature: support qwen and llama4 reducescatter for dp attention padding (#9101)
|
2025-08-13 21:10:29 -07:00 |
|
|
Alex Yang
|
1bc183c6de
|
Faster weight processing (trtllm-gen moe nvfp4) (#9162)
|
2025-08-13 21:09:34 -07:00 |
|
|
Cheng Wan
|
b87aacb5c5
|
[DP Attention] Refactor: adding some utility functions (#9136)
|
2025-08-13 21:08:06 -07:00 |
|
|
fzyzcjy
|
b3363cc1aa
|
Fix docker container DeepEP error on Blackwell (#9171)
|
2025-08-13 21:06:48 -07:00 |
|
|
Huaixin Chang
|
98457c0453
|
[Bugfix] Avoid unnecessary reduce-scatter call in prepare_mlp (#9169)
|
2025-08-13 21:04:41 -07:00 |
|
|
michael-amdandgemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
|
0fc8bf2cd4
|
[AMD] Update fallback images for AMD CI (#9159)
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
|
2025-08-13 20:15:10 -07:00 |
|
|
Hongbo Xu
|
a669bc2f74
|
Replace sglang.srt.layers.quantization.scalar_types with sgl_kernel.scalar_type (#8951)
|
2025-08-13 19:41:41 -07:00 |
|
|
Nicolas Castet
|
6b7c24712c
|
Fix broken trtllm_mha attn backend with gpt-oss (#9161)
|
2025-08-13 16:40:55 -07:00 |
|
|
Sundara Raman Ramachandran
|
a027a9b4b3
|
[Generative Score API] Optimization to Remove Decode. (#8840)
|
2025-08-14 05:12:24 +08:00 |
|
|
Lianmin Zhengandgemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
|
9e426466af
|
Clean up allocators (#9134)
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
|
2025-08-13 13:56:04 -07:00 |
|
|
DiweiSun
|
2f20f43026
|
Swap xeon ci to gnr server (#9042)
|
2025-08-13 12:39:19 -07:00 |
|
|
Zhihao Liu
|
65736dc524
|
[Model] Support Qwen3ForSequenceClassification for Qwen3-Embed Model (#7957)
|
2025-08-13 11:14:54 -07:00 |
|
|
Yineng Zhang
|
7b56e494be
|
chore: bump v0.5.0rc1 (#9069)
|
2025-08-13 10:44:14 -07:00 |
|
|
Ke Bao
|
0ff6d1fce1
|
Support FA3 backend for gpt-oss (#9028)
|
2025-08-13 10:41:50 -07:00 |
|
|
Teng MaandShangming Cai
|
4a16a71c36
|
[PD] feat: mooncake use batch reg/dereg (#8910)
Co-authored-by: Shangming Cai <csmthu@gmail.com>
|
2025-08-13 09:54:34 -07:00 |
|
|
FrancisandShangming Cai
|
a16923efab
|
[PD] optimize kv cache transfer directly using batch transfer (#9149)
Co-authored-by: Shangming Cai <csmthu@gmail.com>
|
2025-08-13 09:54:14 -07:00 |
|
|
Simo Lin
|
6337d9057c
|
[router] optimize Rust compilation and development workflow (#9133)
|
2025-08-13 05:14:25 -07:00 |
|
|
Yineng Zhang
|
71fb8c9527
|
feat: update fa3 (#9126)
|
2025-08-13 20:07:08 +08:00 |
|
|
Ke Bao
|
94f44b88d1
|
Update fa3 interface and add unit test (#9150)
|
2025-08-13 20:05:02 +08:00 |
|
|
Kevin Xiang LiandXiang Li
|
3b3b3baf9f
|
Double vision prefill throughput by defaulting to optimal vision attention backend (#8484)
Co-authored-by: Xiang (Kevin) Li <lik@nvidia.com>
|
2025-08-13 02:08:30 -07:00 |
|
|
kkandwunhuang
|
35e6bc92e3
|
Update docker file for MI35x base image update to support gpt-oss mxfp4 model (#9111)
Co-authored-by: wunhuang <wunhuang@amd.com>
|
2025-08-13 00:55:31 -07:00 |
|
|
fzyzcjy
|
9394ed6386
|
Fix gpt-oss ~2x memory consumption issue (#9146)
|
2025-08-13 00:11:43 -07:00 |
|
|
Stefan HeandXiaoyu Zhang
|
930fe467bd
|
Support Triton FP8 Gemm can handle hidden_dim not divisible by 16 (#9093)
Co-authored-by: Xiaoyu Zhang <35585791+BBuf@users.noreply.github.com>
|
2025-08-12 21:21:55 -07:00 |
|
|
Trevor Morris
|
13c48dcf88
|
[1/2][resubmit again] sgl-kernel: Fuse routed scaling factor into moe_fused_gate (#9088)
|
2025-08-12 20:12:38 -07:00 |
|
|
Elfie Guo
|
8723b4f146
|
Use FlashInfer's TRTLLM FP8 Blockscale GEMM (#8588)
|
2025-08-12 20:08:40 -07:00 |
|
|
li chaoran
|
62f99e08b3
|
fix: wrong docker hub org name (#9137)
Signed-off-by: mywaaagh_admin <pkwarcraft@gmail.com>
|
2025-08-12 19:26:19 -07:00 |
|
|
DarkSharpness
|
86a0be65d8
|
[Feature] Support custom set kv buffer kernel (#8884)
|
2025-08-12 16:56:51 -07:00 |
|
|
huangtingweiandZhiqiang Xie
|
0edda32001
|
Support page first layout zero copy for mooncake store (#8651)
Co-authored-by: Zhiqiang Xie <xiezhq@stanford.edu>
|
2025-08-12 15:59:26 -07:00 |
|
|
Yineng Zhang
|
924827c3de
|
chore: use cp310 (#9130)
|
2025-08-12 15:33:22 -07:00 |
|
|
Yineng Zhang
|
c81daf838d
|
fix: update Dockerfile (#9129)
|
2025-08-12 15:01:29 -07:00 |
|