husf
|
c52578c7fd
|
【docs】【NPU】Update Expert Parallelism docs for Ascend NPU (#17940)
|
2026-01-30 23:42:11 -05:00 |
|
Yi Zhong
|
08fcda2f63
|
add the fa4 mm backend and varlen func (#13539)
Signed-off-by: vincentzed <207368749+vincentzed@users.noreply.github.com>
Co-authored-by: Brayden Zhong <b8zhong@uwaterloo.ca>
|
2026-01-23 23:12:06 +08:00 |
|
Ruihuan He
|
eb38d64413
|
[Docs] Explain CUDA attention backend choices and aiter FP8 KV cache support (#17428)
|
2026-01-20 11:10:36 -08:00 |
|
Ho-Ren (Jack) Chuang
|
349ce2dd19
|
Support kv8 (FP8) with torch_native attention backend (#12596)
Signed-off-by: Ho-Ren (Jack) Chuang <horenchuang@bytedance.com>
|
2025-12-28 10:48:30 +08:00 |
|
Ho-Ren (Jack) Chuang
|
171b442ad3
|
Add KV4-capable backend flashmla and update server args (#14989)
Signed-off-by: Ho-Ren (Jack) Chuang <horenchuang@bytedance.com>
|
2025-12-12 11:50:27 -08:00 |
|
Ho-Ren (Jack) Chuang
|
10146af099
|
Check KV4 compatibility with attention backends and add KV4 support to the attention_backend doc (#14467)
Signed-off-by: Ho-Ren (Jack) Chuang <horenchuang@bytedance.com>
|
2025-12-11 19:00:53 -08:00 |
|
b8zhong
|
dd91d38e6a
|
[Doc] Add short explanation on page size (#14557)
|
2025-12-06 17:26:30 -08:00 |
|
b8zhong
|
65c8568c4a
|
sync attention, deepseek doc (#14335)
Co-authored-by: Brayden Zhong <b8zhong@users.noreply.github.com>
|
2025-12-02 21:19:40 -08:00 |
|
b8zhong
|
e6420100ee
|
sync attention doc and ep doc to doctree (#14257)
Co-authored-by: Brayden Zhong <b8zhong@users.noreply.github.com>
|
2025-12-01 21:15:22 -08:00 |
|
b8zhong
|
32ec68faf9
|
keep attention backend document up to date (#12741)
|
2025-11-05 20:41:20 -08:00 |
|
b8zhong
|
d31d48b341
|
update usage of trtllm_fp8_per_tensor_scale_moe (#12569)
|
2025-11-03 14:25:32 -08:00 |
|
b8zhong
|
a076ec1a7a
|
Revert "fix llama4 kv cache layout" (#12437)
|
2025-10-30 22:33:37 -07:00 |
|
Meng, Hengyu
|
b113c72e7a
|
Init attention backend for Intel XPU (#10656)
Co-authored-by: guangyey <guangye.yu@intel.com>
Co-authored-by: DiweiSun <105627594+DiweiSun@users.noreply.github.com>
|
2025-10-21 11:41:28 +08:00 |
|
Baizhou Zhang
|
44f0ece9fc
|
[Doc] Update documents for FA4 (#11778)
|
2025-10-19 17:40:38 -07:00 |
|
b8zhong
|
6bc503af73
|
[Doc] Update support matrix for attn and hybrid attn (#11293)
|
2025-10-14 22:43:11 -07:00 |
|
Philip Kiely - Baseten
|
7f028b07c4
|
Fix formatting in long code blocks (#10528)
|
2025-09-16 12:02:05 -07:00 |
|
jacky.cheng
|
25caa7a8a9
|
[AMD] Support Wave attention backend with AMD GPU optimizations (#8660)
Signed-off-by: Stanley Winata <stanley.winata@amd.com>
Signed-off-by: Harsh Menon <harsh@nod-labs.com>
Signed-off-by: nithinsubbiah <nithinsubbiah@gmail.com>
Signed-off-by: Ivan Butygin <ivan.butygin@gmail.com>
Signed-off-by: xintin <gaurav.verma@amd.com>
Co-authored-by: Harsh Menon <harsh@nod-labs.com>
Co-authored-by: Stanley Winata <stanley.winata@amd.com>
Co-authored-by: Stanley Winata <68087699+raikonenfnu@users.noreply.github.com>
Co-authored-by: Stanley Winata <stanley@nod-labs.com>
Co-authored-by: Ivan Butygin <ivan.butygin@gmail.com>
Co-authored-by: nithinsubbiah <nithinsubbiah@gmail.com>
Co-authored-by: Nithin Meganathan <18070964+nithinsubbiah@users.noreply.github.com>
Co-authored-by: Ivan Butygin <ibutygin@amd.com>
|
2025-08-12 13:49:11 -07:00 |
|
Faraz
|
f508cd3cb7
|
TRTLLM-MLA FP8 path (#8638)
Signed-off-by: Faraz Khoubsirat <58580514+farazkh80@users.noreply.github.com>
|
2025-08-11 14:02:13 -07:00 |
|
Lianmin Zheng
|
2449a0afe2
|
Refactor the docs (#9031)
|
2025-08-10 19:49:45 -07:00 |
|