Commit Graph
5 Commits
Author SHA1 Message Date
Zack Yu 07b8d763ef feat: Add FP8 KV cache support for Triton attention backend (#18882) 2026-03-02 23:38:34 -08:00
Zack YuBrayden Zhonggemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
536ed3143b test: add test for Modelopt FP8 on SM90 (#18463)
Co-authored-by: Brayden Zhong <b8zhong@uwaterloo.ca>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
2026-02-16 00:29:37 +08:00
Zack YuBrayden Zhonggemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
54589a2f2d docs: expand and update modelopt documentation (#18479)
Co-authored-by: Brayden Zhong <b8zhong@uwaterloo.ca>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
2026-02-09 23:09:52 +00:00
Zack Yu d71ccd8860 fix: sync server_args.kv_cache_dtype when detecting FP8 KV cache (#18394) 2026-02-08 14:10:59 +08:00
Zack Yu 2e87c2bd5e fix: fix MockModelRunner in attention tests (#18240) 2026-02-04 13:18:02 -08:00