3 Commits

This Branch

This Branch

All Branches

Author	SHA1	Message	Date
3 people	b1bb8e7490	Enables TRT-LLM backend to be used for target_verify (#10281) ... Co-authored-by: Pranav Marathe <pranavm@ipp1-3309.ipp1a1.colossus.nvidia.com> Co-authored-by: fzyzcjy <ch271828n@outlook.com>	2025-09-22 15:54:00 -07:00
pranavm-nvidia	42f34437ab	Adds initialize_moe_config to bench_one_batch so MOE backend is respected (#9670)	2025-08-29 17:29:32 -07:00
pranavm-nvidia	64574ef8c0	Enables speculative decoding for the trtllm_mla attention backend (#9238)	2025-08-21 01:18:21 -07:00