Hudson Xing 38daa29466 Add fused FP8 KV cache write kernel for TRTLLM MHA backend (#14093) ...

Co-authored-by: Qiaolin Yu <liin1211@outlook.com>

2025-12-06 00:53:55 +08:00

..

ascend

[spec-overlap] bugfix for pd disaggregation and npu (#14088)

2025-12-01 22:58:20 +08:00

cpu

…

debug_utils

…

entrypoints/http_server

…

ep

[chore] update torch version to 2.9 (#12969)

2025-11-25 14:47:34 -08:00

hicache

…

kv_transfer

Add mooncake transfer_engine_bench into maunal test (#14429)

2025-12-04 22:35:00 +08:00

lang_frontend

…

layers

[Performance] Optimize NSA Indexer K/S Buffer Access with Fused Triton Kernels (#13812)

2025-12-02 18:53:06 -08:00

lora

Fix utils import issue for nightly tests (#13944)

2025-11-27 15:24:27 -08:00

models

Move test_dummy_grok_models.py from manual to srt (temporary) (#13901)

2025-11-24 23:36:53 -08:00

nightly

[DeepSeekV3.2] Enable pure TP & Partial DP Attention (#13646)

2025-11-30 15:59:23 -08:00

openai_server/features

…

piecewise_cudagraph

Move piecewise cuda graph test to manual dir to fix CI (#14121)

2025-11-29 00:52:01 -08:00

quant

…

test_async_dynamic_batch_tokenizer.py

…

test_async_mm_data_processor.py

…

test_config_integration.py

…

test_custom_allreduce.py

…

test_deepseek_chat_templates.py

…

test_deepseek_v32_cp_single_node.py

…

test_double_sparsity.py

…

test_eagle_infer_beta_dp_attention.py

…

test_expert_distribution.py

…

test_expert_location_updater.py

…

test_fim_completion.py

…

test_forward_split_prefill.py

…

test_get_weights_by_name.py

…

test_health_check.py

…

test_kv_events.py

fix: malformed KV events for NVIDIA Dynamo (#13488)

2025-11-28 14:55:20 -08:00

test_logprobs.py

…

test_mla_tp.py

…

test_modelopt_fp8kvcache.py

…

test_modelopt.py

…

test_models_from_modelscope.py

…

test_mscclpp.py

…

test_quick_allreduce.py

Move custom_ops under layers; move _custom_ops.py → custom_all_reduce_ops.py (#14326)

2025-12-03 10:33:37 -08:00

test_sagemaker_server.py

…

test_schedule_policy.py

Refactor cache init logic (#13800)

2025-11-24 11:41:46 +08:00

test_session_control.py

…

test_srt_engine_with_quant_args.py

…

test_tokenizer_batch_encode.py

…

test_tokenizer_manager.py

…

test_torch_flex_attention_backend.py

…

test_torch_tp.py

…

test_tracing.py

…

test_triton_attention_rocm_mla.py

…

test_triton_moe_wna16.py

…

test_trtllm_fp8_kv_kernel.py

Add fused FP8 KV cache write kernel for TRTLLM MHA backend (#14093)

2025-12-06 00:53:55 +08:00

test_two_batch_overlap.py

…

test_vertex_endpoint.py

…

test_vlm_accuracy.py

…

test_wave_attention_backend.py

…

test_weight_version.py

…