Aurick Qiao c6cb0c9649 [Session] Add streaming mode with SessionAwareCache fast path (#19171) ...

Co-authored-by: hnyls2002 <lsyincs@gmail.com>

2026-02-27 16:31:08 -08:00

..

ascend

[NPU] [CI] temporarily disable mtp test (#17614)

2026-01-23 15:17:31 +08:00

cpu

Test reorganization: Move tests to manual/ (#13610)

2025-11-20 13:41:58 -08:00

debug_utils

Test reorganization: Move tests to manual/ (#13610)

2025-11-20 13:41:58 -08:00

entrypoints/http_server

Test reorganization: Move tests to manual/ (#13610)

2025-11-20 13:41:58 -08:00

ep

[4/N] (Elastic EP) Back up Expert Weights in DRAM (#17374)

2026-02-27 15:59:13 +08:00

hicache

[Benchmark] Remove re-exports from bench_serving.py (#19130)

2026-02-21 14:30:30 -08:00

kv_transfer

Add mooncake transfer_engine_bench into maunal test (#14429)

2025-12-04 22:35:00 +08:00

lang_frontend

…

layers

Revert "optimize get_topk_ragged by fusing get k and k_scale triton kernel" (#18471)

2026-02-09 16:37:19 +08:00

lora

enhance LoRA tests and fix base model LoRA eviction in Scheduler (#16333)

2026-01-10 16:49:00 +08:00

models

Move deleted 8-GPU tests to test/manual/ (#18060)

2026-02-01 00:21:56 -08:00

nightly

[VLM] Introduce FlashInfer CUDNN Prefill as ViT Backend (#19003)

2026-02-24 19:49:22 +08:00

openai_server/features

Test reorganization: Move tests to manual/ (#13610)

2025-11-20 13:41:58 -08:00

piecewise_cudagraph

[CI] feat: add early exit to wait_for_server when process dies (#18602)

2026-02-13 16:46:09 -08:00

quant

Test reorganization: Move tests to manual/ (#13610)

2025-11-20 13:41:58 -08:00

vlm

[FEAT] Add Anthropic compatible API endpoint (#18630)

2026-02-21 19:37:38 +08:00

test_async_dynamic_batch_tokenizer.py

Test reorganization: Move tests to manual/ (#13610)

2025-11-20 13:41:58 -08:00

test_async_mm_data_processor.py

Test reorganization: Move tests to manual/ (#13610)

2025-11-20 13:41:58 -08:00

test_config_integration.py

Fix parse args from file(#13911) (#14085)

2026-01-01 11:37:33 +08:00

test_custom_allreduce.py

Test reorganization: Move tests to manual/ (#13610)

2025-11-20 13:41:58 -08:00

test_deepseek_chat_templates.py

Test reorganization: Move tests to manual/ (#13610)

2025-11-20 13:41:58 -08:00

test_double_sparsity.py

Test reorganization: Move tests to manual/ (#13610)

2025-11-20 13:41:58 -08:00

test_expert_distribution.py

Test reorganization: Move tests to manual/ (#13610)

2025-11-20 13:41:58 -08:00

test_expert_location_updater.py

enable ut test for xpu devices (#11712)

2026-02-03 11:15:14 -08:00

test_fim_completion.py

Test reorganization: Move tests to manual/ (#13610)

2025-11-20 13:41:58 -08:00

test_forward_split_prefill.py

enable ut test for xpu devices (#11712)

2026-02-03 11:15:14 -08:00

test_get_weights_by_name.py

enable ut test for xpu devices (#11712)

2026-02-03 11:15:14 -08:00

test_health_check.py

Test reorganization: Move tests to manual/ (#13610)

2025-11-20 13:41:58 -08:00

test_kv_events.py

KV Cache Events with Attention DP bug fix (#16030) (#16412)

2026-01-19 14:13:48 +08:00

test_logprobs.py

[Auto Sync] Update logits_processor.py, test_logprobs.py (20260124) (#17664)

2026-01-23 17:57:41 -08:00

test_mla_tp.py

Test reorganization: Move tests to manual/ (#13610)

2025-11-20 13:41:58 -08:00

test_modelopt_fp8kvcache.py

Test reorganization: Move tests to manual/ (#13610)

2025-11-20 13:41:58 -08:00

test_modelopt.py

Test reorganization: Move tests to manual/ (#13610)

2025-11-20 13:41:58 -08:00

test_models_from_modelscope.py

Test reorganization: Move tests to manual/ (#13610)

2025-11-20 13:41:58 -08:00

test_mori_transfer_engine_e2e.py

[CI] feat: add early exit to wait_for_server when process dies (#18602)

2026-02-13 16:46:09 -08:00

test_mscclpp.py

Test reorganization: Move tests to manual/ (#13610)

2025-11-20 13:41:58 -08:00

test_quick_allreduce.py

Move custom_ops under layers; move _custom_ops.py → custom_all_reduce_ops.py (#14326)

2025-12-03 10:33:37 -08:00

test_sagemaker_server.py

Test reorganization: Move tests to manual/ (#13610)

2025-11-20 13:41:58 -08:00

test_schedule_policy.py

Add routing key based schedule policy (#16840)

2026-01-10 10:16:23 +08:00

test_srt_engine_with_quant_args.py

Test reorganization: Move tests to manual/ (#13610)

2025-11-20 13:41:58 -08:00

test_tokenizer_batch_encode.py

Test reorganization: Move tests to manual/ (#13610)

2025-11-20 13:41:58 -08:00

test_tokenizer_manager.py

[CI] fix UT assert error in test_tokenizer_manager.py (#15646)

2025-12-23 22:24:33 +08:00

test_torch_flex_attention_backend.py

Test reorganization: Move tests to manual/ (#13610)

2025-11-20 13:41:58 -08:00

test_torch_tp.py

Test reorganization: Move tests to manual/ (#13610)

2025-11-20 13:41:58 -08:00

test_tracing.py

Refactor: observability code cleanup (#17862)

2026-02-24 18:07:29 -08:00

test_triton_attention_rocm_mla.py

Test reorganization: Move tests to manual/ (#13610)

2025-11-20 13:41:58 -08:00

test_triton_moe_wna16.py

enable ut test for xpu devices (#11712)

2026-02-03 11:15:14 -08:00

test_trtllm_fp8_kv_kernel.py

[refactor] Move trtllm_fp8_kv_kernel to triton_ops directory (#15044)

2025-12-14 15:22:37 -08:00

test_two_batch_overlap.py

Test reorganization: Move tests to manual/ (#13610)

2025-11-20 13:41:58 -08:00

test_vertex_endpoint.py

Test reorganization: Move tests to manual/ (#13610)

2025-11-20 13:41:58 -08:00

test_vlm_accuracy.py

update pre-commit config (#18860)

2026-02-16 00:18:31 +08:00

test_wave_attention_backend.py

Test reorganization: Move tests to manual/ (#13610)

2025-11-20 13:41:58 -08:00

test_weight_validation.py

Refactor: separate CI-specific weight validation into dedicated module (#15216)

2025-12-27 20:50:39 -08:00

test_weight_version.py

Revert "tiny remove deprecated endpoint call" (#14533)

2025-12-05 23:48:54 -08:00