Charles Chen af0d35b224 Fix: Reject requests with a duplicate request ID which can cause server crash/hang (#19035) ...

Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: hnyls2002 <lsyincs@gmail.com>

2026-03-03 00:33:25 -08:00

..

4-gpu-models

[Spec V2] Support specV2 for mamba hybrid attention (#18808)

2026-02-27 00:36:01 +08:00

8-gpu-models

Fix CompressedTensorsMxInt4MoE abstract method and relax GPQA baseline (#19726)

2026-03-02 19:03:21 -08:00

amd

[AMD] [Qwen 3.5 Day 0] Add Qwen 3.5 nightly accuracy tests (#19479)

2026-03-02 19:42:42 -08:00

ascend

[NPU]grok2 model support (#17119)

2026-03-03 10:24:10 +08:00

attention

feat: Add FP8 KV cache support for Triton attention backend (#18882)

2026-03-02 23:38:34 -08:00

backends

[CI] Reorganize stage-b 1-GPU tests for 5090 compatibility (#16826)

2026-01-15 15:23:35 -08:00

bench_fn

[Benchmark] Fix generated_shared_prefix attribute naming and remove args dependency (#19363)

2026-02-25 18:45:54 -08:00

constrained_decoding

[CI] Reorganize stage-b 1-GPU tests for 5090 compatibility (#16826)

2026-01-15 15:23:35 -08:00

core

Use ephemeral nccl port via get_free_port() (#18009)

2026-02-16 00:32:47 +08:00

debug_utils

Enhance error resilience in dump comparator (#19685)

2026-03-02 19:08:35 +08:00

disaggregation

[HiCache] Re-land spec v2 + decode KV cache offloading compatibility (#19615)

2026-03-01 13:58:31 -08:00

distributed

Cleanup disagg decode prebuilt flow and add cross-stream sync in merge_batch (#19568)

2026-03-01 21:52:27 -08:00

dllm

Revert "Add SDAR model support" (#19032)

2026-02-19 16:03:56 -08:00

ep

chore: bump mooncake version to 0.3.9 (#18316)

2026-02-07 17:30:01 +08:00

eval

Fix nightly VLM accuracy: gemma3n TP fixes + removal, latency thresholds (#19401)

2026-02-27 14:24:02 -08:00

function_call

Gigachat 3 tool parser and tests (#14765)

2026-02-02 22:28:34 -08:00

hicache

[Benchmark] Remove re-exports from bench_serving.py (#19130)

2026-02-21 14:30:30 -08:00

kernels

[DSv32] [GLM5] Improve Model Quality by Avoiding FP32 Precision Loss in weights_proj (#19041)

2026-02-22 16:20:51 +08:00

layers

Fix mamba2 mixer ci test (#19658)

2026-03-02 14:55:15 +08:00

lora

[TestFix] change LoRA tests to use NVIDIA adapter instead of Nutanix (#19642)

2026-03-02 12:55:41 -08:00

metrics

Refactor: observability code cleanup (#17862)

2026-02-24 18:07:29 -08:00

mla

Piecewise Cuda Graph set default (#16331)

2026-03-02 23:18:07 +08:00

model_loading

enable ut test for xpu devices (#11712)

2026-02-03 11:15:14 -08:00

models

Piecewise Cuda Graph set default (#16331)

2026-03-02 23:18:07 +08:00

moe

Merge stage-c-test-large-4-gpu suites into partitioned suites (#18325)

2026-02-06 15:32:33 -08:00

openai_server

[Anthropic API] Preserve image content in tool_result conversion (#19233)

2026-02-28 12:07:22 -08:00

ops

[AMD] Support --enable-aiter-allreduce-fusion on AMD GPUs (#13747)

2026-02-24 23:11:55 -08:00

parser

Add KimiK2Detector with tool interruption support (#19696)

2026-03-03 14:04:49 +08:00

perf

[TestFix] change LoRA tests to use NVIDIA adapter instead of Nutanix (#19642)

2026-03-02 12:55:41 -08:00

piecewise_cuda_graph

Piecewise Cuda Graph set default (#16331)

2026-03-02 23:18:07 +08:00

profiling

Migrate 4-GPU/8-GPU workflow jobs to stage-c and add CI registry decorators (#17299)

2026-01-31 22:37:22 -08:00

quant

feat: Add FP8 KV cache support for Triton attention backend (#18882)

2026-03-02 23:38:34 -08:00

radix_cache

Piecewise Cuda Graph set default (#16331)

2026-03-02 23:18:07 +08:00

rl

[CI] Move test_load_lora_from_tensor test to H100 (#18797)

2026-02-13 21:28:00 +08:00

rotary

feat: Support mrope_section with rope_type: "yarn" (#13313)

2026-02-14 22:51:44 +08:00

sampling

Fix flaky penalty tests by using higher temperature for effect comparison (#18380)

2026-02-12 21:08:37 +08:00

scheduler

Fix: Reject requests with a duplicate request ID which can cause server crash/hang (#19035)

2026-03-03 00:33:25 -08:00

sessions

[Session] Gate streaming sessions with --enable-streaming-session and spec v2 guard (#19531)

2026-02-27 18:14:55 -08:00

spec

Add timeout abort kits for normal / eagle. (#18815)

2026-02-13 17:57:30 -08:00

stress

…

tokenizer

[CI] Reorganize stage-b 1-GPU tests for 5090 compatibility (#16826)

2026-01-15 15:23:35 -08:00

utils

chore: fix some typos (#18577)

2026-02-10 20:47:41 -08:00

vlm

[vlm][internVL] Support processor and embedding inputs for InternVL (#19127)

2026-02-26 22:46:48 -08:00

test_hybrid_dp_ep_tp_mtp.py

Add hybrid parallelism test to nightly CI (#17444)

2026-01-20 17:43:50 -08:00

test_srt_backend.py

[AMD CI] Migrate and Add More Testcases (#17116)

2026-01-19 08:07:39 -08:00