Jasonzhang517 d939e26585 [model gateway][0/N] router EPD support: add encoder grpc server backend support (#16552) ...

Co-authored-by: Zongyao Chen <ZongYao.Chen@linux.alibaba.com>
Co-authored-by: Zongyao Chen <solar1s@163.com>

2026-03-03 19:38:15 +08:00

..

batch_invariant_ops

[Auto Sync] Update batch_invariant_ops.py (20260221) (#19098)

2026-02-20 18:27:31 -08:00

batch_overlap

Remove sync points in mamba cache + prefill cudagraph plumbing for DP (#19639)

2026-03-02 15:03:42 +08:00

checkpoint_engine

update pre-commit config (#18860)

2026-02-16 00:18:31 +08:00

compilation

Piecewise Cuda Graph set default (#16331)

2026-03-02 23:18:07 +08:00

configs

Fix/nemotron mtp quantaized (#19433)

2026-03-03 01:07:46 -08:00

connector

Remove sync points in mamba cache + prefill cudagraph plumbing for DP (#19639)

2026-03-02 15:03:42 +08:00

constrained

…

debug_utils

Enhance error resilience in dump comparator (#19685)

2026-03-02 19:08:35 +08:00

disaggregation

[model gateway][0/N] router EPD support: add encoder grpc server backend support (#16552)

2026-03-03 19:38:15 +08:00

distributed

[Fix] NPU deepep hccl buffer and fix IPC safe check (#17804)

2026-03-03 14:56:06 +08:00

dllm

Refactor: observability code cleanup (#17862)

2026-02-24 18:07:29 -08:00

elastic_ep

[4/N] (Elastic EP) Back up Expert Weights in DRAM (#17374)

2026-02-27 15:59:13 +08:00

entrypoints

[model gateway][0/N] router EPD support: add encoder grpc server backend support (#16552)

2026-03-03 19:38:15 +08:00

eplb

Refactor: observability code cleanup (#17862)

2026-02-24 18:07:29 -08:00

function_call

[Tool Call] Stream DeepSeek-V3.2 function call parameters in JSON format. (#16091)

2026-03-03 01:46:29 -08:00

grpc

Refactor: observability code cleanup (#17862)

2026-02-24 18:07:29 -08:00

hardware_backend/npu

[NPU]grok2 model support (#17119)

2026-03-03 10:24:10 +08:00

layers

Fix/nemotron mtp quantaized (#19433)

2026-03-03 01:07:46 -08:00

lora

[Fix] Add lora tied lm head support (for Qwen2.5, Gemma, etc model need) (#18634)

2026-02-19 00:34:51 +08:00

managers

[model gateway][0/N] router EPD support: add encoder grpc server backend support (#16552)

2026-03-03 19:38:15 +08:00

mem_cache

[HiCache] fix compatibility bugs with eagle and HiCacheStorage (#19570)

2026-03-02 18:29:51 -08:00

model_executor

Piecewise Cuda Graph set default (#16331)

2026-03-02 23:18:07 +08:00

model_loader

[Quantization] Support config.json quantization_config format, fix exclude_modules matching, and fix KV cache scale loading for Nemotron (#18546)

2026-02-21 16:14:29 +08:00

models

[NPU] bugs fix: fix a condition bug when using speculative inference on Qwen3 and Qwen3 moe (#19532)

2026-03-03 17:59:25 +08:00

multimodal

[vlm][internVL] Support processor and embedding inputs for InternVL (#19127)

2026-02-26 22:46:48 -08:00

multiplex

…

observability

feat: TTL-based prefix pinning with refresh-on-hit for HiRadixCache (#18941)

2026-03-01 23:27:22 -08:00

parser

Add KimiK2Detector with tool interruption support (#19696)

2026-03-03 14:04:49 +08:00

sampling

…

speculative

[Spec V2] Support specV2 for mamba hybrid attention (#18808)

2026-02-27 00:36:01 +08:00

tokenizer

…

utils

[Fix] NPU deepep hccl buffer and fix IPC safe check (#17804)

2026-03-03 14:56:06 +08:00

weight_sync

…

constants.py

…

environ.py

[model gateway][0/N] router EPD support: add encoder grpc server backend support (#16552)

2026-03-03 19:38:15 +08:00

server_args_config_parser.py

…

server_args.py

[FlashInfer] Bump FlashInfer version from 0.6.3 to 0.6.4 (#19005)

2026-03-02 16:12:09 -08:00