Cheng Wan ac5010e0ba Fix CUDA Graph Check under Deepep with DP FFN (#7451)

2025-06-22 20:35:58 -07:00

..

configs

Feat/support rerank (#6058)

2025-06-16 10:50:01 -07:00

connector

…

constrained

…

disaggregation

[minor] simplify the TokenToKVPoolAllocator (#7414)

2025-06-22 12:37:18 +08:00

distributed

Fix All-Gather under world size one (#7219)

2025-06-20 14:57:34 -07:00

entrypoints

feat(oai refactor): Replace openai_api with entrypoints/openai (#7351)

2025-06-21 13:21:06 -07:00

eplb_simulator

Minor add utility to read expert distribution recorder output (#7134)

2025-06-12 16:50:05 -07:00

function_call

feat(oai refactor): Replace openai_api with entrypoints/openai (#7351)

2025-06-21 13:21:06 -07:00

layers

add fused moe config for qwen3 in triton3.3.1 (#7445)

2025-06-22 18:29:25 -07:00

lora

Refactor LoRAManager and LoRAMemoryPool state management logic for dynamic LoRA loading support (#7412)

2025-06-21 16:09:19 -07:00

managers

FlashInfer NVFP4 MoE with EP & 2-stream shared expert (#7327)

2025-06-22 13:38:47 -07:00

mem_cache

[minor] simplify the TokenToKVPoolAllocator (#7414)

2025-06-22 12:37:18 +08:00

metrics

…

model_executor

Fix CUDA Graph Check under Deepep with DP FFN (#7451)

2025-06-22 20:35:58 -07:00

model_loader

Fix Deepseek R1 0528 FP4 tensor name mismatch issue during weights loading. (#7164)

2025-06-17 11:26:23 -07:00

models

Remove copy after bmm (#7441)

2025-06-22 15:07:44 -07:00

sampling

[Feature] Add Logit Bias (#6579)

2025-06-10 15:39:25 -07:00

speculative

Fix CUDA Graph Check under Deepep with DP FFN (#7451)

2025-06-22 20:35:58 -07:00

_custom_ops.py

support qwen2 running on ascend npu device (#7022)

2025-06-17 11:24:10 -07:00

aio_rwlock.py

…

code_completion_parser.py

feat(oai refactor): Replace openai_api with entrypoints/openai (#7351)

2025-06-21 13:21:06 -07:00

constants.py

Multi-Stage Awake: Support Resume and Pause KV Cache and Weights separately (#7099)

2025-06-19 00:56:37 -07:00

conversation.py

feat(oai refactor): Replace openai_api with entrypoints/openai (#7351)

2025-06-21 13:21:06 -07:00

custom_op.py

Update python API of activation, topk, norm and rope and remove vllm dependency (#6614)

2025-06-17 22:11:50 -07:00

debug_utils.py

Add simple utility to dump tensors for debugging (#6815)

2025-06-02 11:15:31 -07:00

hf_transformers_utils.py

…

jinja_template_utils.py

feat(oai refactor): Replace openai_api with entrypoints/openai (#7351)

2025-06-21 13:21:06 -07:00

mm_utils.py

…

model_parallel.py

…

operations_strategy.py

…

operations.py

…

patch_torch.py

…

reasoning_parser.py

feat(oai refactor): Replace openai_api with entrypoints/openai (#7351)

2025-06-21 13:21:06 -07:00

server_args.py

FlashInfer NVFP4 MoE with EP & 2-stream shared expert (#7327)

2025-06-22 13:38:47 -07:00

torch_memory_saver_adapter.py

Multi-Stage Awake: Support Resume and Pause KV Cache and Weights separately (#7099)

2025-06-19 00:56:37 -07:00

two_batch_overlap.py

Refactor DeepGEMM integration (#7150)

2025-06-13 20:41:03 -07:00

utils.py

Tiny add logging for GC (#7406)

2025-06-22 12:40:02 +08:00

warmup.py

…