fzyzcjy 3b2680a44d Overlap shared expert and routed expert computations (#5121)

2025-05-08 01:02:32 -07:00

..

configs

[Feature] Support for Ascend NPU backend (#3853)

2025-05-06 20:32:53 -07:00

connector

…

constrained

…

disaggregation

Better PD initialization (#5751)

2025-05-07 01:12:57 +08:00

distributed

Clean logs for DeepSeek-V3 launching (#6079)

2025-05-07 18:54:50 -07:00

entrypoints

feat(engine): add bootstrap parameters to generate methods (dynamo) (#6075)

2025-05-07 10:33:58 -07:00

layers

optimize pad operations in fa3 to accelarate 100+us (#6077)

2025-05-07 23:40:08 -07:00

lora

…

managers

Better PD initialization (#5751)

2025-05-07 01:12:57 +08:00

mem_cache

Fix prefill OOM error in the case of large page size (#5081)

2025-05-05 16:02:55 -07:00

metrics

…

model_executor

Clean logs for DeepSeek-V3 launching (#6079)

2025-05-07 18:54:50 -07:00

model_loader

…

models

Overlap shared expert and routed expert computations (#5121)

2025-05-08 01:02:32 -07:00

openai_api

feat: append more comprehensive fields in messages instead of merely role and content (#5996)

2025-05-05 11:43:34 -07:00

platforms

…

sampling

…

speculative

…

_custom_ops.py

…

aio_rwlock.py

…

code_completion_parser.py

…

conversation.py

…

custom_op.py

…

function_call_parser.py

…

hf_transformers_utils.py

…

mm_utils.py

…

model_parallel.py

…

patch_torch.py

…

reasoning_parser.py

…

server_args.py

Hint users DeepEP normal mode is incompatible with CUDA Graph (#5014)

2025-05-07 22:40:59 +08:00

torch_memory_saver_adapter.py

…

utils.py

Clean logs for DeepSeek-V3 launching (#6079)

2025-05-07 18:54:50 -07:00

warmup.py

…