b8zhong d36f6f043c [Fix] flashinfer_trtllm intermediate_size assertion with Qwen3 + TP=8 (#16824)

2026-01-17 09:24:05 +08:00

..

__init__.py

…

aio_rwlock.py

…

auth.py

feat: add --admin-api-key for finer-grained endpoint auth (#15908)

2026-01-13 20:21:55 -08:00

bench_utils.py

…

common.py

[Fix] flashinfer_trtllm intermediate_size assertion with Qwen3 + TP=8 (#16824)

2026-01-17 09:24:05 +08:00

cuda_ipc_transport_utils.py

…

custom_op.py

[Refactor] Clean up custom op (#15995)

2026-01-01 21:41:56 +08:00

device_timer.py

Add metrics for having prefill and decode in different ranks (#15752)

2025-12-24 21:35:35 +08:00

gauge_histogram.py

Tiny add gauge histogram abstraction for engine and router (#16848)

2026-01-10 11:45:25 +08:00

hf_transformers_utils.py

Add AFMoE model implementation (#13216)

2026-01-16 20:35:42 +08:00

host_shared_memory.py

…

log_utils.py

Tiny extract file logging utils (#16870)

2026-01-10 20:02:37 +08:00

mistral_utils.py

…

model_file_verifier.py

Add file size hints in bitwise model file verifier (#16735)

2026-01-08 22:28:52 +08:00

multi_stream_utils.py

Reworked fast_pos_embed_interpolate() using torch (#10959)

2025-12-30 14:45:34 +08:00

numa_utils.py

…

nvtx_pytorch_hooks.py

…

offloader.py

…

patch_tokenizer.py

Tiny speed up kimi detokenizer by 10x (#16427)

2026-01-05 09:12:05 +08:00

patch_torch.py

[NPU]Fix for ipc handle with npu (#14138)

2025-12-19 22:39:04 +08:00

poll_based_barrier.py

…

profile_merger.py

…

profile_utils.py

…

request_logger.py

feat: add request queued timeout (#17143)

2026-01-16 17:55:09 +08:00

rpd_utils.py

…

scheduler_status_logger.py

Tiny add scheduler status logging (#16872)

2026-01-10 20:12:24 +08:00

slow_rank_detector.py

…

torch_memory_saver_adapter.py

…

watchdog.py

fix: health check adding test delays (#16381)

2026-01-04 00:28:32 -08:00

weight_checker.py

…