Lianmin ZhengandKan Wu 22352d47a9 Improve streaming, log_level, memory report, weight loading, and benchmark script (#7632) ...

Co-authored-by: Kan Wu <wukanustc@gmail.com>

2025-06-29 23:16:19 -07:00

..

disaggregation

Auto handle PD disaggregation in bench_serving (#6587)

2025-05-25 22:41:27 -07:00

lora

minor: Add basic editorconfig and pre-commit hooks to enforce style for whitespaces (#1926)

2024-11-06 13:46:04 +00:00

router

[router] add base_gpu_id server args & merged radix tree python reference (#2115)

2024-11-21 17:13:33 -08:00

bench_speculative.py

fix: update bench_speculative (#5649)

2025-04-22 16:08:15 -07:00

frontend_reasoning.ipynb

Do not run frontend_reasoning.ipynb to reduce the CI load (#7073)

2025-06-10 17:15:31 -07:00

launch_tgi.sh

Add OpenAI backend to the CI test (#869)

2024-08-01 09:25:24 -07:00

load_tokenizer.py

Add OpenAI backend to the CI test (#869)

2024-08-01 09:25:24 -07:00

long_context_example.py

feat: add long context example (#6391)

2025-05-18 01:45:17 -07:00

reference_hf.py

[docs] fix HF reference script command (#4148)

2025-03-06 13:21:54 -08:00

replay_request_dump.py

Improve streaming, log_level, memory report, weight loading, and benchmark script (#7632)

2025-06-29 23:16:19 -07:00