caiyueliangandYineng Zhang 2f1d92834f [FEAT] Support batches cancel (#1222) ...

Co-authored-by: Yineng Zhang <me@zhyncs.com>

2024-08-26 23:28:26 +00:00

..

models

[CI] Fix CI (#1217)

2024-08-26 02:56:42 +00:00

sampling/penaltylib

[CI] Fix CI (#1217)

2024-08-26 02:56:42 +00:00

run_suite.py

[FEAT] JSON constrained support (#1125)

2024-08-26 09:37:26 -07:00

test_chunked_prefill.py

improve the threshold and ports in tests (#1215)

2024-08-25 19:02:08 -07:00

test_embedding_openai_server.py

improve the threshold and ports in tests (#1215)

2024-08-25 19:02:08 -07:00

test_eval_accuracy_large_chunked_prefill.py

improve the threshold and ports in tests (#1215)

2024-08-25 19:02:08 -07:00

test_eval_accuracy_large_mixed_chunked_prefill.py

improve the threshold and ports in tests (#1215)

2024-08-25 19:02:08 -07:00

test_eval_accuracy_large.py

improve the threshold and ports in tests (#1215)

2024-08-25 19:02:08 -07:00

test_eval_accuracy_mini.py

improve the threshold and ports in tests (#1215)

2024-08-25 19:02:08 -07:00

test_json_constrained.py

[FEAT] JSON constrained support (#1125)

2024-08-26 09:37:26 -07:00

test_large_max_new_tokens.py

improve the threshold and ports in tests (#1215)

2024-08-25 19:02:08 -07:00

test_models_from_modelscope.py

Clean up unit tests (#1020)

2024-08-10 15:09:03 -07:00

test_moe_serving_throughput.py

improve the threshold and ports in tests (#1215)

2024-08-25 19:02:08 -07:00

test_openai_server.py

[FEAT] Support batches cancel (#1222)

2024-08-26 23:28:26 +00:00

test_serving_throughput.py

improve the threshold and ports in tests (#1215)

2024-08-25 19:02:08 -07:00

test_skip_tokenizer_init.py

improve the threshold and ports in tests (#1215)

2024-08-25 19:02:08 -07:00

test_srt_endpoint.py

improve the threshold and ports in tests (#1215)

2024-08-25 19:02:08 -07:00

test_torch_compile.py

Torch compile CI throughput test (#1223)

2024-08-26 13:52:58 -07:00

test_triton_attn_backend.py

improve the threshold and ports in tests (#1215)

2024-08-25 19:02:08 -07:00

test_update_weights.py

improve the threshold and ports in tests (#1215)

2024-08-25 19:02:08 -07:00

test_vision_openai_server.py

[Fix] Multi-images loading error (#1218)

2024-08-26 03:58:51 +00:00