kousakawang 7efd8b3d1f [FEAT] Shared mem pool based cuda ipc for multi-modal data transport (#11917) ...

Co-authored-by: kousakawang <wanghanpei@bytedance.com>
Co-authored-by: Yuan Luo <4908075+yuan-luo@users.noreply.github.com>

2025-11-02 16:46:37 +08:00

..

compare.py

[Feature] Initial support for multi-LoRA serving (#1307)

2024-09-12 16:46:14 -07:00

test_clip_models.py

support clip embedding model (#4506)

2025-03-27 00:18:15 -07:00

test_compressed_tensors_models.py

[model] support MiniCPM-V 4.0 (#8747)

2025-09-02 15:33:03 -07:00

test_cross_encoder_models.py

Feat/support rerank (#6058)

2025-06-16 10:50:01 -07:00

test_dummy_grok_models.py

Add V2-lite model test (#7390)

2025-07-03 22:25:50 -07:00

test_embedding_models.py

Add support for Matryoshka embeddings (#126) (#11142)

2025-10-28 02:49:36 +08:00

test_encoder_embedding_models.py

Enable FlashInfer support encoder models and add head_dim padding workaround (#6230)

2025-07-19 19:30:16 -07:00

test_falcon_h1_models.py

[model] Add mamba2 and Falcon-H1 support. (#10988)

2025-10-02 19:15:36 +08:00

test_generation_models.py

[Model] Add Olmo 3 model support (#11396)

2025-10-19 23:59:16 -07:00

test_glm4_moe_models.py

[CI] Add GLM4MoE model test (#11706)

2025-10-16 16:25:58 +08:00

test_gme_qwen_models.py

Add retry for flaky tests in CI (#4755)

2025-03-25 16:53:12 -07:00

test_grok_models.py

Add retry for flaky tests in CI (#4755)

2025-03-25 16:53:12 -07:00

test_kimi_linear_models.py

Support Kimi Linear (#12469)

2025-10-31 14:03:35 -07:00

test_llama4_models.py

Update CI tests for Llama4 models (#6421)

2025-06-01 11:52:15 +08:00

test_mtp_models.py

Support XiaomiMiMo inference with mtp (#6059)

2025-05-22 14:14:49 -07:00

test_nvidia_nemotron_nano_v2.py

Feature/nano v2 offline modelopt fp8 and nvfp4 (#12018)

2025-10-23 11:16:46 -07:00

test_qwen3_next_models.py

[Feature] Qwen3-Next & FLA: Support MTP topk>1; Up to 6% faster (#11133)

2025-11-01 19:47:56 -07:00

test_qwen_models.py

Add retry for flaky tests in CI (#4755)

2025-03-25 16:53:12 -07:00

test_reward_models.py

Add retry for flaky tests in CI (#4755)

2025-03-25 16:53:12 -07:00

test_transformers_models.py

Clean up server args (#8161)

2025-07-19 11:32:52 -07:00

test_unsloth_models.py

[Model Support] unsloth/Phi-4-mini bnb model (#4982)

2025-04-16 19:58:20 -07:00

test_vlm_models.py

[FEAT] Shared mem pool based cuda ipc for multi-modal data transport (#11917)

2025-11-02 16:46:37 +08:00