Zheng Wengang 2d120f8b18 [Feature][Multimodal] Implement LRU cache for multimodal embeddings (#8292) ...

Signed-off-by: Xinyuan Tong <xinyuantong.cs@gmail.com>
Co-authored-by: Xinyuan Tong <115166877+JustinTong0323@users.noreply.github.com>
Co-authored-by: Xinyuan Tong <xinyuantong.cs@gmail.com>

2025-08-06 23:21:40 -07:00

..

lora

Support GPU pinning for LoRA (#8697)

2025-08-06 19:39:45 -07:00

compare.py

…

test_clip_models.py

…

test_compressed_tensors_models.py

…

test_cross_encoder_models.py

Feat/support rerank (#6058)

2025-06-16 10:50:01 -07:00

test_dummy_grok_models.py

Add V2-lite model test (#7390)

2025-07-03 22:25:50 -07:00

test_embedding_models.py

support qwen3 emebedding (#6990)

2025-06-09 01:32:49 -07:00

test_encoder_embedding_models.py

Enable FlashInfer support encoder models and add head_dim padding workaround (#6230)

2025-07-19 19:30:16 -07:00

test_generation_models.py

Support bailing moe (#8680)

2025-08-05 20:40:34 -07:00

test_gme_qwen_models.py

…

test_grok_models.py

…

test_llama4_models.py

…

test_mtp_models.py

…

test_qwen_models.py

…

test_reward_models.py

…

test_transformers_models.py

Clean up server args (#8161)

2025-07-19 11:32:52 -07:00

test_unsloth_models.py

…

test_vlm_models.py

[Feature][Multimodal] Implement LRU cache for multimodal embeddings (#8292)

2025-08-06 23:21:40 -07:00