sglang

arcee.py

[Model] Add support for Arcee Foundational Model (#8154 )

2025-07-30 10:45:25 -07:00

baichuan.py

…

bailing_moe.py

Support bailing moe (#8680 )

2025-08-05 20:40:34 -07:00

bert.py

Feat/support rerank (#6058 )

2025-06-16 10:50:01 -07:00

chatglm.py

…

clip.py

refactor: unify names of the feature field of MultimodalDataItem (#8075 )

2025-07-16 17:52:38 -07:00

commandr.py

…

dbrx.py

…

deepseek_janus_pro.py

refactor: unify names of the feature field of MultimodalDataItem (#8075 )

2025-07-16 17:52:38 -07:00

deepseek_nextn.py

Move files related to EPLB (#7580 )

2025-06-29 15:39:38 -07:00

deepseek_v2.py

Use reduce scatter for DP (#8539 )

2025-08-06 16:21:26 -07:00

deepseek_vl2.py

[Refactor] simplify multimodal data processing (#8107 )

2025-07-20 21:43:09 -07:00

deepseek.py

[1/N] MoE Refactor: refactor select_experts (#7966 )

2025-07-19 00:51:15 -07:00

exaone.py

fix: EXAONE when using tie_word_embeddings (#5759 )

2025-05-21 11:30:04 -07:00

gemma2_reward.py

…

gemma2.py

[Feature] Layer-wise Prefill (#7634 )

2025-07-17 01:57:46 +08:00

gemma3_causal.py

[Feature] Layer-wise Prefill (#7634 )

2025-07-17 01:57:46 +08:00

gemma3_mm.py

refactor: unify names of the feature field of MultimodalDataItem (#8075 )

2025-07-16 17:52:38 -07:00

gemma3n_audio.py

chore: remove vlm unnecessary import (#7541 )

2025-06-26 01:38:15 -07:00

gemma3n_causal.py

Updates Gemma3n MLP layer to adapt latest transformers version (#7573 )

2025-06-26 15:07:22 -07:00

gemma3n_mm.py

[Fix] Fix several issues preventing gemma3n LoRA support. (#8776 )

2025-08-04 17:11:46 -07:00

gemma.py

[Feature] Layer-wise Prefill (#7634 )

2025-07-17 01:57:46 +08:00

glm4_moe_nextn.py

GLM-4.5 Model Support (#8224 )

2025-07-27 22:54:07 -07:00

glm4_moe.py

fix glm4 moe (#8883 )

2025-08-06 18:02:31 -07:00

glm4.py

Support THUDM/GLM-4-0414 (GLM-Z1) Glm4ForCausalLM architecture. (#5485 )

2025-06-20 10:07:43 -07:00

gpt2.py

…

gpt_bigcode.py

…

gpt_oss.py

[Perf] Auto enable best flashinfer mxfp4 kernel in b200 (#8898 )

2025-08-07 01:08:41 -07:00

granite.py

…

granitemoe.py

Support EPLB in FusedMoE (#8448 )

2025-07-29 16:02:41 -07:00

grok.py

[5/N] MoE Refactor: Update MoE parallelism arguments (#8658 )

2025-08-01 01:20:03 -07:00

hunyuan.py

Support EPLB in FusedMoE (#8448 )

2025-07-29 16:02:41 -07:00

idefics2.py

Fix incorrect LoRA weight loading for fused gate_up_proj (#6734 )

2025-05-31 13:41:44 -07:00

internlm2_reward.py

…

internlm2.py

…

interns1.py

model: support intern-s1 (#8350 )

2025-07-26 13:48:51 -07:00

internvl.py

model: support intern-s1 (#8350 )

2025-07-26 13:48:51 -07:00

kimi_vl_moonvit.py

…

kimi_vl.py

refactor: unify names of the feature field of MultimodalDataItem (#8075 )

2025-07-16 17:52:38 -07:00

llama4.py

[fix] Fix divide by zero error for llama4. (#8683 )

2025-08-03 00:55:55 -07:00

llama_classification.py

…

llama_eagle3.py

support llama4 eagle3 (#6985 )

2025-06-30 22:34:10 -07:00

llama_eagle.py

…

llama_embedding.py

…

llama_reward.py

…

llama.py

[Feature] Layer-wise Prefill (#7634 )

2025-07-17 01:57:46 +08:00

llava.py

chore: bump transformer to 4.54.0 (#8416 )

2025-07-27 21:27:25 -07:00

llavavid.py

refactor: unify names of the feature field of MultimodalDataItem (#8075 )

2025-07-16 17:52:38 -07:00

mimo_mtp.py

Clean unused import for mimo mtp model (#7370 )

2025-06-19 19:16:14 -07:00

mimo.py

Support XiaomiMiMo inference with mtp (#6059 )

2025-05-22 14:14:49 -07:00

minicpm3.py

…

minicpm.py

fix: remove redundant rotary embedding cache recomputation in MiniCPM (#8022 )

2025-07-15 00:12:45 -07:00

minicpmo.py

chore: bump transformer to 4.54.0 (#8416 )

2025-07-27 21:27:25 -07:00

minicpmv.py

refactor: unify names of the feature field of MultimodalDataItem (#8075 )

2025-07-16 17:52:38 -07:00

mistral.py

refactor: unify names of the feature field of MultimodalDataItem (#8075 )

2025-07-16 17:52:38 -07:00

mixtral_quant.py

[feature]Ascend quantization support (#7791 )

2025-07-10 09:17:37 -07:00

mixtral.py

[5/N] MoE Refactor: Update MoE parallelism arguments (#8658 )

2025-08-01 01:20:03 -07:00

mllama4.py

model: adapt mllama4 to VisionAttention (#8512 )

2025-08-02 00:39:40 -07:00

mllama.py

refactor: unify names of the feature field of MultimodalDataItem (#8075 )

2025-07-16 17:52:38 -07:00

olmo2.py

…

olmo.py

…

olmoe.py

Support EPLB in FusedMoE (#8448 )

2025-07-29 16:02:41 -07:00

persimmon.py

Feat: Support for Persimmon Model (#7983 )

2025-07-19 23:07:47 -07:00

phi3_small.py

…

phi4mm_audio.py

Feat: Support audio in Phi4-mm model (#8048 )

2025-07-18 21:03:53 -07:00

phi4mm_utils.py

Feat: Support audio in Phi4-mm model (#8048 )

2025-07-18 21:03:53 -07:00

phi4mm.py

[Refactor] simplify multimodal data processing (#8107 )

2025-07-20 21:43:09 -07:00

phi.py

Support for Phi-1.5 & Phi-2 models (#7862 )

2025-07-13 18:43:40 -07:00

phimoe.py

Support EPLB in FusedMoE (#8448 )

2025-07-29 16:02:41 -07:00

pixtral.py

Refactor mm processors and Enable mixed modality processing (#7629 )

2025-06-30 23:14:48 -07:00

qwen2_5_vl.py

refactor: unify names of the feature field of MultimodalDataItem (#8075 )

2025-07-16 17:52:38 -07:00

qwen2_audio.py

refactor: unify names of the feature field of MultimodalDataItem (#8075 )

2025-07-16 17:52:38 -07:00

qwen2_classification.py

…

qwen2_eagle.py

[Bugfix] pipeline parallelism and Eagle Qwen2 (#6910 )

2025-06-07 01:58:50 -07:00

qwen2_moe.py

[Feat] QWen-1M context support[2/2]: Update block sparse attention backend (#5949 )

2025-08-06 23:49:36 -07:00

qwen2_rm.py

…

qwen2_vl.py

refactor: unify names of the feature field of MultimodalDataItem (#8075 )

2025-07-16 17:52:38 -07:00

qwen2.py

[Feat] QWen-1M context support[2/2]: Update block sparse attention backend (#5949 )

2025-08-06 23:49:36 -07:00

qwen3_moe.py

[Feat] QWen-1M context support[2/2]: Update block sparse attention backend (#5949 )

2025-08-06 23:49:36 -07:00

qwen3.py

Add get_hidden_dim to qwen3.py for correct lora (#7312 )

2025-07-19 19:31:16 -07:00

qwen.py

[Feature] Layer-wise Prefill (#7634 )

2025-07-17 01:57:46 +08:00

registry.py

[FEAT] Add transformers backend support (#5929 )

2025-06-03 21:05:29 -07:00

roberta.py

Feat/support rerank (#6058 )

2025-06-16 10:50:01 -07:00

siglip.py

…

stablelm.py

…

step3_vl.py

feat: Support DP Attention for step3_vl (#8699 )

2025-08-03 19:35:26 +08:00

torch_native_llama.py

…

transformers.py

chore: upgrade transformers 4.55.0 (#8823 )

2025-08-05 11:37:21 -07:00

vila.py

refactor: unify names of the feature field of MultimodalDataItem (#8075 )

2025-07-16 17:52:38 -07:00

xverse_moe.py

…

xverse.py

…

yivl.py

…