sglang

deepseek_common

[3/n] deepseek_v2.py Refactor: Migrate MLA forward method in deepseek_v2.py (#19122 )

2026-02-27 13:37:29 -08:00

afmoe.py

Add AFMoE model implementation (#13216 )

2026-01-16 20:35:42 +08:00

apertus.py

…

arcee.py

…

baichuan.py

update pre-commit config (#18860 )

2026-02-16 00:18:31 +08:00

bailing_moe_linear.py

Cleanup debug log for Ring model (#18793 )

2026-02-13 18:36:20 +08:00

bailing_moe_nextn.py

update pre-commit config (#18860 )

2026-02-16 00:18:31 +08:00

bailing_moe.py

update pre-commit config (#18860 )

2026-02-16 00:18:31 +08:00

bert.py

[NPU] bugfix with Kimi-k2 and bge-reranker-v2 model (#17478 )

2026-01-22 22:02:05 +08:00

chatglm.py

…

clip.py

refactor: cleanup vision attention related codes (#13228 )

2025-11-16 22:44:40 +08:00

commandr.py

[new-model] Add support for Cohere2ForCausalLM behind Command-A and Command-R Models (#16927 )

2026-01-21 12:28:33 -08:00

dbrx.py

…

deepseek_janus_pro.py

[AMD] Fix Janus-Pro crash and add Kimi-K2.5 nightly test (#18269 )

2026-02-10 22:33:13 -08:00

deepseek_nextn.py

[AMD] Fix weight load shape mismatch for amd dsr1 0528 mxfp4 (#19425 )

2026-02-26 17:11:59 -08:00

deepseek_ocr.py

Adapt the Qwen2Model._update_causal_mask for transformers==4.57.1 (#18774 )

2026-02-17 10:20:41 +08:00

deepseek_v2.py

[3/n] deepseek_v2.py Refactor: Migrate MLA forward method in deepseek_v2.py (#19122 )

2026-02-27 13:37:29 -08:00

deepseek_vl2.py

…

deepseek.py

…

dots_ocr.py

…

dots_vlm_vit.py

Convert cu_seqlens to CPU for npu_flash_attention_unpad operator (#15434 )

2026-01-04 08:16:42 +08:00

dots_vlm.py

feat: support EPD disaggregation (#12263 )

2025-12-14 22:30:08 +08:00

ernie4_eagle.py

update pre-commit config (#18860 )

2026-02-16 00:18:31 +08:00

ernie4.py

update pre-commit config (#18860 )

2026-02-16 00:18:31 +08:00

ernie45_moe_vl.py

update pre-commit config (#18860 )

2026-02-16 00:18:31 +08:00

ernie45_vl.py

update pre-commit config (#18860 )

2026-02-16 00:18:31 +08:00

exaone4.py

[Model] Add support for EXAONE-4.0 Model (#8205 )

2026-01-27 14:08:24 +08:00

exaone_moe_mtp.py

[Model] Add K-EXAONE model support (#16294 )

2026-01-30 20:01:14 +08:00

exaone_moe.py

[Model] Add K-EXAONE model support (#16294 )

2026-01-30 20:01:14 +08:00

exaone.py

…

falcon_h1.py

Use attn tp group in embedding for more models (#17570 )

2026-01-24 13:37:44 +08:00

gemma2_reward.py

…

gemma2.py

[NPU] support model skywork-reward-gemma2-2-27B-v0.2 (#16947 )

2026-02-11 15:34:53 +08:00

gemma3_causal.py

feature: support bidirectional attention for Gemma-3 (#10707 )

2026-02-09 23:17:45 +08:00

gemma3_mm.py

feature: support bidirectional attention for Gemma-3 (#10707 )

2026-02-09 23:17:45 +08:00

gemma3n_audio.py

…

gemma3n_causal.py

Fix nightly VLM accuracy: gemma3n TP fixes + removal, latency thresholds (#19401 )

2026-02-27 14:24:02 -08:00

gemma3n_mm.py

Fix nightly VLM accuracy: gemma3n TP fixes + removal, latency thresholds (#19401 )

2026-02-27 14:24:02 -08:00

gemma.py

…

glm4_moe_lite.py

[Tiny] Fix grammar in shared experts fusion log messages (#18043 )

2026-01-31 13:14:25 -08:00

glm4_moe_nextn.py

Use attn tp group in embedding for more models (#17570 )

2026-01-24 13:37:44 +08:00

glm4_moe.py

Fix GLM-5 fused shared expert (#18804 )

2026-02-16 19:50:39 +00:00

glm4.py

[GLM-OCR] Support GLM-OCR Model (#17582 )

2026-01-26 22:24:00 -08:00

glm4v_moe.py

[Glm46v] Bug fix for accuracy drop and unable to launch server (#14585 )

2025-12-07 23:45:02 -08:00

glm4v.py

[GLM-OCR] Support GLM-OCR Model (#17582 )

2026-01-26 22:24:00 -08:00

glm_ocr_nextn.py

[GLM-OCR] Support GLM-OCR Model (#17582 )

2026-01-26 22:24:00 -08:00

glm_ocr.py

[GLM-OCR] Support GLM-OCR Model (#17582 )

2026-01-26 22:24:00 -08:00

glmasr.py

fix: change class name of GLM-ASR (#15772 )

2025-12-26 00:15:16 +08:00

gpt2.py

update pre-commit config (#18860 )

2026-02-16 00:18:31 +08:00

gpt_bigcode.py

…

gpt_j.py

[Fix] Remove unused Type import in gpt_j.py (#17975 )

2026-01-29 21:11:11 -08:00

gpt_oss.py

[Feature] rewrite rope kernel; remove flashinfer dependencies (#18844 )

2026-02-21 21:32:40 +08:00

granite.py

…

granitemoe.py

…

granitemoehybrid.py

Model: Support IBM Granite (Dense/Mamba + MoE) (#18040 )

2026-02-15 11:24:41 +08:00

grok.py

[Auto Sync] Update grok.py (20260213) (#18765 )

2026-02-12 18:41:41 -08:00

hunyuan.py

update pre-commit config (#18860 )

2026-02-16 00:18:31 +08:00

idefics2.py

Convert cu_seqlens to CPU for npu_flash_attention_unpad operator (#15434 )

2026-01-04 08:16:42 +08:00

internlm2_reward.py

…

internlm2.py

…

interns1.py

…

interns1pro.py

model: support interns1-pro (#18145 )

2026-02-05 00:22:44 +08:00

internvl.py

[vlm][internVL] Support processor and embedding inputs for InternVL (#19127 )

2026-02-26 22:46:48 -08:00

iquest_loopcoder.py

[Model] Support IQuest-Coder-40B-Loop (#16348 )

2026-01-12 23:44:45 +08:00

jet_nemotron.py

model: support JetVLM (#13289 )

2025-11-18 12:02:03 +08:00

jet_vlm.py

model: support JetVLM (#13289 )

2025-11-18 12:02:03 +08:00

kimi_k25.py

[NPU] support Kimi-K2.5 on NPU (#19331 )

2026-02-26 20:41:44 +08:00

kimi_linear.py

[Qwen3-Next] Support gdn fused_rms_norm_gated (#19434 )

2026-02-27 23:08:08 +08:00

kimi_vl_moonvit.py

…

kimi_vl.py

vlm: refactor engine vlm params and support processor output as input (#14091 )

2025-12-20 18:31:24 +08:00

lfm2_moe.py

Add LMF2 MoE model architecture (#17997 )

2026-02-12 01:03:43 +08:00

lfm2.py

Add tensor parallelism support to LFM2 ShortConv layers (#17777 )

2026-02-09 00:52:47 +08:00

lightonocr.py

Support LightOnOCR-2-1B (#17806 )

2026-01-29 23:03:41 +08:00

llada2.py

[Feature] rewrite rope kernel; remove flashinfer dependencies (#18844 )

2026-02-21 21:32:40 +08:00

llama4.py

llama4 npu adapt (#17123 )

2026-02-27 14:52:37 +08:00

llama_classification.py

…

llama_eagle3.py

…

llama_eagle.py

…

llama_embedding.py

…

llama_reward.py

…

llama.py

[Bugfix]Repeated add modelslim quant_config and bugfix with "enable-piecewise-cuda-graph" on NPU (#17511 )

2026-01-26 09:51:07 +08:00

llava.py

fix: Support PP for Mistral Small 3.1 (#14254 )

2025-12-02 13:04:14 +08:00

llavavid.py

…

longcat_flash_nextn.py

Use attn tp group in embedding for more models (#17570 )

2026-01-24 13:37:44 +08:00

longcat_flash.py

Use attn tp group in embedding for more models (#17570 )

2026-01-24 13:37:44 +08:00

midashenglm.py

Add MiDasheng Model Support (#15219 )

2025-12-19 21:41:59 +08:00

mimo_mtp.py

…

mimo_v2_flash_nextn.py

model: support Step-3.5-Flash (#18084 )

2026-02-03 00:40:07 +08:00

mimo_v2_flash.py

[MiMoV2Flash] [feat]: support two batch overlap (#17634 )

2026-02-02 14:03:57 -08:00

mimo.py

…

mindspore.py

[NPU]mindspore model support moe (#15363 )

2026-02-02 17:52:49 +08:00

minicpm3.py

[NPU]support model MiniCPM3-4B for npu (#16866 )

2026-01-24 08:25:12 +08:00

minicpm.py

…

minicpmo.py

vlm: refactor engine vlm params and support processor output as input (#14091 )

2025-12-20 18:31:24 +08:00

minicpmv.py

[model] Support MiniCPM-V 4.5 (#9610 )

2026-01-31 23:37:36 -08:00

minimax_m2.py

[piecewise graph]: support MiniMax-M2 (#18217 )

2026-02-04 23:24:38 -08:00

ministral3.py

ministral3 (#14251 )

2025-12-04 14:31:26 -08:00

mistral_large_3_eagle.py

Mistral Large 3 NVFP4 support (#14485 )

2025-12-13 13:34:42 +08:00

mistral_large_3.py

Mistral Large 3 NVFP4 support (#14485 )

2025-12-13 13:34:42 +08:00

mistral.py

…

mixtral_quant.py

[fix typo] expert_indicies -> expert_indices (#19627 )

2026-03-01 17:37:34 -08:00

mixtral.py

[Piecewise CUDA Graph] Fix recompile issue for Mixtral and Grok2 (#13667 )

2025-11-20 14:20:11 -08:00

mllama4.py

refactor: cleanup vision attention related codes (#13228 )

2025-11-16 22:44:40 +08:00

mllama.py

update pre-commit config (#18860 )

2026-02-16 00:18:31 +08:00

nano_nemotron_vl.py

EVS Framework: Support NemotronH_Nano_VL_V2 (#14051 )

2026-01-05 16:18:07 +08:00

nemotron_h_mtp.py

Feat/support nemotron h mtp (#17013 )

2026-01-14 16:30:35 +08:00

nemotron_h.py

[Quantization] Support config.json quantization_config format, fix exclude_modules matching, and fix KV cache scale loading for Nemotron (#18546 )

2026-02-21 16:14:29 +08:00

nemotron_nas.py

update pre-commit config (#18860 )

2026-02-16 00:18:31 +08:00

nvila_lite.py

…

nvila.py

…

olmo2.py

update pre-commit config (#18860 )

2026-02-16 00:18:31 +08:00

olmo.py

update pre-commit config (#18860 )

2026-02-16 00:18:31 +08:00

olmoe.py

…

opt.py

update pre-commit config (#18860 )

2026-02-16 00:18:31 +08:00

orion.py

update pre-commit config (#18860 )

2026-02-16 00:18:31 +08:00

paddleocr_vl.py

Convert cu_seqlens to CPU for npu_flash_attention_unpad operator (#15434 )

2026-01-04 08:16:42 +08:00

persimmon.py

…

phi3_small.py

…

phi4mm_audio.py

…

phi4mm_utils.py

…

phi4mm.py

…

phi.py

…

phimoe.py

…

pixtral.py

update pre-commit config (#18860 )

2026-02-16 00:18:31 +08:00

points_v15_chat.py

…

qwen2_5_vl.py

update pre-commit config (#18860 )

2026-02-16 00:18:31 +08:00

qwen2_audio.py

update pre-commit config (#18860 )

2026-02-16 00:18:31 +08:00

qwen2_classification.py

…

qwen2_eagle.py

…

qwen2_moe.py

Register tensors with symmetric memory for qwen (#18643 )

2026-02-20 09:32:32 +08:00

qwen2_rm.py

…

qwen2_vl.py

update pre-commit config (#18860 )

2026-02-16 00:18:31 +08:00

qwen2.py

update pre-commit config (#18860 )

2026-02-16 00:18:31 +08:00

qwen3_5_mtp.py

[Qwen3.5] Enable nvfp4 checkpoint (#18937 )

2026-02-19 12:24:05 +08:00

qwen3_5.py

[Qwen3.5] Qwen3.5-27B inference repeat bug fix (#19411 )

2026-02-26 20:11:29 +08:00

qwen3_classification.py

[Model] Add Qwen3ForRewardModel and fix Qwen3ForSequenceClassification (#17992 )

2026-02-16 19:44:41 +08:00

qwen3_moe.py

[ModelOpt] Fix broken Qwen3-235B-A22B-Instruct-2507-NVFP4 launch (#18189 )

2026-02-08 14:35:28 +00:00

qwen3_next_mtp.py

update pre-commit config (#18860 )

2026-02-16 00:18:31 +08:00

qwen3_next.py

[feat] Support nvfp4 quantized model of Qwen3-Next (#17627 )

2026-02-27 18:28:47 -08:00

qwen3_omni_moe.py

update pre-commit config (#18860 )

2026-02-16 00:18:31 +08:00

qwen3_rm.py

[Model] Add Qwen3ForRewardModel and fix Qwen3ForSequenceClassification (#17992 )

2026-02-16 19:44:41 +08:00

qwen3_vl_moe.py

update pre-commit config (#18860 )

2026-02-16 00:18:31 +08:00

qwen3_vl.py

fix qwen3_vl visual module loading (#19333 )

2026-02-26 19:44:05 -08:00

qwen3.py

Update weight rename check for Qwen3 Embeddings (#17535 )

2026-02-03 13:55:11 -08:00

qwen.py

…

radio.py

Support nvidia/NVIDIA-Nemotron-Nano-12B-v2-VL-BF16 (and nvidia/C-RADIOv2-H) (#12277 )

2025-11-26 16:28:52 -07:00

registry.py

tiny unify environ usage (#15335 )

2025-12-17 23:31:43 +08:00

roberta.py

…

sarashina2_vision.py

…

sdar_moe.py

Feature/sdar support (#19044 )

2026-02-19 21:58:15 -08:00

sdar.py

Feature/sdar support (#19044 )

2026-02-19 21:58:15 -08:00

siglip.py

refactor: cleanup vision attention related codes (#13228 )

2025-11-16 22:44:40 +08:00

solar.py

…

stablelm.py

[NPU] solve accuracy problem for stablelm-2-1-6b for npu (#17470 )

2026-01-24 08:27:38 +08:00

starcoder2.py

update pre-commit config (#18860 )

2026-02-16 00:18:31 +08:00

step3_vl_10b.py

model: step3-vl-10b (#17513 )

2026-01-22 23:15:08 +08:00

step3_vl.py

Use attn tp group in embedding for more models (#17570 )

2026-01-24 13:37:44 +08:00

step3p5_mtp.py

model: support Step-3.5-Flash (#18084 )

2026-02-03 00:40:07 +08:00

step3p5.py

model: support Step-3.5-Flash (#18084 )

2026-02-03 00:40:07 +08:00

teleflm.py

model: support teleflm (#10573 )

2025-11-15 03:14:49 +08:00

torch_native_llama.py

…

transformers.py

update pre-commit config (#18860 )

2026-02-16 00:18:31 +08:00

utils.py

[Feature] rewrite rope kernel; remove flashinfer dependencies (#18844 )

2026-02-21 21:32:40 +08:00

whisper.py

Whisper model support & /v1/audio/transcriptions endpoint & benchmark (#16983 )

2026-02-23 17:28:37 -08:00

xverse_moe.py

support xverse_moe on npu

2026-02-24 14:11:20 +08:00

xverse.py

…

yivl.py

…