chenxu214 7dd679cbb9 [NPU][Bugfix] Fix qwen3 error when enable-dp-lm-head (#16115)

2026-01-08 15:15:43 +08:00

..

deepseek_common

[1/n]deepseek_v2.py Refactor: attention backend handlers and forward method definition (#16306)

2026-01-08 09:22:31 +08:00

apertus.py

Depreate global_server_args_dict (#11528)

2025-10-13 19:34:43 +08:00

arcee.py

Depreate global_server_args_dict (#11528)

2025-10-13 19:34:43 +08:00

baichuan.py

…

bailing_moe_nextn.py

Depreate global_server_args_dict (#11528)

2025-10-13 19:34:43 +08:00

bailing_moe.py

[Feature] JIT Fused QK norm + qk norm clean up (#15835)

2025-12-28 11:53:50 +08:00

bert.py

[Lint] Add python/sglang to ruff F401 checks and remove unused imports in files (#11685)

2025-10-17 16:49:46 -07:00

chatglm.py

…

clip.py

refactor: cleanup vision attention related codes (#13228)

2025-11-16 22:44:40 +08:00

commandr.py

…

dbrx.py

…

deepseek_janus_pro.py

refactor: cleanup vision attention related codes (#13228)

2025-11-16 22:44:40 +08:00

deepseek_nextn.py

[DeepSeek v3.2] opt Context Parallelism: support fused moe, multi batch and fp8 kvcache (#13959)

2026-01-02 23:49:14 +08:00

deepseek_ocr.py

model: support deepseek-ocr (#11891)

2025-10-24 03:15:17 +08:00

deepseek_v2.py

[AMD] Fix aiter page-size handling, DeepSeek MLA tuple inputs, and HiCache/FA3 decode-backend override (#16531)

2026-01-07 21:14:32 -08:00

deepseek_vl2.py

…

deepseek.py

…

dots_ocr.py

[Lint] Add python/sglang to ruff F401 checks and remove unused imports in files (#11685)

2025-10-17 16:49:46 -07:00

dots_vlm_vit.py

Convert cu_seqlens to CPU for npu_flash_attention_unpad operator (#15434)

2026-01-04 08:16:42 +08:00

dots_vlm.py

feat: support EPD disaggregation (#12263)

2025-12-14 22:30:08 +08:00

ernie4_eagle.py

…

ernie4.py

[Feature] Enable return routed experts (#12162)

2025-12-21 15:16:43 +08:00

exaone.py

…

falcon_h1.py

[bugfix] fix TBO crashes when attn_tp_size > 1 (#13730)

2025-12-11 18:18:40 -08:00

gemma2_reward.py

…

gemma2.py

…

gemma3_causal.py

vlm: refactor engine vlm params and support processor output as input (#14091)

2025-12-20 18:31:24 +08:00

gemma3_mm.py

vlm: refactor engine vlm params and support processor output as input (#14091)

2025-12-20 18:31:24 +08:00

gemma3n_audio.py

…

gemma3n_causal.py

…

gemma3n_mm.py

[Lint] Add python/sglang to ruff F401 checks and remove unused imports in files (#11685)

2025-10-17 16:49:46 -07:00

gemma.py

…

glm4_moe_nextn.py

Feat: GLM-4.6 supports shared experts fusion (#13873)

2025-12-01 11:33:18 +08:00

glm4_moe.py

[Feature] JIT Fused QK norm + qk norm clean up (#15835)

2025-12-28 11:53:50 +08:00

glm4.py

support GLM-V vision model dp (#14097)

2025-12-05 21:03:54 +08:00

glm4v_moe.py

[Glm46v] Bug fix for accuracy drop and unable to launch server (#14585)

2025-12-07 23:45:02 -08:00

glm4v.py

Convert cu_seqlens to CPU for npu_flash_attention_unpad operator (#15434)

2026-01-04 08:16:42 +08:00

glmasr.py

fix: change class name of GLM-ASR (#15772)

2025-12-26 00:15:16 +08:00

gpt2.py

…

gpt_bigcode.py

…

gpt_oss.py

[Feature] Enable return routed experts (#12162)

2025-12-21 15:16:43 +08:00

granite.py

…

granitemoe.py

…

grok.py

[Feature] Enable return routed experts (#12162)

2025-12-21 15:16:43 +08:00

hunyuan.py

[Feature] Enable return routed experts (#12162)

2025-12-21 15:16:43 +08:00

idefics2.py

Convert cu_seqlens to CPU for npu_flash_attention_unpad operator (#15434)

2026-01-04 08:16:42 +08:00

internlm2_reward.py

…

internlm2.py

…

interns1.py

[Bug] Fix Intern-S1 model accuracy and support /generate interface with input_ids (#12367)

2025-11-02 20:22:33 -08:00

internvl.py

[VLM] Support Video for InternVL3_5 (#15942)

2025-12-30 17:07:49 +08:00

jet_nemotron.py

model: support JetVLM (#13289)

2025-11-18 12:02:03 +08:00

jet_vlm.py

model: support JetVLM (#13289)

2025-11-18 12:02:03 +08:00

kimi_linear.py

remove unecessary dual stream token threshold from the rest of models (qwen moe, kimi linear, etc.) (#14337)

2025-12-06 19:57:26 -08:00

kimi_vl_moonvit.py

move more files under srt/utils (#11285)

2025-10-09 16:46:15 -07:00

kimi_vl.py

vlm: refactor engine vlm params and support processor output as input (#14091)

2025-12-20 18:31:24 +08:00

llada2.py

[Feature] JIT Fused QK norm + qk norm clean up (#15835)

2025-12-28 11:53:50 +08:00

llama4.py

[bugfix] fix TBO crashes when attn_tp_size > 1 (#13730)

2025-12-11 18:18:40 -08:00

llama_classification.py

…

llama_eagle3.py

Eagle3 DP attention for Qwen3 MoE (#12002)

2025-10-29 20:25:17 +08:00

llama_eagle.py

…

llama_embedding.py

…

llama_reward.py

…

llama.py

[NPU][Bugfix] Fix qwen3 error when enable-dp-lm-head (#16115)

2026-01-08 15:15:43 +08:00

llava.py

fix: Support PP for Mistral Small 3.1 (#14254)

2025-12-02 13:04:14 +08:00

llavavid.py

…

longcat_flash_nextn.py

[bugfix] fix TBO crashes when attn_tp_size > 1 (#13730)

2025-12-11 18:18:40 -08:00

longcat_flash.py

[Feature] Enable return routed experts (#12162)

2025-12-21 15:16:43 +08:00

midashenglm.py

Add MiDasheng Model Support (#15219)

2025-12-19 21:41:59 +08:00

mimo_mtp.py

[Lint] Add python/sglang to ruff F401 checks and remove unused imports in files (#11685)

2025-10-17 16:49:46 -07:00

mimo_v2_flash_nextn.py

Clean hidden_states_before_norm (#15485)

2025-12-20 09:38:46 +08:00

mimo_v2_flash.py

Optimize MiMo-V2-Flash by flashinfer fused allreduce (#15464)

2025-12-20 17:45:18 +08:00

mimo.py

[Lint] Add python/sglang to ruff F401 checks and remove unused imports in files (#11685)

2025-10-17 16:49:46 -07:00

mindspore.py

Fix Mindspore model import warning (#15287)

2025-12-18 23:15:33 -05:00

minicpm3.py

…

minicpm.py

…

minicpmo.py

vlm: refactor engine vlm params and support processor output as input (#14091)

2025-12-20 18:31:24 +08:00

minicpmv.py

…

minimax_m2.py

Fusing RMSNormTP in minimax_m2 (#14416)

2025-12-30 10:22:07 -08:00

ministral3.py

ministral3 (#14251)

2025-12-04 14:31:26 -08:00

mistral_large_3_eagle.py

Mistral Large 3 NVFP4 support (#14485)

2025-12-13 13:34:42 +08:00

mistral_large_3.py

Mistral Large 3 NVFP4 support (#14485)

2025-12-13 13:34:42 +08:00

mistral.py

…

mixtral_quant.py

…

mixtral.py

[Piecewise CUDA Graph] Fix recompile issue for Mixtral and Grok2 (#13667)

2025-11-20 14:20:11 -08:00

mllama4.py

refactor: cleanup vision attention related codes (#13228)

2025-11-16 22:44:40 +08:00

mllama.py

refactor: cleanup vision attention related codes (#13228)

2025-11-16 22:44:40 +08:00

nano_nemotron_vl.py

EVS Framework: Support NemotronH_Nano_VL_V2 (#14051)

2026-01-05 16:18:07 +08:00

nemotron_h.py

[NemotronH] Add latent MoE support (#16227)

2026-01-02 22:08:58 +08:00

nemotron_nas.py

…

nvila_lite.py

model: support NVILA and NVILA Lite (#10399)

2025-10-26 09:58:09 -07:00

nvila.py

model: support NVILA and NVILA Lite (#10399)

2025-10-26 09:58:09 -07:00

olmo2.py

support piecewise cuda graph for Olmo models (#14476)

2025-12-06 17:57:44 -08:00

olmo.py

support piecewise cuda graph for Olmo models (#14476)

2025-12-06 17:57:44 -08:00

olmoe.py

…

opt.py

[lint] improve ruff check (#11922)

2025-10-22 11:32:50 +08:00

orion.py

Support orion (#10665)

2025-11-15 03:08:32 +08:00

paddleocr_vl.py

Convert cu_seqlens to CPU for npu_flash_attention_unpad operator (#15434)

2026-01-04 08:16:42 +08:00

persimmon.py

…

phi3_small.py

…

phi4mm_audio.py

…

phi4mm_utils.py

…

phi4mm.py

[Lint] Add python/sglang to ruff F401 checks and remove unused imports in files (#11685)

2025-10-17 16:49:46 -07:00

phi.py

[Lint] Add python/sglang to ruff F401 checks and remove unused imports in files (#11685)

2025-10-17 16:49:46 -07:00

phimoe.py

[Lint] Add python/sglang to ruff F401 checks and remove unused imports in files (#11685)

2025-10-17 16:49:46 -07:00

pixtral.py

ministral3 (#14251)

2025-12-04 14:31:26 -08:00

points_v15_chat.py

[model] Support POINTSV15Chat (#9651)

2025-10-22 16:58:17 +08:00

qwen2_5_vl.py

Convert cu_seqlens to CPU for npu_flash_attention_unpad operator (#15434)

2026-01-04 08:16:42 +08:00

qwen2_audio.py

[Lint] Add python/sglang to ruff F401 checks and remove unused imports in files (#11685)

2025-10-17 16:49:46 -07:00

qwen2_classification.py

…

qwen2_eagle.py

…

qwen2_moe.py

[VLM] feat: true on policy for vlm + fsdp (#14636)

2026-01-01 16:54:39 -08:00

qwen2_rm.py

…

qwen2_vl.py

Convert cu_seqlens to CPU for npu_flash_attention_unpad operator (#15434)

2026-01-04 08:16:42 +08:00

qwen2.py

[RL] refactor flash rl weight reload in sglang (#14870)

2025-12-12 12:50:47 +08:00

qwen3_classification.py

…

qwen3_moe.py

[NPU][Bugfix] Fix qwen3 error when enable-dp-lm-head (#16115)

2026-01-08 15:15:43 +08:00

qwen3_next_mtp.py

Depreate global_server_args_dict (#11528)

2025-10-13 19:34:43 +08:00

qwen3_next.py

[NPU] Adapt qwen3-next W8A8 on NPU (#16164)

2026-01-03 19:41:20 +08:00

qwen3_omni_moe.py

Convert cu_seqlens to CPU for npu_flash_attention_unpad operator (#15434)

2026-01-04 08:16:42 +08:00

qwen3_vl_moe.py

[VLM] feat: true on policy for vlm + fsdp (#14636)

2026-01-01 16:54:39 -08:00

qwen3_vl.py

Fix the problem where Qwen3VL raises an "object has no attribute 'mod… (#15677)

2026-01-06 08:45:13 +08:00

qwen3.py

[NPU][Bugfix] Fix qwen3 error when enable-dp-lm-head (#16115)

2026-01-08 15:15:43 +08:00

qwen.py

[Lint] Add python/sglang to ruff F401 checks and remove unused imports in files (#11685)

2025-10-17 16:49:46 -07:00

radio.py

Support nvidia/NVIDIA-Nemotron-Nano-12B-v2-VL-BF16 (and nvidia/C-RADIOv2-H) (#12277)

2025-11-26 16:28:52 -07:00

registry.py

tiny unify environ usage (#15335)

2025-12-17 23:31:43 +08:00

roberta.py

Implement BGE-M3 Sparse Embeddings in SGLang (#10869)

2025-10-22 13:46:16 -07:00

sarashina2_vision.py

[Lint] Add python/sglang to ruff F401 checks and remove unused imports in files (#11685)

2025-10-17 16:49:46 -07:00

siglip.py

refactor: cleanup vision attention related codes (#13228)

2025-11-16 22:44:40 +08:00

solar.py

Remove wrong imports from sglang.python (#10493)

2025-09-15 22:12:21 -07:00

stablelm.py

…

starcoder2.py

model: support starcoder2 (#10609)

2025-10-04 00:11:19 +08:00

step3_vl.py

[Feature] Enable return routed experts (#12162)

2025-12-21 15:16:43 +08:00

teleflm.py

model: support teleflm (#10573)

2025-11-15 03:14:49 +08:00

torch_native_llama.py

Fix multimodal registry and code sync scripts (#10759)

2025-09-22 15:36:01 -07:00

transformers.py

…

utils.py

[jit kernel] support dtype as a cpp template parameter (#16452)

2026-01-08 13:54:33 +08:00

xverse_moe.py

…

xverse.py

…

yivl.py

…