Nicolas Castet 2340798353 Register allgather/reducescatter buffers with symm memory (#12572)

2025-11-04 17:11:36 -08:00

..

apertus.py

Depreate global_server_args_dict (#11528)

2025-10-13 19:34:43 +08:00

arcee.py

Depreate global_server_args_dict (#11528)

2025-10-13 19:34:43 +08:00

baichuan.py

…

bailing_moe_nextn.py

Depreate global_server_args_dict (#11528)

2025-10-13 19:34:43 +08:00

bailing_moe.py

Enable bailing_moe to support TP=16 (#12369)

2025-10-31 19:32:49 +08:00

bert.py

[Lint] Add python/sglang to ruff F401 checks and remove unused imports in files (#11685)

2025-10-17 16:49:46 -07:00

chatglm.py

…

clip.py

…

commandr.py

…

dbrx.py

[6/N] MoE Refactor: Cleanup MoE-related configs (#8849)

2025-08-14 21:14:53 -07:00

deepseek_janus_pro.py

…

deepseek_nextn.py

[Feature] Support DeepSeek MTP on NPU (#11897)

2025-10-30 21:56:56 +08:00

deepseek_ocr.py

model: support deepseek-ocr (#11891)

2025-10-24 03:15:17 +08:00

deepseek_v2.py

Register allgather/reducescatter buffers with symm memory (#12572)

2025-11-04 17:11:36 -08:00

deepseek_vl2.py

…

deepseek.py

[6/N] MoE Refactor: Cleanup MoE-related configs (#8849)

2025-08-14 21:14:53 -07:00

dots_ocr.py

[Lint] Add python/sglang to ruff F401 checks and remove unused imports in files (#11685)

2025-10-17 16:49:46 -07:00

dots_vlm_vit.py

Replace pad with cat for better performance (#11388)

2025-10-10 12:03:17 +08:00

dots_vlm.py

[Lint] Add python/sglang to ruff F401 checks and remove unused imports in files (#11685)

2025-10-17 16:49:46 -07:00

ernie4_eagle.py

Add ernie4.py for ERNIE-4.5 (#7657)

2025-08-08 00:55:48 -07:00

ernie4.py

Refactor TopK to ensure readability and extensibility (#9338)

2025-09-14 19:16:25 -07:00

exaone.py

…

falcon_h1.py

[Lint] Add python/sglang to ruff F401 checks and remove unused imports in files (#11685)

2025-10-17 16:49:46 -07:00

gemma2_reward.py

…

gemma2.py

Fix incorrect default get_hidden_dim logic (#8987)

2025-08-09 00:25:38 -07:00

gemma3_causal.py

Fix gemma 3 launch with transformers: the error: AttributeError: 'TransformersForCausalLM' object has no attribute 'tp_size' (#9614)

2025-09-29 06:18:29 +00:00

gemma3_mm.py

Fix LoRA support for multimodal models (VLMs) by implementing a consistent pattern for skipping vision components (#11261)

2025-10-06 17:23:00 -07:00

gemma3n_audio.py

…

gemma3n_causal.py

…

gemma3n_mm.py

[Lint] Add python/sglang to ruff F401 checks and remove unused imports in files (#11685)

2025-10-17 16:49:46 -07:00

gemma.py

…

glm4_moe_nextn.py

Refactoring GLM-4.5 and GLM-4.5V related implementations (#11800)

2025-10-24 08:22:36 +00:00

glm4_moe.py

Register allgather/reducescatter buffers with symm memory (#12572)

2025-11-04 17:11:36 -08:00

glm4.py

GLM-4-0414 and GLM-4.1V Code Refactor (#12117)

2025-10-27 16:57:07 +08:00

glm4v_moe.py

GLM-4-0414 and GLM-4.1V Code Refactor (#12117)

2025-10-27 16:57:07 +08:00

glm4v.py

GLM-4-0414 and GLM-4.1V Code Refactor (#12117)

2025-10-27 16:57:07 +08:00

gpt2.py

…

gpt_bigcode.py

…

gpt_oss.py

Support running FP4 Deepseek on SM120. (#11708)

2025-10-27 17:37:49 -07:00

granite.py

Fix incorrect default get_hidden_dim logic (#8987)

2025-08-09 00:25:38 -07:00

granitemoe.py

[6/N] MoE Refactor: Cleanup MoE-related configs (#8849)

2025-08-14 21:14:53 -07:00

grok.py

Depreate global_server_args_dict (#11528)

2025-10-13 19:34:43 +08:00

hunyuan.py

[Lint] Add python/sglang to ruff F401 checks and remove unused imports in files (#11685)

2025-10-17 16:49:46 -07:00

idefics2.py

…

internlm2_reward.py

…

internlm2.py

…

interns1.py

[Bug] Fix Intern-S1 model accuracy and support /generate interface with input_ids (#12367)

2025-11-02 20:22:33 -08:00

internvl.py

[Bug] Fix Intern-S1 model accuracy and support /generate interface with input_ids (#12367)

2025-11-02 20:22:33 -08:00

kimi_linear.py

Support Kimi Linear (#12469)

2025-10-31 14:03:35 -07:00

kimi_vl_moonvit.py

move more files under srt/utils (#11285)

2025-10-09 16:46:15 -07:00

kimi_vl.py

move more files under srt/utils (#11285)

2025-10-09 16:46:15 -07:00

llama4.py

Fix the shared expert & routed expert overlap in Llama 4 (#12405)

2025-10-30 20:14:49 -07:00

llama_classification.py

…

llama_eagle3.py

Eagle3 DP attention for Qwen3 MoE (#12002)

2025-10-29 20:25:17 +08:00

llama_eagle.py

…

llama_embedding.py

…

llama_reward.py

…

llama.py

Depreate global_server_args_dict (#11528)

2025-10-13 19:34:43 +08:00

llava.py

…

llavavid.py

…

longcat_flash_nextn.py

[Refactor] move deep_gemm_wrapper out of quantization (#11784)

2025-10-17 18:57:54 -07:00

longcat_flash.py

[hotfix] missing w13_weight_fp8 and w2_weight_fp8 in UE8M0 requantization (#12259)

2025-10-28 19:10:38 -07:00

mimo_mtp.py

[Lint] Add python/sglang to ruff F401 checks and remove unused imports in files (#11685)

2025-10-17 16:49:46 -07:00

mimo.py

[Lint] Add python/sglang to ruff F401 checks and remove unused imports in files (#11685)

2025-10-17 16:49:46 -07:00

minicpm3.py

[6/N] MoE Refactor: Cleanup MoE-related configs (#8849)

2025-08-14 21:14:53 -07:00

minicpm.py

…

minicpmo.py

[Lint] Add python/sglang to ruff F401 checks and remove unused imports in files (#11685)

2025-10-17 16:49:46 -07:00

minicpmv.py

[model] support MiniCPM-V 4.0 (#8747)

2025-09-02 15:33:03 -07:00

minimax_m2.py

improve mimax-m2 rmsnorm precision (#12186)

2025-10-28 00:01:42 +08:00

mistral.py

…

mixtral_quant.py

…

mixtral.py

[Lint] Add python/sglang to ruff F401 checks and remove unused imports in files (#11685)

2025-10-17 16:49:46 -07:00

mllama4.py

Depreate global_server_args_dict (#11528)

2025-10-13 19:34:43 +08:00

mllama.py

ci: reduce and refactor vlm ut and combine test files (#11062)

2025-10-17 15:24:50 +00:00

nemotron_h.py

Feature/nano v2 offline modelopt fp8 and nvfp4 (#12018)

2025-10-23 11:16:46 -07:00

nemotron_nas.py

from python.sglang.srt -> from sglang.srt (#9268)

2025-08-17 02:45:45 -07:00

nvila_lite.py

model: support NVILA and NVILA Lite (#10399)

2025-10-26 09:58:09 -07:00

nvila.py

model: support NVILA and NVILA Lite (#10399)

2025-10-26 09:58:09 -07:00

olmo2.py

[Model] Add Olmo 3 model support (#11396)

2025-10-19 23:59:16 -07:00

olmo.py

…

olmoe.py

[6/N] MoE Refactor: Cleanup MoE-related configs (#8849)

2025-08-14 21:14:53 -07:00

opt.py

[lint] improve ruff check (#11922)

2025-10-22 11:32:50 +08:00

persimmon.py

…

phi3_small.py

…

phi4mm_audio.py

…

phi4mm_utils.py

…

phi4mm.py

[Lint] Add python/sglang to ruff F401 checks and remove unused imports in files (#11685)

2025-10-17 16:49:46 -07:00

phi.py

[Lint] Add python/sglang to ruff F401 checks and remove unused imports in files (#11685)

2025-10-17 16:49:46 -07:00

phimoe.py

[Lint] Add python/sglang to ruff F401 checks and remove unused imports in files (#11685)

2025-10-17 16:49:46 -07:00

pixtral.py

[Lint] Add python/sglang to ruff F401 checks and remove unused imports in files (#11685)

2025-10-17 16:49:46 -07:00

points_v15_chat.py

[model] Support POINTSV15Chat (#9651)

2025-10-22 16:58:17 +08:00

qwen2_5_vl.py

[smol] [perf] Inverse perm improvement (#11482)

2025-10-21 19:18:10 +08:00

qwen2_audio.py

[Lint] Add python/sglang to ruff F401 checks and remove unused imports in files (#11685)

2025-10-17 16:49:46 -07:00

qwen2_classification.py

…

qwen2_eagle.py

…

qwen2_moe.py

Eagle3 DP attention for Qwen3 MoE (#12002)

2025-10-29 20:25:17 +08:00

qwen2_rm.py

…

qwen2_vl.py

[Fix] Skip visual layers when applying LoRA to Qwen2VL modules (#11519)

2025-10-17 17:39:57 -05:00

qwen2.py

[FEAT] Shared mem pool based cuda ipc for multi-modal data transport (#11917)

2025-11-02 16:46:37 +08:00

qwen3_classification.py

Add support for Qwen3-seq-cls (#9357)

2025-08-20 16:51:56 -07:00

qwen3_moe.py

Eagle3 DP attention for Qwen3 MoE (#12002)

2025-10-29 20:25:17 +08:00

qwen3_next_mtp.py

Depreate global_server_args_dict (#11528)

2025-10-13 19:34:43 +08:00

qwen3_next.py

[NPU] bugfix for Qwen3-Next and performance update (#11969)

2025-10-30 21:52:16 +08:00

qwen3_omni_moe.py

model: qwen3-omni (thinker-only) (#10911)

2025-10-16 13:20:38 -07:00

qwen3_vl_moe.py

[Qwen3 VL] Add LoRA support for Qwen 3 VL (#12165)

2025-11-03 20:32:54 -08:00

qwen3_vl.py

[Qwen3 VL] Add LoRA support for Qwen 3 VL (#12165)

2025-11-03 20:32:54 -08:00

qwen3.py

[Bug fix][PP] fix deadlock with tie_word_embeddings (#12362)

2025-10-30 01:03:28 -07:00

qwen.py

[Lint] Add python/sglang to ruff F401 checks and remove unused imports in files (#11685)

2025-10-17 16:49:46 -07:00

registry.py

[Auto Sync] Update registry.py (20250915) (#10484)

2025-09-15 17:34:28 -07:00

roberta.py

Implement BGE-M3 Sparse Embeddings in SGLang (#10869)

2025-10-22 13:46:16 -07:00

sarashina2_vision.py

[Lint] Add python/sglang to ruff F401 checks and remove unused imports in files (#11685)

2025-10-17 16:49:46 -07:00

siglip.py

…

solar.py

Remove wrong imports from sglang.python (#10493)

2025-09-15 22:12:21 -07:00

stablelm.py

…

starcoder2.py

model: support starcoder2 (#10609)

2025-10-04 00:11:19 +08:00

step3_vl.py

[Lint] Add python/sglang to ruff F401 checks and remove unused imports in files (#11685)

2025-10-17 16:49:46 -07:00

torch_native_llama.py

Fix multimodal registry and code sync scripts (#10759)

2025-09-22 15:36:01 -07:00

transformers.py

Small bug fix in transformers model implementation (#9809)

2025-08-29 18:51:44 -07:00

utils.py

[smol] [perf] Inverse perm improvement (#11482)

2025-10-21 19:18:10 +08:00

xverse_moe.py

[6/N] MoE Refactor: Cleanup MoE-related configs (#8849)

2025-08-14 21:14:53 -07:00

xverse.py

…

yivl.py

…