elvischenv 9970ee34e8 Mistral Large 3 NVFP4 TRTLLM MoE support (#15049)

2025-12-18 11:11:42 +08:00

..

attention

Feature/trtllm mha workspace size configurable #15089 (#15131)

2025-12-17 17:07:23 -08:00

deep_gemm_wrapper

[Fix] Environment variable SGL_* is deprecated (#14943)

2025-12-13 19:55:43 -08:00

moe

Mistral Large 3 NVFP4 TRTLLM MoE support (#15049)

2025-12-18 11:11:42 +08:00

quantization

Mistral Large 3 NVFP4 TRTLLM MoE support (#15049)

2025-12-18 11:11:42 +08:00

activation.py

[Auto Sync] Update activation.py, logits_processor.py, rota... (20251107) (#12853)

2025-11-07 22:07:51 -08:00

amx_utils.py

[CPU] Optimize small oc GEMM for Qwen3-next on CPU (#12446)

2025-12-04 00:38:47 -08:00

communicator_nsa_cp.py

[NPU] adapt dsv3.2 nsa prefill context parallel (#14541)

2025-12-11 20:12:59 +08:00

communicator.py

[bugfix] fix TBO crashes when attn_tp_size > 1 (#13730)

2025-12-11 18:18:40 -08:00

dp_attention.py

(1/n)support context parallel with deepseekv3.2-DSA (#12065)

2025-11-16 20:12:25 -08:00

elementwise.py

[Code sync] Fix registration of some ops in grok & Fix oss sync scripts (#13990)

2025-11-26 13:11:52 -08:00

flashinfer_comm_fusion.py

Fix spec decoding acc length for dpsk-r1-fp4 tp8 (2nd attempt) (#12915)

2025-11-11 13:30:33 -08:00

layernorm.py

[CPU] Add Gemma3RMSNorm kernel in sgl-kernel and add ut (#9324)

2025-12-15 00:24:02 -08:00

linear.py

[NPU] optimization for dsv3.2 (#14572)

2025-12-12 14:52:16 +08:00

logits_processor.py

tiny unify environ usage (#15335)

2025-12-17 23:31:43 +08:00

model_parallel.py

Move parsers under a single folder (#9912)

2025-09-02 18:25:04 -07:00

modelopt_utils.py

Enable native ModelOpt quantization support (1/3) (#7149)

2025-10-06 13:24:15 -07:00

multimodal.py

[VLM] Improving multimodal tensor hash kernel (#9008)

2025-08-14 13:45:55 -07:00

parameter.py

fix: fp8 quantization failure of qwen 2.5 VL 7B model (#10112)

2025-09-27 05:05:23 +00:00

pooler.py

Support piecewise CUDA graph for embedding models (#13852)

2025-11-26 15:29:46 +08:00

radix_attention.py

Refactor KTransformers heterogeneous compute with unified GPU-quantization backend (#12834)

2025-11-09 21:06:32 -08:00

rocm_linear_utils.py

Aiter fp8 kv cache (#13147)

2025-12-08 16:39:53 -08:00

rotary_embedding.py

[VLM] Support cos sin cache for Qwen3-VL & GLM-4.1V (#15205)

2025-12-18 08:39:50 +08:00

sampler.py

[Ascend][Feat] Add Ascend sampling backend (#12692)

2025-11-15 21:59:58 +08:00

sparse_pooler.py

Implement BGE-M3 Sparse Embeddings in SGLang (#10869)

2025-10-22 13:46:16 -07:00

torchao_utils.py

clean up gemlite usage (#14444)

2025-12-04 21:52:56 -08:00

utils.py

[Lint] Add python/sglang to ruff F401 checks and remove unused imports in files (#11685)

2025-10-17 16:49:46 -07:00

vocab_parallel_embedding.py

CI: Kill zombie diffusion processes in CI & minor code style fix on rotary embedding fallback (#13637)

2025-11-20 21:57:01 +08:00