5 people fd16c91cb8 Handle Marlin weight restoration and shape recording (QAT INT4 Rollout Part1) (#15238) ...

Co-authored-by: Gao016 <yngao016@163.com>
Co-authored-by: yefei12 <xjtu_yefeichen@163.com>
Co-authored-by: yzlnew <yzlnew@gmail.com>
Co-authored-by: Peng Zhang <aniz1905@gmail.com>

2026-01-07 21:11:24 +08:00

..

attention

Only allocate encoder metadata for encoder-decoder models (#16527)

2026-01-06 22:17:04 -08:00

deep_gemm_wrapper

[fix]deepgemm precompile when warmup (#15891)

2025-12-28 13:47:39 +08:00

moe

[JIT kernel] Apply jit per_tensor_quant_fp8 kernel (#15836)

2026-01-05 10:15:00 +08:00

quantization

Handle Marlin weight restoration and shape recording (QAT INT4 Rollout Part1) (#15238)

2026-01-07 21:11:24 +08:00

utils

[Refactor] Rename CustomOp -> MultiPlatformOp (#16175)

2025-12-31 01:16:32 +08:00

activation.py

[Refactor] Rename CustomOp -> MultiPlatformOp (#16175)

2025-12-31 01:16:32 +08:00

amx_utils.py

[CPU] Optimize small oc GEMM for Qwen3-next on CPU (#12446)

2025-12-04 00:38:47 -08:00

communicator_nsa_cp.py

[DeepSeek v3.2] opt Context Parallelism: support fused moe, multi batch and fp8 kvcache (#13959)

2026-01-02 23:49:14 +08:00

communicator.py

[DeepSeek v3.2] opt Context Parallelism: support fused moe, multi batch and fp8 kvcache (#13959)

2026-01-02 23:49:14 +08:00

dp_attention.py

[Refactor] Clean up custom op (#15995)

2026-01-01 21:41:56 +08:00

elementwise.py

[Refactor] Clean up custom op (#15995)

2026-01-01 21:41:56 +08:00

flashinfer_comm_fusion.py

[Refactor] Clean up custom op (#15995)

2026-01-01 21:41:56 +08:00

layernorm.py

[minor] reduce 1 unnecessary add (#16474)

2026-01-05 01:00:56 -08:00

linear.py

[Feature] Xiaomi MiMo-V2-Flash day0 support (#15207)

2025-12-19 11:40:07 +08:00

logits_processor.py

Support returning customized info (#16144)

2026-01-02 15:32:18 +08:00

model_parallel.py

[Refactor] Rename CustomOp -> MultiPlatformOp (#16175)

2025-12-31 01:16:32 +08:00

modelopt_utils.py

Enable native ModelOpt quantization support (1/3) (#7149)

2025-10-06 13:24:15 -07:00

multimodal.py

[VLM] Improving multimodal tensor hash kernel (#9008)

2025-08-14 13:45:55 -07:00

parameter.py

fix: fp8 quantization failure of qwen 2.5 VL 7B model (#10112)

2025-09-27 05:05:23 +00:00

pooler.py

Support piecewise CUDA graph for embedding models (#13852)

2025-11-26 15:29:46 +08:00

radix_attention.py

[Refactor] Clean up custom op (#15995)

2026-01-01 21:41:56 +08:00

rocm_linear_utils.py

Aiter fp8 kv cache (#13147)

2025-12-08 16:39:53 -08:00

rotary_embedding.py

[Performance] Optimze the performance of Qwen25VL (#15640)

2026-01-02 23:15:36 -08:00

sampler.py

[1 / N] Clean up logprob utils (#15509)

2025-12-22 03:12:25 +08:00

sparse_pooler.py

Implement BGE-M3 Sparse Embeddings in SGLang (#10869)

2025-10-22 13:46:16 -07:00

torchao_utils.py

clean up gemlite usage (#14444)

2025-12-04 21:52:56 -08:00

vocab_parallel_embedding.py

CI: Kill zombie diffusion processes in CI & minor code style fix on rotary embedding fallback (#13637)

2025-11-20 21:57:01 +08:00