Stefan He 4fff1ec1d9 Deterministic Mode: Add 1-stage triton kernel for prefill (#11147) ...

Co-authored-by: Minglei Zhu <mingleizhu1122@gmail.com>
Co-authored-by: Binyao Jiang <bijiang@linkedin.com>

2025-10-20 01:47:36 +08:00

..

attention

Deterministic Mode: Add 1-stage triton kernel for prefill (#11147)

2025-10-20 01:47:36 +08:00

deep_gemm_wrapper

[Refactor] move deep_gemm_wrapper out of quantization (#11784)

2025-10-17 18:57:54 -07:00

moe

Make single-batch overlap compatible with NextN (#11804)

2025-10-19 16:10:44 +08:00

quantization

Change bf16 to fp8 for some gemms in attention for DeepSeek ckpt v2 (#11805)

2025-10-19 16:15:13 +08:00

activation.py

[Lint] Add python/sglang to ruff F401 checks and remove unused imports in files (#11685)

2025-10-17 16:49:46 -07:00

amx_utils.py

[CPU] refine CPU integration code (#7647)

2025-07-03 09:51:09 -07:00

communicator.py

Depreate global_server_args_dict (#11528)

2025-10-13 19:34:43 +08:00

dp_attention.py

[Feat] Support Torch Symm Mem AllReduce (#10571)

2025-10-05 13:55:19 -07:00

elementwise.py

[Auto Sync] Update elementwise.py (20250923) (#10823)

2025-09-23 13:50:22 -07:00

flashinfer_comm_fusion.py

Support trtllm_allreduce_fusion in flashinfer for cuda<12.8 (#9339)

2025-08-20 16:54:30 -07:00

layernorm.py

[Lint] Add python/sglang to ruff F401 checks and remove unused imports in files (#11685)

2025-10-17 16:49:46 -07:00

linear.py

fix: fp8 quantization failure of qwen 2.5 VL 7B model (#10112)

2025-09-27 05:05:23 +00:00

logits_processor.py

Sync code and test CI; rename some env vars (#11686)

2025-10-15 18:37:03 -07:00

model_parallel.py

Move parsers under a single folder (#9912)

2025-09-02 18:25:04 -07:00

modelopt_utils.py

Enable native ModelOpt quantization support (1/3) (#7149)

2025-10-06 13:24:15 -07:00

multimodal.py

[VLM] Improving multimodal tensor hash kernel (#9008)

2025-08-14 13:45:55 -07:00

parameter.py

fix: fp8 quantization failure of qwen 2.5 VL 7B model (#10112)

2025-09-27 05:05:23 +00:00

pooler.py

Feat/support rerank (#6058)

2025-06-16 10:50:01 -07:00

radix_attention.py

Compilation Folder Reset (#11539)

2025-10-14 09:19:12 +08:00

rocm_linear_utils.py

Optimized deepseek-v3/r1 model performance on mxfp4 run (#10008)

2025-09-04 15:11:22 -07:00

rotary_embedding.py

Revert "Fix: Dynamic RoPE Cache Expansion to Prevent Position-ID Out-of-Bounds in EAGLE + Long-Sequence Workloads" (#11827)

2025-10-19 19:44:06 +08:00

sampler.py

Sync code and test CI; rename some env vars (#11686)

2025-10-15 18:37:03 -07:00

torchao_utils.py

…

utils.py

[Lint] Add python/sglang to ruff F401 checks and remove unused imports in files (#11685)

2025-10-17 16:49:46 -07:00

vocab_parallel_embedding.py

Revert "Revert the changes on NCCL symmetric memory" (#10238)

2025-09-09 12:11:49 -07:00