Xiaoyu Zhang e9c6ce461d sgl scaled_fp8_quant support output padding (#4861)

2025-04-02 23:53:57 +08:00

..

attention

use fa3 in sgl-kernel (#4954)

2025-03-31 16:14:49 -07:00

moe

[Feature] Support DeepEP Low Latency (#4767)

2025-04-01 09:23:25 -07:00

quantization

sgl scaled_fp8_quant support output padding (#4861)

2025-04-02 23:53:57 +08:00

activation.py

cleanup deps 2/n (#4464)

2025-03-15 23:06:17 -07:00

dp_attention.py

Support (1 <= dp < tp) in the dp attention in DeepEP (#4770)

2025-03-27 17:09:35 -07:00

elementwise.py

Add some fused elementwise kernels for grok-1 (#4398)

2025-03-13 13:39:10 -07:00

layernorm.py

Urgent model support: support gemma-3-it (#4424)

2025-03-16 17:37:32 -07:00

linear.py

Support compressed tensors fp8w8a8 (#4743)

2025-03-26 13:21:25 -07:00

logits_processor.py

Reduce computation and communication in DP attention (#4521)

2025-03-18 13:41:36 -07:00

parameter.py

[Feature] Integrate DeepEP into SGLang (#4232)

2025-03-19 08:16:31 -07:00

pooler.py

Rename InputMetadata -> ForwardBatch (#1543)

2024-09-30 02:41:11 -07:00

radix_attention.py

[QUANT] Add GPTQModel Dynamic Quantization + lm_head Quantization (#3790)

2025-03-05 01:11:00 -08:00

rotary_embedding.py

Revert PR 4764 & 4813 related to R1 RoPE (#4959)

2025-03-31 20:56:58 -07:00

sampler.py

Remove redundant type conversion (#4513)

2025-03-17 05:57:35 -07:00

torchao_utils.py

Support loading of larger models with on-the-fly quantization (#3061)

2025-01-22 21:33:17 -08:00

vocab_parallel_embedding.py

Clean up fp8 support (#4230)

2025-03-09 21:46:35 -07:00