Ke Bao 6cb32ef92c Support Triton fp8 e5m2 kv cache (#1286) ...

Co-authored-by: Yineng Zhang <me@zhyncs.com>

2024-09-01 19:46:40 +10:00

..

fused_moe

Cleanup readme, llava examples, usage examples and nccl init (#1194)

2024-08-24 08:02:23 -07:00

activation.py

feat: replace GeluAndMul (#1234)

2024-08-28 14:07:02 +00:00

decode_attention.py

Cleanup readme, llava examples, usage examples and nccl init (#1194)

2024-08-24 08:02:23 -07:00

extend_attention.py

Support Triton fp8 e5m2 kv cache (#1286)

2024-09-01 19:46:40 +10:00

layernorm.py

feat: update GemmaRMSNorm (#1232)

2024-08-28 22:47:34 +10:00

logits_processor.py

Sampler cudagraph (#1253)

2024-08-28 18:58:52 -07:00

pooler.py

Add e5-mistral modules [unreachable code] - step 1/3 (#983)

2024-08-08 00:04:15 -07:00

prefill_attention.py

Clean up the comments and names under python/sglang/srt/layers (#1047)

2024-08-12 05:54:37 +00:00

radix_attention.py

[Feature] Support fp8 e5m2 kv cache with flashinfer (#1204)

2024-08-25 17:38:11 -07:00

sampler.py

Sampler cudagraph (#1253)

2024-08-28 18:58:52 -07:00