Liangsheng Yin a5a134f39f Fix bugs in sampler with CUDA graph / torch.compile (#1306)

2024-09-02 23:18:48 +00:00

..

fused_moe

Cleanup readme, llava examples, usage examples and nccl init (#1194)

2024-08-24 08:02:23 -07:00

activation.py

feat: replace GeluAndMul (#1234)

2024-08-28 14:07:02 +00:00

decode_attention.py

Cleanup readme, llava examples, usage examples and nccl init (#1194)

2024-08-24 08:02:23 -07:00

extend_attention.py

[triton] Remove the zero initialization of qk_acc by directly writing the result (#1288)

2024-09-01 03:12:06 -07:00

layernorm.py

feat: update GemmaRMSNorm (#1232)

2024-08-28 22:47:34 +10:00

logits_processor.py

Sampler cudagraph (#1253)

2024-08-28 18:58:52 -07:00

pooler.py

Add e5-mistral modules [unreachable code] - step 1/3 (#983)

2024-08-08 00:04:15 -07:00

prefill_attention.py

Clean up the comments and names under python/sglang/srt/layers (#1047)

2024-08-12 05:54:37 +00:00

radix_attention.py

[Feature] Support fp8 e5m2 kv cache with flashinfer (#1204)

2024-08-25 17:38:11 -07:00

sampler.py

Fix bugs in sampler with CUDA graph / torch.compile (#1306)

2024-09-02 23:18:48 +00:00