Yineng ZhangandWANDY666 ba5112ff69 feat: support moe_align_block_size_triton (#2712) ...

Co-authored-by: WANDY666 <1060304770@qq.com>

2025-01-02 21:47:44 +08:00

..

attention

Eagle speculative decoding part 3: small modifications to the general scheduler (#2709)

2025-01-02 02:09:08 -08:00

moe

feat: support moe_align_block_size_triton (#2712)

2025-01-02 21:47:44 +08:00

quantization

fix typo in python/sglang/srt/layers/quantization/fp8.py (#2655)

2024-12-29 23:45:02 -08:00

activation.py

docs: fix module docstrings and copyright headers (#2077)

2024-11-22 22:16:53 +08:00

custom_op_util.py

docs: fix module docstrings and copyright headers (#2077)

2024-11-22 22:16:53 +08:00

layernorm.py

docs: fix module docstrings and copyright headers (#2077)

2024-11-22 22:16:53 +08:00

linear.py

Refactor MoE (#2575)

2024-12-26 00:02:14 +08:00

logits_processor.py

Eagle speculative decoding part 2: Fix cuda graph + DP attention hanging (#2684)

2024-12-31 02:25:05 -08:00

pooler.py

Rename InputMetadata -> ForwardBatch (#1543)

2024-09-30 02:41:11 -07:00

radix_attention.py

[Minor] Improve code style (#2422)

2024-12-09 06:30:35 -08:00

rotary_embedding.py

docs: fix module docstrings and copyright headers (#2077)

2024-11-22 22:16:53 +08:00

sampler.py

Minor follow-up fixes for the logprob refactor (#2670)

2024-12-30 05:42:08 -08:00

torchao_utils.py

Add GemLite caching after each capture (#2669)

2024-12-30 05:27:29 -08:00

vocab_parallel_embedding.py

Revert "Revert "[FEAT] Support GGUF format"" (#2287)

2024-11-30 22:14:48 -08:00