 Juwan Yoo
|
502524e2da
|
compressed_tensors: port w8a16 fp8 from vllm (#4852)
|
2025-04-20 17:48:31 -07:00 |
|
|
Juwan Yoo
|
7907f9eb20
|
test: reduce mem_fraction_static for gemma3 vision test (#4840)
|
2025-03-27 23:20:10 -07:00 |
|
|
Juwan Yoo
|
188105a21b
|
deps: lazy import optional dependencies gguf and torchvision (#4826)
|
2025-03-27 14:35:36 -07:00 |
|
|
Juwan Yoo
|
0bc0bf5734
|
gemma3: impl get_attention_sliding_window_size for attn init (#4823)
|
2025-03-27 10:43:58 -07:00 |
|
|
Juwan Yoo
|
d8476818ef
|
feat: allow streaming for multi-prompt and/or parallel sampling (#1134)
|
2024-08-20 08:06:55 -07:00 |
|
|
Juwan Yoo
|
10bca45bc6
|
bugfix: penalizers to be merged before reqs (#1001)
|
2024-08-09 21:46:24 +10:00 |
|
|
Juwan Yoo
|
95a28019ba
|
test: negative value testing for frequency, presence penalizers (#995)
|
2024-08-08 23:30:50 -07:00 |
|