Ke Bao 0ac94c36cb Fallback when sampling failed (#678)

2024-07-20 10:44:54 -07:00

..

controller

Fallback when sampling failed (#678)

2024-07-20 10:44:54 -07:00

detokenizer_manager.py

Fix jump forward when streaming (#665)

2024-07-19 16:42:06 -07:00

io_struct.py

Fix illegal tokens during sampling (#676)

2024-07-20 03:11:15 -07:00

tokenizer_manager.py

Support random dataset in bench_serving.py (#669)

2024-07-20 01:06:43 -07:00