intervitens 068e9eae55 Support min-p sampling (#1167)

2024-08-21 22:49:32 +00:00

..

controller_multi.py

Improve multi-node stability (#1171)

2024-08-20 22:35:05 -07:00

controller_single.py

Improve multi-node stability (#1171)

2024-08-20 22:35:05 -07:00

detokenizer_manager.py

[Feat] Support update weights without restart server (#1157)

2024-08-20 13:48:24 -07:00

io_struct.py

[Feat] Support update weights without restart server (#1157)

2024-08-20 13:48:24 -07:00

policy_scheduler.py

Mixed style of chunked prefill (#1013)

2024-08-16 09:13:00 +00:00

schedule_batch.py

Support min-p sampling (#1167)

2024-08-21 22:49:32 +00:00

tokenizer_manager.py

[Feat] Support update weights without restart server (#1157)

2024-08-20 13:48:24 -07:00

tp_worker.py

Improve multi-node stability (#1171)

2024-08-20 22:35:05 -07:00