Lianmin Zheng 2b80978859 Provide an argument to set the maximum batch size for cuda graph (#1809)

2024-10-26 15:09:33 -07:00

..

data_parallel_controller.py

Fix possible ZMQ hanging (#1800)

2024-10-25 23:07:07 -07:00

detokenizer_manager.py

Fix possible ZMQ hanging (#1800)

2024-10-25 23:07:07 -07:00

image_processor.py

fix int conversion for SGLANG_CPU_COUNT (#1803)

2024-10-26 00:09:44 -07:00

io_struct.py

[Fix] Fix --skip-tokenizer-init (#1798)

2024-10-25 18:51:59 -07:00

schedule_batch.py

[Performance] Support both xgrammar and outlines for constrained decoding (#1752)

2024-10-25 21:47:02 +00:00

schedule_policy.py

Provide an argument to set the maximum batch size for cuda graph (#1809)

2024-10-26 15:09:33 -07:00

scheduler.py

Fix possible ZMQ hanging (#1800)

2024-10-25 23:07:07 -07:00

tokenizer_manager.py

Fix possible ZMQ hanging (#1800)

2024-10-25 23:07:07 -07:00

tp_worker_overlap_thread.py

Fix logprob in the overlapped mode (#1795)

2024-10-25 11:06:57 -07:00

tp_worker.py

Update max_req_len and max_req_input_len (#1748)

2024-10-21 16:12:04 -07:00