4 Commits

Author	SHA1	Message	Date
Lianmin Zheng	40b26b456b	Simplify the BatchMultimodalOutput in io_struct.py (#12993)	2025-11-10 13:54:56 -08:00
Lianmin Zheng	c7d57d5bb3	Fix CI and style (#12658)	2025-11-05 15:08:15 -08:00
harrisonlimh	14fdd52740	feat: add priority based scheduling with priority based request acceptance and preemption (#8746)	2025-09-16 17:10:10 -07:00
harrisonlimh	747dd45077	feat: throttle requests at scheduler based on --max_queued_requests (#7565)	2025-07-28 22:32:33 +08:00