4 Commits

Include renames

Author	SHA1	Message	Date
Lianmin Zheng	36d5acfca5	Rename InputMetadata -> ForwardBatch (#1543)	2024-09-30 02:41:11 -07:00
Lianmin Zheng	3f0fe08d37	Let ModelRunner take InputMetadata as input, instead of ScheduleBatch (#1541)	2024-09-29 20:28:45 -07:00
Lianmin Zheng	f86c1e611f	Move scheduler code from tp_worker.py to scheduler.py (#1538)	2024-09-29 17:42:45 -07:00
Lianmin Zheng	048685430d	Improve process creation (#1534)	2024-09-29 02:36:12 -07:00