14 Commits

This Branch

This Branch

All Branches

Author	SHA1	Message	Date
Liangsheng Yin	26f0bedc8f	jump-forward rename (#144)	2024-02-05 16:50:37 +08:00
Liangsheng Yin	bb3a3b6675	Support Faster JSON decoding for llava (#137) ... When sending fast-forwarded reqs to model_rpc, re-calculate `pad_input_ids`	2024-02-03 23:32:05 +08:00
Liangsheng Yin	cd8c3ccd95	Fix is_multimodal_model judge (#132)	2024-02-03 11:48:01 +08:00
hnyls2002	9c121f2a45	minor fix: result dump format	2024-02-02 09:58:24 +00:00
Liangsheng Yin	79cb018e4b	Add city doc benchmark mode (#129)	2024-02-01 13:38:47 +08:00
Liangsheng Yin	81561f8e2d	Flush Cache API (#103)	2024-01-25 21:32:59 -08:00
Liangsheng Yin	01ee0fbc05	fast regex decode ... Auto-detect constant str path in regex FSM, then extend instead.	2024-01-25 01:16:25 +08:00
Liangsheng Yin	ca13f3b8c5	Disk FSM cache and adjust code. (#63)	2024-01-20 21:26:11 -08:00
Liangsheng Yin	40ab1f0129	Fix the possible bug of decode out of memory (#36)	2024-01-19 11:01:15 -08:00
Liangsheng Yin	01ca82d765	fix radix cache match (#7)	2024-01-15 09:42:46 -08:00
Liangsheng Yin	08ab2a1655	Json Decode && Mutl-Turns (#4)	2024-01-15 00:49:29 -08:00
hnyls2002	f652494df1	fix typo	2024-01-10 04:21:17 +00:00
Liangsheng Yin	331848de9d	Add SRT json decode example (#2)	2024-01-09 12:35:44 -08:00
Liangsheng Yin	ead5b39f82	Add flashinfer && Oultines (#1)	2024-01-08 08:26:18 -08:00