4 Commits

Author	SHA1	Message	Date
fzyzcjy	249c356331	Super tiny update tokenizer benchmark (#16429)	2026-01-05 09:14:52 +08:00
fzyzcjy	387fad2f74	Tiny add detokenization benchmarks (#16400)	2026-01-04 22:53:38 +08:00
Lifu Huang	6e2da51561	Replace time.time() to time.perf_counter() for benchmarking. (#6178) ... Signed-off-by: Lifu Huang <lifu.hlf@gmail.com>	2025-05-11 14:32:49 -07:00
Sundara Raman Ramachandran	f08154193c	Perform Batch Tokenization. (#5141)	2025-04-20 18:10:37 -07:00