Commit Graph
11 Commits
Author SHA1 Message Date
Chang Su 4229de3b13 [model-gateway] Refine TokenizerRegisty.load() to handle duplication (#17230) 2026-01-16 13:53:21 -08:00
Praneth Paruchurigemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>Simo Lin
250477d2ac [model-gateway] Optimize L1 cache insertion with incremental hashing and tokenization (#16259)
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: Simo Lin <linsimo.mark@gmail.com>
2026-01-13 06:24:25 -08:00
Chang Su b98bd9a5fb [model-gateway] Tighten visibility in modules and remove unused re-exports (#16524) 2026-01-05 17:38:50 -08:00
Chang Su d8ac5eecf7 [model-gateway] bug fix on module name (#16332) 2026-01-02 21:56:18 -08:00
Simo Lin c31f62722c [model-gateway] fix tokenizer to match transformers special token handling (#16087) 2025-12-29 08:13:03 -08:00
Simo Lin 643aeefe6d [model-gateway] Fix logging module name, parse endpoint context, and tokenizer factory (#15782) 2025-12-24 10:54:48 -08:00
Simo Lin 846953d9f1 [model-gateway] Add tokenize/detokenize HTTP endpoints and tokenizer management (#15702) 2025-12-23 17:32:07 -08:00
Arthur Cheng dd620987d1 [model-gateway] Replace tokenizer with tokenizer registry for dynamic tokenizer loading in gRPC router (#12968) 2025-12-23 07:58:47 -08:00
Simo Lin ba72e759ca [model-gateway] Improve logging across core modules (#15497) 2025-12-19 13:35:28 -08:00
Simo Lin 73df7a4e8d [SMG] perf: optimize tokenizer for reduced CPU and memory overhead (#14752) 2025-12-09 11:41:13 -08:00
Simo Lin 49dfa1d891 [model-gateway] change sgl-router to sgl-model-gateway (#14312) 2025-12-05 12:04:48 -08:00