Commit Graph
20 Commits
Author SHA1 Message Date
Praneth ParuchuriandYuhao Yang 9bb1260558 [Feature] Support file:// URL format for multimodal inputs (#14490)
Co-authored-by: Yuhao Yang <47235274+yhyang201@users.noreply.github.com>
2026-01-31 23:44:44 -08:00
Praneth Paruchuri 6f009961bb [model-gateway] Optimize HashRing construction to reduce heap allocations (#17575) 2026-01-27 22:46:40 -08:00
Praneth Paruchuri 897c35b457 [model-gateway] Optimize consistent hashing hot path to eliminate allocations (#17467) 2026-01-27 22:46:11 -08:00
Praneth Paruchuri 8c2d8b51e9 [model-gateway] fix wasm example2 (#17244) 2026-01-25 22:45:36 -08:00
Praneth Paruchuri 02c1dabf5d [model-gateway] fix wasm example3 (#17277) 2026-01-25 22:45:21 -08:00
Praneth Paruchuri 511961870f [model-gateway] Optimize WASM cache lookups using SHA-256 (#17344) 2026-01-25 22:44:55 -08:00
Praneth Paruchuriandgemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com> fc7096f80b [model-gateway] Optimize special token search using Aho-Corasick (#17387)
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
2026-01-25 13:54:15 -08:00
Praneth Paruchurigemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>Simo Lin
250477d2ac [model-gateway] Optimize L1 cache insertion with incremental hashing and tokenization (#16259)
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: Simo Lin <linsimo.mark@gmail.com>
2026-01-13 06:24:25 -08:00
Praneth Paruchuri af1232b2f2 [model-gateway] fix wasm example (#16924) 2026-01-13 06:21:47 -08:00
Praneth Paruchuri bd1afeb568 [model-gateway] Restore response streaming by optimizing WASM middleware buffering (#16804) 2026-01-09 09:29:22 -08:00
Praneth Paruchuri b12258bfaa [model-gateway] Optimize HTTP Router Fan-out: Replace Serial Execution with Concurrent Streams (#16042) 2026-01-04 23:38:45 -08:00
Praneth Paruchuri 370bd27f3a [model-gateway] Implement Zero-Copy Vision Tensor Access (#15750) 2025-12-24 09:15:44 -08:00
Praneth Paruchuri 80ae2229d3 [model-gateway] Optimize router selection with lock-free snapshots (#15672) 2025-12-23 09:09:30 -08:00
Praneth Paruchuri 537ef18d17 [model-gateway] Optimize WASM Runtime with Instance Pooling and Component Caching (#15515) 2025-12-20 10:27:02 -10:00
Praneth Paruchuri bab20a849e [model-gateway] Parallelize metrics requests (#14953) 2025-12-14 15:38:45 -08:00
Praneth Paruchuri 1834401e7c [model-gateway] optimize worker selection (#14894) 2025-12-11 21:15:12 -08:00
Praneth Paruchuri e99ee0c695 [model-gateway] Fix incompatible metric comparison in PowerOfTwo policy (#14823) 2025-12-10 11:15:38 -08:00
Praneth Paruchuri 665f43bdd8 model: support teleflm (#10573) 2025-11-15 03:14:49 +08:00
Praneth Paruchuri a53f2d6c12 Support orion (#10665) 2025-11-15 03:08:32 +08:00
Praneth Paruchuri fad7ca73f8 model: support starcoder2 (#10609) 2025-10-04 00:11:19 +08:00