Logo
Explore Help
Sign In
chenchenghao/sglang
Watch 1
Star 0
Fork 0
Code Issues Pull Requests Actions 11 Packages Projects Releases Wiki Activity
1,428 Commits 1 Branch 0 Tags
4a63c181f19015a0a8812b1fe5c33daf90ec8590
Commit Graph
9 Commits
Author SHA1 Message Date
Byron Hsu 0b46b951ae Fix rust warning (#2208) 2024-11-26 15:00:41 -08:00
Byron Hsu 4d62bca542 [router] Replace print with logger (#2183) 2024-11-25 13:36:02 -08:00
Byron Hsu 4b0a1c9365 Replace prob based with threshold based load balancing (#2170) 2024-11-24 23:17:11 -08:00
Byron Hsu bbb81c2457 Add more api routes (completion, health, etc) to the router (#2146) 2024-11-23 15:10:26 -08:00
Byron Hsu cbedd1db1d [router] cache-aware load-balancing router v1 (#2114) 2024-11-23 08:34:48 -08:00
Byron Hsu f9633fa9b9 [rust] cache-aware DP - approx tree (#1934) 2024-11-10 21:57:32 -08:00
Byron Hsu 96766101b4 [rust] refactor server and router (#1922) 2024-11-06 00:02:02 -08:00
Byron HsuandLianmin Zheng 530ff541cf [router] Impl radix tree and set up CI (#1893)
Co-authored-by: Lianmin Zheng <lianminzheng@gmail.com>
2024-11-04 10:56:52 -08:00
Byron Hsu 3839be2913 [Router] Add a rust-based router (#1790) 2024-10-28 09:49:48 -07:00
Powered by Gitea Version: 1.27.2 Page: 1010ms Template: 4ms
Auto
English
Bahasa Indonesia Deutsch English Español Français Gaeilge Italiano Latviešu Magyar nyelv Nederlands Polski Português de Portugal Português do Brasil Suomi Svenska Türkçe Čeština Ελληνικά Български Русский Українська فارسی മലയാളം 日本語 简体中文 繁體中文(台灣) 繁體中文(香港) 한국어
Licenses API