chenchenghao/sglang
1
0
Fork 0
Code Issues Pull Requests Actions 11 Packages Projects Releases Wiki Activity

Commit Graph

  • 7358fa64f7 Fix a bug in runtime backend Lianmin Zheng 2024-01-23 22:10:17 +00:00
  • 9a16fea012 Return logprob for choices (#87) Lianmin Zheng 2024-01-23 05:07:30 -08:00
  • 9e037c822c Update README.md Lianmin Zheng 2024-01-23 03:43:19 -08:00
  • 9076386d90 Fix SRT endpoint api json syntax (#84) 0xWe11es.eth 2024-01-23 16:25:26 +08:00
  • 959c4174b2 Fix the chat template for QWen (#83) Lianmin Zheng 2024-01-22 21:46:47 -08:00
  • 94e05770db Fix after QWen support (#82) Lianmin Zheng 2024-01-22 21:17:05 -08:00
  • 63e97e5e4c Suppport qwen model and solve some problems (#75) Arcmoon 2024-01-23 12:14:51 +08:00
  • e08bca2840 Support load fine-tuned LLaVA model (#80) isaac-vidas 2024-01-22 21:15:48 -05:00
  • cd3ccb2ed7 Add a note about triton version for older GPUs (#72) Lianmin Zheng 2024-01-21 16:51:45 -08:00
  • 3f5c2f4c4a Add an async example (#37) Ying Sheng 2024-01-21 15:17:30 -08:00
  • 007eeb4eb9 Fix the error message and dependency of openai backend (#71) Lianmin Zheng 2024-01-21 14:56:25 -08:00
  • e8f2b155fe Update README.md Ying Sheng 2024-01-21 02:45:58 -08:00
  • 723f042163 release v0.1.7 & fix bugs Lianmin Zheng 2024-01-21 10:31:02 +00:00
  • 585eababa1 Improve error message of openai Lianmin Zheng 2024-01-21 10:13:45 +00:00
  • cc3ada983f Bump version to 0.1.6 (#68) Lianmin Zheng 2024-01-21 01:45:02 -08:00
  • a837166e6f Fix select and normalized logprobs (#67) Lianmin Zheng 2024-01-21 01:39:23 -08:00
  • 11f3cca64f Fix select (#64) Lianmin Zheng 2024-01-20 23:20:35 -08:00
  • ca13f3b8c5 Disk FSM cache and adjust code. (#63) Liangsheng Yin 2024-01-21 13:26:11 +08:00
  • 0b2efc2adc Update README.md (#58) Ikko Eltociear Ashimine 2024-01-20 14:00:29 +09:00
  • f30abd090a Improve error message & Add vicuna template (#57) Lianmin Zheng 2024-01-19 17:03:33 -08:00
  • 40ab1f0129 Fix the possible bug of decode out of memory (#36) Liangsheng Yin 2024-01-20 03:01:15 +08:00
  • 199e82a15d Format code & Improve readme (#52) Lianmin Zheng 2024-01-18 23:51:19 -08:00
  • 23471f9aa3 Support v1/chat/completions (#50) Cody Yu 2024-01-18 23:43:09 -08:00
  • 61d4c93962 Support stream=True in v1/completions (#49) Cody Yu 2024-01-18 17:00:56 -08:00
  • 98a3e8ef78 Add a llava example (#47) Lianmin Zheng 2024-01-18 13:46:38 -08:00
  • 2b079f8931 Increase interpreter parallelism (#46) Lianmin Zheng 2024-01-18 13:30:10 -08:00
  • 05b4c398df Document sampling parameters (#45) Lianmin Zheng 2024-01-18 11:49:27 -08:00
  • dafafe5b11 Use HTTP link in 3rdparty module (#42) Cody Yu 2024-01-18 11:18:22 -08:00
  • b240f75100 Add a parallel sampling case (#34) Lianmin Zheng 2024-01-17 22:26:32 -08:00
  • 501f944445 Bump version to 0.1.5 (#33) Lianmin Zheng 2024-01-17 21:14:31 -08:00
  • 22ec7bc2a1 Expose more arguments to control the scheduling policy (#32) Lianmin Zheng 2024-01-17 18:37:02 -08:00
  • c0454b323c Add option to return metadata in async streaming (#18) Christopher Chou 2024-01-17 18:15:02 -08:00
  • 8024fc5eec Fix streaming (#30) Lianmin Zheng 2024-01-17 16:38:20 -08:00
  • 70528762bf update readme Lianmin Zheng 2024-01-17 10:42:55 -08:00
  • 71d30d6ddc Update README.md Ying Sheng 2024-01-17 09:49:53 -08:00
  • f9d723816a Teak mem fraction (#20) Lianmin Zheng 2024-01-17 04:43:17 -08:00
  • bf51ddc6e5 Improve docs & Rename Gemini -> VertexAI (#19) Lianmin Zheng 2024-01-17 02:54:41 -08:00
  • fd7c479239 Gemini Backend (#9) shiyi.c_98 2024-01-16 22:29:37 -08:00
  • c4707f1bb5 Improve docs (#17) Lianmin Zheng 2024-01-16 19:53:55 -08:00
  • ffe4aaee1d Fix for T4 GPUs (#16) Ying Sheng 2024-01-16 15:49:03 -08:00
  • 5b27a1dce4 Rename image_url to image_file (#15) Christopher Chou 2024-01-16 15:41:30 -08:00
  • e71d4ab3f9 Update docs (#12) Lianmin Zheng 2024-01-16 04:18:54 -08:00
  • fbf42263f1 Update Readme (#11) Lianmin Zheng 2024-01-16 02:46:27 -08:00
  • 2ccd9fd8c5 update version to 0.1.3 Lianmin Zheng 2024-01-16 05:55:25 +00:00
  • 46b7ea7c85 Improve Readme (#10) Lianmin Zheng 2024-01-15 21:37:11 -08:00
  • 70359bf31a Update benchmark scripts (#8) Lianmin Zheng 2024-01-15 16:12:57 -08:00
  • 01ca82d765 fix radix cache match (#7) Liangsheng Yin 2024-01-16 01:42:46 +08:00
  • 4bd8233f2c Fix test cases (#6) Lianmin Zheng 2024-01-15 01:15:53 -08:00
  • 08ab2a1655 Json Decode && Mutl-Turns (#4) Liangsheng Yin 2024-01-15 16:49:29 +08:00
  • f652494df1 fix typo hnyls2002 2024-01-10 04:21:17 +00:00
  • 30720e732c Add install with pip (#3) Lianmin Zheng 2024-01-09 12:43:40 -08:00
  • 331848de9d Add SRT json decode example (#2) Liangsheng Yin 2024-01-10 04:35:44 +08:00
  • 93eeb543ba Update readme.md Lianmin Zheng 2024-01-08 21:20:23 +00:00
  • ead5b39f82 Add flashinfer && Oultines (#1) Liangsheng Yin 2024-01-09 00:26:18 +08:00
  • 22085081bb release initial code Lianmin Zheng 2024-01-08 04:37:50 +00:00
  • f6d40df0ee Initial commit Ying Sheng 2023-10-09 15:41:15 -07:00