Commit Graph
13 Commits
Author SHA1 Message Date
DarkSharpness 86a0be65d8 [Feature] Support custom set kv buffer kernel (#8884) 2025-08-12 16:56:51 -07:00
DarkSharpness b4ac2b9c0c [Fix] Fix dual chunk model default behavior (#9032) 2025-08-11 23:50:23 -07:00
DarkSharpness 7ba5ad5766 [Fix] Fix flashinfer cpu <-> gpu synchronization (#8340) 2025-08-10 03:11:40 +00:00
DarkSharpness 19bc77f05c [Fix] Fix hicache backend (#8991) 2025-08-09 17:16:25 -07:00
DarkSharpness fc42ff7b63 [Fix] Fix wrong backend chosen in hybrid backend (#8989) 2025-08-08 21:21:17 -07:00
DarkSharpness e273aa6dcf [Feature] Radix Tree in C++ (#7369) 2025-08-02 19:50:14 -07:00
DarkSharpnessandZhiqiang Xie 47367b768d [Refactor] Clean up radix cache related API (#7303)
Co-authored-by: Zhiqiang Xie <xiezhq@stanford.edu>
2025-06-20 00:58:48 +08:00
DarkSharpness ac3fae8445 [Feature] Support "strict" in function calling (#4310) 2025-03-24 22:15:25 -07:00
DarkSharpness 19120f71f3 [Fix & Style] Refactor the grammar backend to reduce human errors and improve readability (#4030) 2025-03-04 03:56:45 -08:00
DarkSharpness 9c745d078e [Performance] Update xgrammar-related constrained decoding (#2056) 2024-11-17 16:58:49 -08:00
DarkSharpness 954f4e6bd6 benchmark json schema (#2030) 2024-11-15 05:06:19 -08:00
DarkSharpnessandLianmin Zheng 125b1199c5 support parallel grammar preprocessing (#1996)
Co-authored-by: Lianmin Zheng <lianminzheng@gmail.com>
2024-11-12 08:45:28 -08:00
DarkSharpness b77a02cdfd [Performance] Support both xgrammar and outlines for constrained decoding (#1752) 2024-10-25 21:47:02 +00:00