 DarkSharpnessandXiaoyu Zhang
|
2dd9196079
|
[JIT Kernel][Feature] Support JIT custom all reduce (rewrite as v2) (#19880)
Co-authored-by: Xiaoyu Zhang <35585791+BBuf@users.noreply.github.com>
|
2026-03-20 18:24:07 +08:00 |
|
|
DarkSharpnessandgemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
|
d8d0208c63
|
[Feature] rewrite rope kernel; remove flashinfer dependencies (#18844)
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
|
2026-02-21 21:32:40 +08:00 |
|
|
DarkSharpness
|
52852404c8
|
[Fix] DO NOT skip save_kv_cache for dllm (#19020)
|
2026-02-20 23:20:29 +08:00 |
|
|
DarkSharpness
|
9d138685c1
|
[Refactor] Fix test and clean up hicache code (#18555)
|
2026-02-18 14:37:46 +08:00 |
|
|
DarkSharpness
|
8e2e835c2f
|
[Fix] Fix backend selection after flashinfer version update (#18364)
|
2026-02-08 11:20:41 +08:00 |
|
|
DarkSharpness
|
95f59c13fd
|
[Chore] include all jit files in building packages (#17493)
|
2026-01-21 14:48:02 -08:00 |
|
|
|
ba9f6d8f26
|
[Refactor] Clean up JIT kernel utilites (#16884)
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: Xiaoyu Zhang <35585791+BBuf@users.noreply.github.com>
|
2026-01-13 17:54:16 +08:00 |
|
|
DarkSharpness
|
d112f6a25b
|
[Feature] Support JIT set kv cache (#16273)
|
2026-01-10 17:34:09 -08:00 |
|
|
DarkSharpness
|
da2f8cc33f
|
[minor] reduce 1 unnecessary add (#16474)
|
2026-01-05 01:00:56 -08:00 |
|
|
DarkSharpness
|
f6f7af4068
|
[Refactor] Clean up custom op (#15995)
|
2026-01-01 21:41:56 +08:00 |
|
|
DarkSharpness
|
a3b1e8ef3d
|
[Feature] add aligned_vector type for JIT kernel (#16162)
|
2026-01-01 21:40:05 +08:00 |
|
|
DarkSharpness
|
45f3ad2f52
|
[Refactor] Rename CustomOp -> MultiPlatformOp (#16175)
|
2025-12-31 01:16:32 +08:00 |
|
|
DarkSharpness
|
8e43980ebb
|
[Feature] JIT Fused QK norm + qk norm clean up (#15835)
|
2025-12-28 11:53:50 +08:00 |
|
|
DarkSharpness
|
291f11ae39
|
[Minor] Enhance JIT kernel and add dev docs (#14570)
|
2025-12-23 22:34:59 +08:00 |
|
|
DarkSharpness
|
f03bfa4ce3
|
[Feature] Fuse mrope all in 1 kernel (#14906)
|
2025-12-15 02:50:55 -08:00 |
|
|
DarkSharpness
|
c1dd9a9599
|
[Fix] JIT kernel dependencies in other platforms (#13889)
|
2025-11-24 23:19:17 -08:00 |
|
|
DarkSharpness
|
ac5505b04c
|
[Feature] HiCache JIT kernel (once again) (#13764)
|
2025-11-22 22:19:16 -08:00 |
|
|
DarkSharpness
|
b51f9bbee7
|
[Feature] Introduce JIT Kernel in sglang (with hicache JIT kernel) (#13453)
|
2025-11-20 00:03:32 -08:00 |
|
|
DarkSharpness
|
f969664172
|
[Performance] Move the contiguous to torch compile region (#13199)
|
2025-11-15 20:49:52 -08:00 |
|
|
DarkSharpness
|
e8b71445c0
|
[Misc] Improve the error message of failed import (#12119)
|
2025-10-25 12:09:05 -07:00 |
|
|
DarkSharpness
|
276e7b3e4e
|
[Feature] New structural tag support (#10691)
|
2025-10-20 18:25:58 +08:00 |
|
|
DarkSharpness
|
e28c9e526f
|
[Minor] Update xgrammar dependency (#11622)
|
2025-10-14 13:46:50 -07:00 |
|
|
DarkSharpness
|
832c84fba9
|
[Chore] Update xgrammar 0.1.24 -> 0.1.25 (#10710)
|
2025-10-07 18:22:28 -07:00 |
|
|
DarkSharpnessandBaizhou Zhang
|
e0b2d3eebe
|
[Feature] Add a fast-topk to sgl-kernel for DeepSeek v3.2 (#11194)
Co-authored-by: Baizhou Zhang <sobereddiezhang@gmail.com>
|
2025-10-05 10:19:03 -07:00 |
|
|
DarkSharpnessandZhiqiang Xie
|
948b01a04c
|
[Refactor] Remove Hicache Load & Write threads (#10127)
Co-authored-by: Zhiqiang Xie <xiezhq@stanford.edu>
|
2025-09-08 22:18:50 -07:00 |
|
|
DarkSharpness
|
067246830d
|
[Minor] fix lint in main (#10128)
|
2025-09-07 17:36:46 +08:00 |
|
|
DarkSharpness
|
86a0be65d8
|
[Feature] Support custom set kv buffer kernel (#8884)
|
2025-08-12 16:56:51 -07:00 |
|
|
DarkSharpness
|
b4ac2b9c0c
|
[Fix] Fix dual chunk model default behavior (#9032)
|
2025-08-11 23:50:23 -07:00 |
|
|
DarkSharpness
|
7ba5ad5766
|
[Fix] Fix flashinfer cpu <-> gpu synchronization (#8340)
|
2025-08-10 03:11:40 +00:00 |
|
|
DarkSharpness
|
19bc77f05c
|
[Fix] Fix hicache backend (#8991)
|
2025-08-09 17:16:25 -07:00 |
|
|
DarkSharpness
|
fc42ff7b63
|
[Fix] Fix wrong backend chosen in hybrid backend (#8989)
|
2025-08-08 21:21:17 -07:00 |
|
|
DarkSharpness
|
e273aa6dcf
|
[Feature] Radix Tree in C++ (#7369)
|
2025-08-02 19:50:14 -07:00 |
|
|
DarkSharpnessandZhiqiang Xie
|
47367b768d
|
[Refactor] Clean up radix cache related API (#7303)
Co-authored-by: Zhiqiang Xie <xiezhq@stanford.edu>
|
2025-06-20 00:58:48 +08:00 |
|
|
DarkSharpness
|
ac3fae8445
|
[Feature] Support "strict" in function calling (#4310)
|
2025-03-24 22:15:25 -07:00 |
|
|
DarkSharpness
|
19120f71f3
|
[Fix & Style] Refactor the grammar backend to reduce human errors and improve readability (#4030)
|
2025-03-04 03:56:45 -08:00 |
|
|
DarkSharpness
|
9c745d078e
|
[Performance] Update xgrammar-related constrained decoding (#2056)
|
2024-11-17 16:58:49 -08:00 |
|
|
DarkSharpness
|
954f4e6bd6
|
benchmark json schema (#2030)
|
2024-11-15 05:06:19 -08:00 |
|
|
DarkSharpnessandLianmin Zheng
|
125b1199c5
|
support parallel grammar preprocessing (#1996)
Co-authored-by: Lianmin Zheng <lianminzheng@gmail.com>
|
2024-11-12 08:45:28 -08:00 |
|
|
DarkSharpness
|
b77a02cdfd
|
[Performance] Support both xgrammar and outlines for constrained decoding (#1752)
|
2024-10-25 21:47:02 +00:00 |
|