DarkSharpness
|
f03bfa4ce3
|
[Feature] Fuse mrope all in 1 kernel (#14906)
|
2025-12-15 02:50:55 -08:00 |
|
DarkSharpness
|
c1dd9a9599
|
[Fix] JIT kernel dependencies in other platforms (#13889)
|
2025-11-24 23:19:17 -08:00 |
|
DarkSharpness
|
ac5505b04c
|
[Feature] HiCache JIT kernel (once again) (#13764)
|
2025-11-22 22:19:16 -08:00 |
|
DarkSharpness
|
b51f9bbee7
|
[Feature] Introduce JIT Kernel in sglang (with hicache JIT kernel) (#13453)
|
2025-11-20 00:03:32 -08:00 |
|
DarkSharpness
|
f969664172
|
[Performance] Move the contiguous to torch compile region (#13199)
|
2025-11-15 20:49:52 -08:00 |
|
DarkSharpness
|
e8b71445c0
|
[Misc] Improve the error message of failed import (#12119)
|
2025-10-25 12:09:05 -07:00 |
|
DarkSharpness
|
276e7b3e4e
|
[Feature] New structural tag support (#10691)
|
2025-10-20 18:25:58 +08:00 |
|
DarkSharpness
|
e28c9e526f
|
[Minor] Update xgrammar dependency (#11622)
|
2025-10-14 13:46:50 -07:00 |
|
DarkSharpness
|
832c84fba9
|
[Chore] Update xgrammar 0.1.24 -> 0.1.25 (#10710)
|
2025-10-07 18:22:28 -07:00 |
|
 DarkSharpnessandBaizhou Zhang
|
e0b2d3eebe
|
[Feature] Add a fast-topk to sgl-kernel for DeepSeek v3.2 (#11194)
Co-authored-by: Baizhou Zhang <sobereddiezhang@gmail.com>
|
2025-10-05 10:19:03 -07:00 |
|
 DarkSharpnessandZhiqiang Xie
|
948b01a04c
|
[Refactor] Remove Hicache Load & Write threads (#10127)
Co-authored-by: Zhiqiang Xie <xiezhq@stanford.edu>
|
2025-09-08 22:18:50 -07:00 |
|
DarkSharpness
|
067246830d
|
[Minor] fix lint in main (#10128)
|
2025-09-07 17:36:46 +08:00 |
|
DarkSharpness
|
86a0be65d8
|
[Feature] Support custom set kv buffer kernel (#8884)
|
2025-08-12 16:56:51 -07:00 |
|
DarkSharpness
|
b4ac2b9c0c
|
[Fix] Fix dual chunk model default behavior (#9032)
|
2025-08-11 23:50:23 -07:00 |
|
DarkSharpness
|
7ba5ad5766
|
[Fix] Fix flashinfer cpu <-> gpu synchronization (#8340)
|
2025-08-10 03:11:40 +00:00 |
|
DarkSharpness
|
19bc77f05c
|
[Fix] Fix hicache backend (#8991)
|
2025-08-09 17:16:25 -07:00 |
|
DarkSharpness
|
fc42ff7b63
|
[Fix] Fix wrong backend chosen in hybrid backend (#8989)
|
2025-08-08 21:21:17 -07:00 |
|
DarkSharpness
|
e273aa6dcf
|
[Feature] Radix Tree in C++ (#7369)
|
2025-08-02 19:50:14 -07:00 |
|
 DarkSharpnessandZhiqiang Xie
|
47367b768d
|
[Refactor] Clean up radix cache related API (#7303)
Co-authored-by: Zhiqiang Xie <xiezhq@stanford.edu>
|
2025-06-20 00:58:48 +08:00 |
|
DarkSharpness
|
ac3fae8445
|
[Feature] Support "strict" in function calling (#4310)
|
2025-03-24 22:15:25 -07:00 |
|
DarkSharpness
|
19120f71f3
|
[Fix & Style] Refactor the grammar backend to reduce human errors and improve readability (#4030)
|
2025-03-04 03:56:45 -08:00 |
|
DarkSharpness
|
9c745d078e
|
[Performance] Update xgrammar-related constrained decoding (#2056)
|
2024-11-17 16:58:49 -08:00 |
|
DarkSharpness
|
954f4e6bd6
|
benchmark json schema (#2030)
|
2024-11-15 05:06:19 -08:00 |
|
 DarkSharpnessandLianmin Zheng
|
125b1199c5
|
support parallel grammar preprocessing (#1996)
Co-authored-by: Lianmin Zheng <lianminzheng@gmail.com>
|
2024-11-12 08:45:28 -08:00 |
|
DarkSharpness
|
b77a02cdfd
|
[Performance] Support both xgrammar and outlines for constrained decoding (#1752)
|
2024-10-25 21:47:02 +00:00 |
|