minke.yu/sglang
1
0
Fork 0
Code Issues Pull Requests Actions 12 Packages Projects Releases Wiki Activity
18,694 Commits 3 Branches 0 Tags
dsv41-pd
Commit Graph
16 Commits
This Branch
This Branch
All Branches
Author SHA1 Message Date
Enrique Shockwave 92b1d382c7 [Fix] Correct dense FP8 Marlin bias ordering (#35020) 2026-08-17 03:43:36 +00:00
Enrique Shockwave e483ab6d20 enable marlin fp8 blockwise (#8990) 2025-08-18 18:53:15 -07:00
Enrique Shockwave fd63b62eaa fix compressed tensors WNA16 imports (#8142) 2025-07-18 11:34:14 -07:00
Enrique Shockwave 4c7640079c check marlin format before attempting conversion (#4675) 2025-04-20 17:47:09 -07:00
Enrique Shockwave d281587989 Improve: Support xgrammar 0.1.14 (#3593) 2025-02-27 08:42:54 -08:00
Enrique Shockwave af6c5357d5 deepseek v3 and r1 chat template (#3015) 2025-01-20 14:40:12 -08:00
Enrique Shockwave 3bcf5ecea7 support regex in xgrammar backend (#2983) 2025-01-20 04:34:41 +08:00
Enrique Shockwave 65fdb28929 fix missing launch server import (#2242) 2024-11-28 21:24:47 +08:00
Enrique Shockwave f11eb90fe4 Initialize model_worker_batch variable (#1973) 2024-11-09 11:28:02 -08:00
Enrique Shockwave 32a4141d5a Allow new lines during JSON generation (#1277) 2024-09-01 03:42:29 -07:00
Enrique Shockwave 6c34d6339c make json_schema usable from gen (#1254) 2024-08-28 18:57:10 -07:00
Enrique Shockwave 21e22b9e96 Fix LiteLLM kwargs (#817) 2024-07-29 22:38:02 -07:00
Enrique Shockwave e2c31fca5c Include finish reason in meta info response (#415) 2024-05-09 15:14:01 +08:00
Enrique Shockwave cf9d8efdd3 llama3 instruct template (#372) 2024-04-21 09:40:12 -07:00
Enrique Shockwave d9b3b01883 enable marlin kernels (#286) 2024-03-12 22:10:12 -04:00
Enrique Shockwave 9759d927cf fix chatml template (#195) 2024-02-24 16:34:22 +08:00