Commit Graph
14 Commits
Author SHA1 Message Date
Brayden Zhong 2871eacc05 Add Triton Fused MoE kernel config for E=16 on B200 (#7004) 2025-08-13 23:12:27 -07:00
Brayden Zhong 4a9f3eef90 Tiny Llama4 type error in constructor (#6752) 2025-08-09 01:03:59 -07:00
Brayden Zhong 4acf690206 [Optimization][Perf] Disable the GC during CUDA graph capture to speed up by up to 3x (#8577) 2025-07-31 11:31:21 -07:00
Brayden Zhong a37e1247c1 [Multimodal][Perf] Use pybase64 instead of base64 (#7724) 2025-07-08 14:00:58 -07:00
Brayden ZhongandCinjon Resnick ca9291181d [Feature] Add Logit Bias (#6579)
Co-authored-by: Cinjon Resnick <cinjon.resnick@gmail.com>
2025-06-10 15:39:25 -07:00
Brayden Zhong 1aa0fbf416 Add note to add supported model to documentation (#6640) 2025-05-27 13:18:46 +08:00
Brayden Zhong 006ead9dcb [FA][Test] Fix Sparse FA test (#6306) 2025-05-26 01:27:48 -07:00
Brayden Zhong 9a91fa0ed1 docs: fix a bad redirect (#6300) 2025-05-14 10:27:19 -07:00
Brayden Zhong 3c32895cbe [Llama4] Add docs note about enable multimodal (#6235) 2025-05-13 10:05:47 +08:00
Brayden Zhong 12319a6787 [Docs] Add docs for SGLANG_ and SGL_ environment variables (#6206) 2025-05-13 01:45:41 +08:00
Brayden Zhongandvincent-4 43fb95c2fa [Model] Support ArcticForCausalLM architecture (Snowflake/snowflake-arctic-instruct) (#5078)
Co-authored-by: vincent-4 <vincentzhongy+githubvincent4@gmail.com>
2025-04-25 15:24:09 +08:00
Brayden Zhong b868526d94 Fix one more issue reported by torchfix (#4859) 2025-04-20 17:49:27 -07:00
Brayden Zhong e84f4ba0ab [Misc] Fix issues reported by torchfix (#4837) 2025-03-27 20:10:32 -07:00
Brayden Zhong b149b39353 [CI] Remove unused imports with Ruff to pre-commit config, only to benchmarks/docs/examples folder (#3969) 2025-03-27 19:45:02 -07:00