Commit Graph
13 Commits
Author SHA1 Message Date
gongwei-130 97be66c358 fix sgl-kernel version (#12723) 2025-11-05 19:01:03 -08:00
gongwei-130 8da608cce0 fix: AttributeError: 'NixlKVManager' object has no attribute 'prefill_tp_size_table' (#12234) 2025-10-27 15:57:33 -07:00
gongwei-130 4aeb193fbd disable sm100 for FlashMLA and fast-hadamard-transform in cuda12.6.1 (#11274) 2025-10-06 14:48:31 -07:00
gongwei-130 0618ad6dd5 fix: shoudn't include CUDA_ARCH 100 and 120 for cuda12.6.1 (#11176) 2025-10-02 13:24:23 -07:00
gongwei-130 373080ea6c skip vision_model for lora (#10530) 2025-09-16 12:34:42 -07:00
gongwei-130 a2424068ec add try catch for quant config hf download (#10340) 2025-09-11 15:00:21 -07:00
gongwei-130 ab62b135c1 support Llama4 with non uniformed intermediate size across layers for… (#10047) 2025-09-05 17:28:15 -07:00
gongwei-130 3fd1431df2 support enable in the reasoning field to enable thingking for thinkin… (#9715) 2025-08-29 10:57:32 -07:00
gongwei-130 9a7c8842ba accomendate json schema in the "schema" field, not in "json_schema" field of response_format (#9786) 2025-08-28 23:51:50 -07:00
gongwei-130 fb107cfd75 feat: allow use local branch to build image (#9546) 2025-08-23 16:38:30 -07:00
gongwei-130 10d34f74e2 fix: should return a invalid request response when schema missing (#9461) 2025-08-21 14:06:50 -07:00
gongwei-130 9ba7253094 accomendate reasoning_effort set in chat_template_kwargs (#9458) 2025-08-21 13:22:03 -07:00
gongwei-130 0cf3fbeb18 should return invalide request for empty prompt (#9315) 2025-08-18 11:44:11 -07:00