Commit Graph
20 Commits
Author SHA1 Message Date
gongwei-130 65bed8382b Add google-cloud-storage into Dockerfile (#15343) 2026-01-07 16:54:45 -08:00
gongwei-130 94e1251131 enable flashinfer-jit-cache in image build and ci install to speed up model launch (#14959) 2025-12-11 23:20:44 -08:00
gongwei-130 3e40c63674 fix "GrammarMatcher has terminated after accepting the stop token, but is trying to find the next token mask" when both reasoning and spec are enabled (#14464) 2025-12-06 06:15:22 -08:00
gongwei-130 3339c81072 fix RuntimeError: RMSNorm failed with error code an illegal memory access was encountered (#14135) 2025-11-29 12:17:41 -08:00
gongwei-130 8ff3ef1fef fix: draft model revision misuse model revision (#11893) 2025-11-24 21:13:37 -08:00
gongwei-130 9dc15d8569 fix xgrammar_backend crash with malformed inputs (#13752) 2025-11-24 13:54:19 -08:00
gongwei-130 a9d22b751d fix lora test (#13537) 2025-11-18 12:40:35 -08:00
gongwei-130 97be66c358 fix sgl-kernel version (#12723) 2025-11-05 19:01:03 -08:00
gongwei-130 8da608cce0 fix: AttributeError: 'NixlKVManager' object has no attribute 'prefill_tp_size_table' (#12234) 2025-10-27 15:57:33 -07:00
gongwei-130 4aeb193fbd disable sm100 for FlashMLA and fast-hadamard-transform in cuda12.6.1 (#11274) 2025-10-06 14:48:31 -07:00
gongwei-130 0618ad6dd5 fix: shoudn't include CUDA_ARCH 100 and 120 for cuda12.6.1 (#11176) 2025-10-02 13:24:23 -07:00
gongwei-130 373080ea6c skip vision_model for lora (#10530) 2025-09-16 12:34:42 -07:00
gongwei-130 a2424068ec add try catch for quant config hf download (#10340) 2025-09-11 15:00:21 -07:00
gongwei-130 ab62b135c1 support Llama4 with non uniformed intermediate size across layers for… (#10047) 2025-09-05 17:28:15 -07:00
gongwei-130 3fd1431df2 support enable in the reasoning field to enable thingking for thinkin… (#9715) 2025-08-29 10:57:32 -07:00
gongwei-130 9a7c8842ba accomendate json schema in the "schema" field, not in "json_schema" field of response_format (#9786) 2025-08-28 23:51:50 -07:00
gongwei-130 fb107cfd75 feat: allow use local branch to build image (#9546) 2025-08-23 16:38:30 -07:00
gongwei-130 10d34f74e2 fix: should return a invalid request response when schema missing (#9461) 2025-08-21 14:06:50 -07:00
gongwei-130 9ba7253094 accomendate reasoning_effort set in chat_template_kwargs (#9458) 2025-08-21 13:22:03 -07:00
gongwei-130 0cf3fbeb18 should return invalide request for empty prompt (#9315) 2025-08-18 11:44:11 -07:00