45 Commits
Author SHA1 Message Date
Po-Han Huang (NVIDIA)andClaude Opus 5.5 02d2445138 [Doc] cookbook: Refresh SemiAnalysis AgentX launches with seven open InferenceX PRs (#46005)
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-23 16:04:01 +08:00
Po-Han Huang (NVIDIA)andClaude Opus 5.5 12370da115 [Doc] cookbook: Refresh SemiAnalysis AgentX launches with five open InferenceX PRs (#45749)
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-22 14:15:19 +08:00
Po-Han Huang (NVIDIA)andClaude Opus 5.5 1689cb2d52 [Doc] cookbook: Add GLM-5.3 AgentX section and refresh with eight open InferenceX PRs (#45513)
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-21 13:22:38 +08:00
Po-Han Huang (NVIDIA)andClaude Opus 5.5 eae134d61f [Test] kernels: Import silu_and_mul_contig_post_quant from its new home (#45368)
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-20 19:48:59 +08:00
Po-Han Huang (NVIDIA)andClaude Opus 5.5 9e23107772 [Doc] cookbook: Refresh SemiAnalysis AgentX launches with five open InferenceX PRs (#45311)
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-20 14:48:48 +08:00
Po-Han Huang (NVIDIA)andClaude Opus 5.5 af9bb2a32d [Doc] cookbook: Refresh SemiAnalysis AgentX launches with twelve open InferenceX PRs (#45111)
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-19 15:24:08 +08:00
Po-Han Huang (NVIDIA)andClaude Opus 5.5 5e240a200d [Doc] cookbook: Refresh SemiAnalysis AgentX launches for Qwen3.5 and DeepSeek-V4.1-Flash GB300 (#44712)
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-16 19:31:08 +08:00
Po-Han Huang (NVIDIA)andClaude Opus 5.5 fd4b75c696 [Doc] cookbook: Add SemiAnalysis AgentX launches to Muse Spark Open, refresh DeepSeek-V4.1-Flash (#44654)
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-16 12:45:07 +08:00
Po-Han Huang (NVIDIA)andClaude Opus 5.5 3b72b70ef4 [CI] vlm: Pin baidu/Unlimited-OCR revision in test_unlimited_ocr_server (#44235)
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-14 17:50:18 +08:00
Po-Han Huang (NVIDIA)andClaude Opus 5.5 72730d6360 [Doc] cookbook: Mirror SA cluster NCCL_CUMEM_ENABLE in AgentX launches, fix GPU counts (#44228)
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-14 16:07:40 +08:00
Po-Han Huang (NVIDIA)andClaude Opus 5.5 d5f80aa3c3 [Test] dsv4: Fix Hopper indexer replay test after DeepSelect decode (#41561) (#44193)
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-14 13:15:35 +08:00
Po-Han Huang (NVIDIA)andClaude Opus 5.5 721953c6f6 [Doc] cookbook: Refresh SemiAnalysis AgentX launches to InferenceX main (GLM-5.2 NVFP4 B300 agg TP4, Dynamo frontend counts) (#44065)
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-14 13:03:51 +08:00
Po-Han Huang (NVIDIA)andClaude Opus 5.5 8e37c6cf37 [CI] Run test_pi05_modelopt_fp8_cuda in the kernel-unit lane (#44055)
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-13 20:39:02 +08:00
Po-Han Huang (NVIDIA)andClaude Opus 5.5 dbad07a06f [Docs] Cookbook: refresh SemiAnalysis AgentX launches (DeepSeek-V4.1 GB200/GB300, GLM-5.2 FP8 B300) (#43983)
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-13 14:39:45 +08:00
Po-Han Huang (NVIDIA)andClaude Opus 5.5 b0c84d4518 [Docs] Cookbook: refresh SemiAnalysis AgentX launches (GLM-5.2 B300, DeepSeek-V4.1 GB300) (#43799)
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-12 17:08:11 +08:00
Po-Han Huang (NVIDIA)andClaude Opus 5.5 6ac8602e8d [CI] Fix TestQwenImageModulationCache after Qwen-Image modulation sharding (#43747)
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-11 20:31:29 -07:00
Po-Han Huang (NVIDIA)andClaude Opus 5.5 1fc6b8962c [Docs] Cookbook: AgentX launches for Qwen3.5 / Qwen3.8-Flash-Next; refresh GLM-5.2, DeepSeek-V4, DeepSeek-V4.1 (#43083)
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-09 13:55:35 +08:00
Po-Han Huang (NVIDIA)andClaude Opus 5.5 7b6b6ee25e [Docs] Cookbook: interactive SemiAnalysis InferenceX AgentX launches for GLM-5.2, DeepSeek-V4 and DeepSeek-V4.1 (#42726)
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-08 09:33:40 +08:00
Po-Han Huang (NVIDIA)andClaude Opus 5.5 1e86143bf0 [Bugfix] Return None for empty reasoning_content outside K2 Horizon (#42962)
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-07 21:02:40 +08:00
Po-Han Huang (NVIDIA)andClaude Opus 5.5 ba77d30256 [FA4] Keep stream last in the SM100 MLA kernel so disk-cached objects load (#42926)
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-07 15:58:55 +08:00
Po-Han Huang (NVIDIA)andClaude Opus 5.5 3eec178e48 [Spec][MegaMoE] Let the speculative draft choose its own W4A4 MXFP4 MegaMoE MMA type (#42022)
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-06 14:09:57 -07:00
Po-Han Huang (NVIDIA)andClaude Opus 5.5 f2f0be731c [Docs] GLM-5.2: move GB300 AgentX recipe to the agentic HiCache section and drop no-op settings (#42167)
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-06 09:40:30 +08:00
Po-Han Huang (NVIDIA) 62af5f56a5 [CI] Drop the redundant and broken tc_piecewise tests (#42571) 2026-10-05 17:29:32 -07:00
Po-Han Huang (NVIDIA)andClaude Opus 5.5 41bd213c5f [Test] Add get_swa_key_page_size to the Q8KV8 sparse-prefill fake KV pool (#42211)
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-02 16:00:15 +08:00
Po-Han Huang (NVIDIA) 771c9d782d [PD] Validate Mooncake EFA allocator compatibility (#39973) 2026-09-22 15:12:29 +08:00
3a64faa1f2 Fix disagg PP MTP for GLM-5.2 (#39378)
Co-authored-by: Julien Lin <jullin@nvidia.com>
Co-authored-by: YAMY1234 <74099316+YAMY1234@users.noreply.github.com>
Co-authored-by: Yangmin Li <yangminl@nvidia.com>
2026-09-19 13:55:07 -07:00
Po-Han Huang (NVIDIA) a2a261963f [CI] Fix SWA decode radix cache NIXL import (#39600) 2026-09-15 21:01:05 +08:00
Po-Han Huang (NVIDIA) 51c8581a26 [Rust] Gate health on startup warmup completion (#37994) 2026-09-09 15:55:13 -07:00
Po-Han Huang (NVIDIA)andYAMY 96d91ef926 [Model] Support GLM-5.3 Flash NVFP4 loading (#38621)
Co-authored-by: YAMY <74099316+YAMY1234@users.noreply.github.com>
2026-09-09 13:51:08 -07:00
Po-Han Huang (NVIDIA) 5097f9ac95 Disable Hopper GLM shared-expert fusion for modelopt_fp4 Marlin (#37325) 2026-09-08 06:16:36 -07:00
Po-Han Huang (NVIDIA) 991368d880 Fix Muse Glimmer ModelOpt mixed weight mapping (#37510) 2026-09-04 20:53:55 -07:00
Po-Han Huang (NVIDIA)andkpham-sgl d122ca99b2 [Bugfix] Fix Llama 4 FA3 local attention with paged KV cache (#32902)
Co-authored-by: kpham-sgl <khoa.pham@radixark.ai>
2026-09-03 23:15:23 -07:00
Po-Han Huang (NVIDIA) d585cec4bd Fix nondeterministic FlashInfer GDN alignment test (#37343) 2026-09-01 23:46:58 -07:00
Po-Han Huang (NVIDIA) e57e934bcc [Bugfix] Accept int64 top-k IDs in FlashInfer routed MoE packer (#32882) 2026-09-01 14:17:46 -07:00
Po-Han Huang (NVIDIA) 6ff2fe6a6a CI: split JIT kernel unit tests into two partitions (#36775) 2026-08-28 09:32:58 -07:00
Po-Han Huang (NVIDIA) c608f9bf75 [CI] Fix Q8KV8 sparse prefill test fixture (#36639) 2026-08-27 01:00:22 -07:00
Po-Han Huang (NVIDIA) 6f69f927da [Scheduler] Add configurable decode interval after prefill (#35017) 2026-08-19 12:01:36 -07:00
Po-Han Huang (NVIDIA) bae29f716a Fix inference mode mismatch in FlashInfer warmup (#33788) 2026-08-06 16:11:41 -07:00
Po-Han Huang (NVIDIA) 7eb27372b3 fix(server): capture legal multi-request prefill CUDA graph batches (#30206) 2026-08-03 16:56:59 -07:00
Po-Han Huang (NVIDIA) 5df193b4ac [Speculative Decoding] Fix GPT-OSS EAGLE3 hidden states (#32334) 2026-07-31 11:58:49 -07:00
Po-Han Huang (NVIDIA) 5d004a20c5 Fix FlashInfer A2A top-k ID dtype (#29929) 2026-07-15 17:56:11 -07:00
Po-Han Huang (NVIDIA) cfc3d0555e Fix ModelOpt NVFP4 scalar scales for merged linears (#29151) 2026-07-13 16:14:20 -07:00
Po-Han Huang (NVIDIA) 17cce6a85f Fix shared logits buffer for reduced-vocab draft models (#29943) 2026-07-02 16:08:56 -07:00
Po-Han Huang (NVIDIA) 72812db138 Avoid dynamic Q quantization in trtllm_mha (#29423) 2026-06-26 15:51:15 -07:00
Po-Han Huang (NVIDIA)andClaude Opus 4.6 ada52e5972 [Docs] Move ptxas sm_103a workaround into For CUDA 13 section (#22852)
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
2026-04-14 22:30:21 -07:00