 Po-Han Huang (NVIDIA)andClaude Opus 5.5
|
02d2445138
|
[Doc] cookbook: Refresh SemiAnalysis AgentX launches with seven open InferenceX PRs (#46005)
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-23 16:04:01 +08:00 |
|
 Po-Han Huang (NVIDIA)andClaude Opus 5.5
|
12370da115
|
[Doc] cookbook: Refresh SemiAnalysis AgentX launches with five open InferenceX PRs (#45749)
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-22 14:15:19 +08:00 |
|
 Po-Han Huang (NVIDIA)andClaude Opus 5.5
|
1689cb2d52
|
[Doc] cookbook: Add GLM-5.3 AgentX section and refresh with eight open InferenceX PRs (#45513)
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-21 13:22:38 +08:00 |
|
 Po-Han Huang (NVIDIA)andClaude Opus 5.5
|
eae134d61f
|
[Test] kernels: Import silu_and_mul_contig_post_quant from its new home (#45368)
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-20 19:48:59 +08:00 |
|
 Po-Han Huang (NVIDIA)andClaude Opus 5.5
|
9e23107772
|
[Doc] cookbook: Refresh SemiAnalysis AgentX launches with five open InferenceX PRs (#45311)
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-20 14:48:48 +08:00 |
|
 Po-Han Huang (NVIDIA)andClaude Opus 5.5
|
af9bb2a32d
|
[Doc] cookbook: Refresh SemiAnalysis AgentX launches with twelve open InferenceX PRs (#45111)
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-19 15:24:08 +08:00 |
|
 Po-Han Huang (NVIDIA)andClaude Opus 5.5
|
5e240a200d
|
[Doc] cookbook: Refresh SemiAnalysis AgentX launches for Qwen3.5 and DeepSeek-V4.1-Flash GB300 (#44712)
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-16 19:31:08 +08:00 |
|
 Po-Han Huang (NVIDIA)andClaude Opus 5.5
|
fd4b75c696
|
[Doc] cookbook: Add SemiAnalysis AgentX launches to Muse Spark Open, refresh DeepSeek-V4.1-Flash (#44654)
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-16 12:45:07 +08:00 |
|
 Po-Han Huang (NVIDIA)andClaude Opus 5.5
|
3b72b70ef4
|
[CI] vlm: Pin baidu/Unlimited-OCR revision in test_unlimited_ocr_server (#44235)
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-14 17:50:18 +08:00 |
|
 Po-Han Huang (NVIDIA)andClaude Opus 5.5
|
72730d6360
|
[Doc] cookbook: Mirror SA cluster NCCL_CUMEM_ENABLE in AgentX launches, fix GPU counts (#44228)
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-14 16:07:40 +08:00 |
|
 Po-Han Huang (NVIDIA)andClaude Opus 5.5
|
d5f80aa3c3
|
[Test] dsv4: Fix Hopper indexer replay test after DeepSelect decode (#41561) (#44193)
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-14 13:15:35 +08:00 |
|
 Po-Han Huang (NVIDIA)andClaude Opus 5.5
|
721953c6f6
|
[Doc] cookbook: Refresh SemiAnalysis AgentX launches to InferenceX main (GLM-5.2 NVFP4 B300 agg TP4, Dynamo frontend counts) (#44065)
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-14 13:03:51 +08:00 |
|
 Po-Han Huang (NVIDIA)andClaude Opus 5.5
|
8e37c6cf37
|
[CI] Run test_pi05_modelopt_fp8_cuda in the kernel-unit lane (#44055)
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-13 20:39:02 +08:00 |
|
 Po-Han Huang (NVIDIA)andClaude Opus 5.5
|
dbad07a06f
|
[Docs] Cookbook: refresh SemiAnalysis AgentX launches (DeepSeek-V4.1 GB200/GB300, GLM-5.2 FP8 B300) (#43983)
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-13 14:39:45 +08:00 |
|
 Po-Han Huang (NVIDIA)andClaude Opus 5.5
|
b0c84d4518
|
[Docs] Cookbook: refresh SemiAnalysis AgentX launches (GLM-5.2 B300, DeepSeek-V4.1 GB300) (#43799)
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-12 17:08:11 +08:00 |
|
 Po-Han Huang (NVIDIA)andClaude Opus 5.5
|
6ac8602e8d
|
[CI] Fix TestQwenImageModulationCache after Qwen-Image modulation sharding (#43747)
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-11 20:31:29 -07:00 |
|
 Po-Han Huang (NVIDIA)andClaude Opus 5.5
|
1fc6b8962c
|
[Docs] Cookbook: AgentX launches for Qwen3.5 / Qwen3.8-Flash-Next; refresh GLM-5.2, DeepSeek-V4, DeepSeek-V4.1 (#43083)
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-09 13:55:35 +08:00 |
|
 Po-Han Huang (NVIDIA)andClaude Opus 5.5
|
7b6b6ee25e
|
[Docs] Cookbook: interactive SemiAnalysis InferenceX AgentX launches for GLM-5.2, DeepSeek-V4 and DeepSeek-V4.1 (#42726)
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-08 09:33:40 +08:00 |
|
 Po-Han Huang (NVIDIA)andClaude Opus 5.5
|
1e86143bf0
|
[Bugfix] Return None for empty reasoning_content outside K2 Horizon (#42962)
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-07 21:02:40 +08:00 |
|
 Po-Han Huang (NVIDIA)andClaude Opus 5.5
|
ba77d30256
|
[FA4] Keep stream last in the SM100 MLA kernel so disk-cached objects load (#42926)
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-07 15:58:55 +08:00 |
|
 Po-Han Huang (NVIDIA)andClaude Opus 5.5
|
3eec178e48
|
[Spec][MegaMoE] Let the speculative draft choose its own W4A4 MXFP4 MegaMoE MMA type (#42022)
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-06 14:09:57 -07:00 |
|
 Po-Han Huang (NVIDIA)andClaude Opus 5.5
|
f2f0be731c
|
[Docs] GLM-5.2: move GB300 AgentX recipe to the agentic HiCache section and drop no-op settings (#42167)
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-06 09:40:30 +08:00 |
|
Po-Han Huang (NVIDIA)
|
62af5f56a5
|
[CI] Drop the redundant and broken tc_piecewise tests (#42571)
|
2026-10-05 17:29:32 -07:00 |
|
 Po-Han Huang (NVIDIA)andClaude Opus 5.5
|
41bd213c5f
|
[Test] Add get_swa_key_page_size to the Q8KV8 sparse-prefill fake KV pool (#42211)
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-02 16:00:15 +08:00 |
|
Po-Han Huang (NVIDIA)
|
771c9d782d
|
[PD] Validate Mooncake EFA allocator compatibility (#39973)
|
2026-09-22 15:12:29 +08:00 |
|
  
|
3a64faa1f2
|
Fix disagg PP MTP for GLM-5.2 (#39378)
Co-authored-by: Julien Lin <jullin@nvidia.com>
Co-authored-by: YAMY1234 <74099316+YAMY1234@users.noreply.github.com>
Co-authored-by: Yangmin Li <yangminl@nvidia.com>
|
2026-09-19 13:55:07 -07:00 |
|
Po-Han Huang (NVIDIA)
|
a2a261963f
|
[CI] Fix SWA decode radix cache NIXL import (#39600)
|
2026-09-15 21:01:05 +08:00 |
|
Po-Han Huang (NVIDIA)
|
51c8581a26
|
[Rust] Gate health on startup warmup completion (#37994)
|
2026-09-09 15:55:13 -07:00 |
|
 Po-Han Huang (NVIDIA)andYAMY
|
96d91ef926
|
[Model] Support GLM-5.3 Flash NVFP4 loading (#38621)
Co-authored-by: YAMY <74099316+YAMY1234@users.noreply.github.com>
|
2026-09-09 13:51:08 -07:00 |
|
Po-Han Huang (NVIDIA)
|
5097f9ac95
|
Disable Hopper GLM shared-expert fusion for modelopt_fp4 Marlin (#37325)
|
2026-09-08 06:16:36 -07:00 |
|
Po-Han Huang (NVIDIA)
|
991368d880
|
Fix Muse Glimmer ModelOpt mixed weight mapping (#37510)
|
2026-09-04 20:53:55 -07:00 |
|
 Po-Han Huang (NVIDIA)andkpham-sgl
|
d122ca99b2
|
[Bugfix] Fix Llama 4 FA3 local attention with paged KV cache (#32902)
Co-authored-by: kpham-sgl <khoa.pham@radixark.ai>
|
2026-09-03 23:15:23 -07:00 |
|
Po-Han Huang (NVIDIA)
|
d585cec4bd
|
Fix nondeterministic FlashInfer GDN alignment test (#37343)
|
2026-09-01 23:46:58 -07:00 |
|
Po-Han Huang (NVIDIA)
|
e57e934bcc
|
[Bugfix] Accept int64 top-k IDs in FlashInfer routed MoE packer (#32882)
|
2026-09-01 14:17:46 -07:00 |
|
Po-Han Huang (NVIDIA)
|
6ff2fe6a6a
|
CI: split JIT kernel unit tests into two partitions (#36775)
|
2026-08-28 09:32:58 -07:00 |
|
Po-Han Huang (NVIDIA)
|
c608f9bf75
|
[CI] Fix Q8KV8 sparse prefill test fixture (#36639)
|
2026-08-27 01:00:22 -07:00 |
|
Po-Han Huang (NVIDIA)
|
6f69f927da
|
[Scheduler] Add configurable decode interval after prefill (#35017)
|
2026-08-19 12:01:36 -07:00 |
|
Po-Han Huang (NVIDIA)
|
bae29f716a
|
Fix inference mode mismatch in FlashInfer warmup (#33788)
|
2026-08-06 16:11:41 -07:00 |
|
Po-Han Huang (NVIDIA)
|
7eb27372b3
|
fix(server): capture legal multi-request prefill CUDA graph batches (#30206)
|
2026-08-03 16:56:59 -07:00 |
|
Po-Han Huang (NVIDIA)
|
5df193b4ac
|
[Speculative Decoding] Fix GPT-OSS EAGLE3 hidden states (#32334)
|
2026-07-31 11:58:49 -07:00 |
|
Po-Han Huang (NVIDIA)
|
5d004a20c5
|
Fix FlashInfer A2A top-k ID dtype (#29929)
|
2026-07-15 17:56:11 -07:00 |
|
Po-Han Huang (NVIDIA)
|
cfc3d0555e
|
Fix ModelOpt NVFP4 scalar scales for merged linears (#29151)
|
2026-07-13 16:14:20 -07:00 |
|
Po-Han Huang (NVIDIA)
|
17cce6a85f
|
Fix shared logits buffer for reduced-vocab draft models (#29943)
|
2026-07-02 16:08:56 -07:00 |
|
Po-Han Huang (NVIDIA)
|
72812db138
|
Avoid dynamic Q quantization in trtllm_mha (#29423)
|
2026-06-26 15:51:15 -07:00 |
|
 Po-Han Huang (NVIDIA)andClaude Opus 4.6
|
ada52e5972
|
[Docs] Move ptxas sm_103a workaround into For CUDA 13 section (#22852)
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
|
2026-04-14 22:30:21 -07:00 |
|