5 people 7431f35fd8 Delete CUTLASS FP8 blockwise for SM90 and SM100, move SM120 to JIT and add SwapAB (#30438) ...

Co-authored-by: Brayden Zhong <brayden.zhong@radixark.ai>
Co-authored-by: Claude Sonnet 5 <noreply@anthropic.com>
Co-authored-by: root <root@sgl-b300-inference.datacrunch.io>
Co-authored-by: Brayden Zhong <brayden@radixark.ai>

2026-07-14 09:31:32 +08:00

..

arg_groups

Revert "[Tiny] Enable Full Cuda Graph with Page size = 1" (#31062)

2026-07-13 14:23:44 -05:00

batch_invariant_ops

[NPU]adaptation to support deterministic inference (#21197)

2026-06-09 09:22:09 +08:00

batch_overlap

[Spec] Remove dead padded_static_len and stale SGLANG_ENABLE_SPEC_V2 references (#30998)

2026-07-13 15:30:31 -05:00

checkpoint_engine

…

compilation

[Intel GPU] xpu_piecewise: fall back to eager when PCG capture stream is unset (#30235)

2026-07-09 10:21:43 +08:00

configs

[Quantization] add humming quantization kernel (#23754)

2026-07-14 08:42:56 +08:00

connector

[connector] Add Azure Blob Storage connector (az:// and *.blob.core.windows.net URLs) (#23995)

2026-05-11 14:20:22 -07:00

constrained

Fix: add grammar sync in PP for structured output (#30747)

2026-07-12 02:54:50 +08:00

debug_utils

Support grad injection and step override in the dumper's model dump (#30657)

2026-07-09 20:26:05 +08:00

disaggregation

Return top-p/top-k sampling mask/nucleas (#27408)

2026-07-13 17:58:51 -05:00

distributed

Fix: add grammar sync in PP for structured output (#30747)

2026-07-12 02:54:50 +08:00

dllm

[dLLM] Make FDFO a framework capability for all dLLM algorithms (#27551)

2026-07-11 11:05:05 +08:00

elastic_ep

[refactor] Move the EP dispatcher and fusion-workspace manager state onto ctx.resources (#30489)

2026-07-09 02:08:35 -07:00

entrypoints

more fixes for Nemotron 3 parser for tool call and force nonempty content (#30533)

2026-07-14 06:50:27 +08:00

eplb

[Fix] Guard kernel OOB accesses and harden runtime edge cases (#30847)

2026-07-11 14:22:13 -05:00

function_call

[minimax-m3] Split 4/4: model + VL + glue + function-call + fp8 quant + generic infra (#28715)

2026-07-11 11:11:06 +08:00

grpc

…

hardware_backend

[Kernel] Migrate top-level srt/layers stray kernels to sglang.kernels (RFC #29630, Phase 2.5, 3/7) (#30787)

2026-07-14 09:20:59 +08:00

kv_canary

[Spec] Rename num_tokens_per_bs to num_tokens_per_req (#30977)

2026-07-13 13:47:53 -05:00

layers

Delete CUTLASS FP8 blockwise for SM90 and SM100, move SM120 to JIT and add SwapAB (#30438)

2026-07-14 09:31:32 +08:00

lora

[Kernel] Migrate scattered MoE kernels to sglang.kernels (RFC #29630, Phase 2.5, 2/7) (#30786)

2026-07-14 09:03:21 +08:00

managers

[Kernel] Migrate top-level srt/layers stray kernels to sglang.kernels (RFC #29630, Phase 2.5, 3/7) (#30787)

2026-07-14 09:20:59 +08:00

mem_cache

[HiCache & HybridModel] nixl hicache backend support hybrid models (#29191)

2026-07-13 09:09:37 -07:00

model_executor

fix: fix Kimi-VL encoder parallelism (#30869)

2026-07-14 08:44:06 +08:00

model_loader

[Quantization] add humming quantization kernel (#23754)

2026-07-14 08:42:56 +08:00

models

[Kernel] Migrate top-level srt/layers stray kernels to sglang.kernels (RFC #29630, Phase 2.5, 3/7) (#30787)

2026-07-14 09:20:59 +08:00

multimodal

fix: fix Kimi-VL encoder parallelism (#30869)

2026-07-14 08:44:06 +08:00

multiplex

Avoid implicit field-based side channel in Scheduler planning (#29408)

2026-07-10 08:55:51 +08:00

observability

[PD] Improve optimistic prefill (#30951)

2026-07-12 15:31:53 -07:00

parser

more fixes for Nemotron 3 parser for tool call and force nonempty content (#30533)

2026-07-14 06:50:27 +08:00

platforms

[Platform] Route pin memory availability through current_platform (#28113)

2026-07-13 11:37:59 -07:00

plugins

Multi platform Plugin (#21388)

2026-04-19 17:23:51 -07:00

ray

[refactor] Move model-capability adjustments into the resolution pipeline (#30299)

2026-07-07 21:26:55 -07:00

sampling

Return top-p/top-k sampling mask/nucleas (#27408)

2026-07-13 17:58:51 -05:00

session

Return top-p/top-k sampling mask/nucleas (#27408)

2026-07-13 17:58:51 -05:00

speculative

[Spec] Remove dead padded_static_len and stale SGLANG_ENABLE_SPEC_V2 references (#30998)

2026-07-13 15:30:31 -05:00

state_capturer

[refactor] Retire the legacy config accessor and the remaining process singletons (#30493)

2026-07-09 02:10:47 -07:00

tokenizer

Fix TiktokenTokenizer missing num_special_tokens_to_add (#30643)

2026-07-10 12:37:30 +00:00

utils

fix: fix Kimi-VL encoder parallelism (#30869)

2026-07-14 08:44:06 +08:00

weight_sync

…

constants.py

[AMD][MXFP4] Online MXFP4 quantization 1/N - dense and MOE models w. original BF16 weight (#18005)

2026-06-03 12:55:24 -07:00

environ.py

[Quantization] add humming quantization kernel (#23754)

2026-07-14 08:42:56 +08:00

runtime_context.py

Add DCP to runtime parallel context (#30478)

2026-07-10 21:23:41 -07:00

server_args_config_parser.py

fix(server): serialize nested dict config values as JSON (#28094)

2026-06-12 19:27:31 -07:00

server_args.py

Refactor FP4 quantization and remove deprecated JIT kernels (#30448)

2026-07-14 09:22:07 +08:00