4 people f855a0bde6 Introduce CUDA graph debug mode with breakable CUDA graph (#19102) ...

Co-authored-by: Cheng Wan <54331508+ch-wan@users.noreply.github.com>
Co-authored-by: Cheng Wan <chwan@rice.edu>
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>

2026-04-11 00:36:56 -07:00

..

attention_backend.md

[Speculative Decoding] Add FA4-based Spec Support (#21080)

2026-04-04 02:09:45 -07:00

breakable_cuda_graph.md

Introduce CUDA graph debug mode with breakable CUDA graph (#19102)

2026-04-11 00:36:56 -07:00

checkpoint_engine.md

[Ckpt Engine] feat: new sglang entrypoint support for update (#12216)

2025-10-30 10:39:27 +08:00

cuda_graph_for_multi_modal_encoder.md

[VLM] Add doc for ViT CUDA Graph (#16343)

2026-01-04 10:05:23 +08:00

deterministic_inference.md

[Documentation] add doc for deterministic inference (#11956)

2025-10-22 12:36:15 -05:00

dp_dpa_smg_guide.md

Enhance SMG guide with RL rollout systems benefits (#18588)

2026-02-10 20:20:45 -08:00

dp_for_multi_modal_encoder.md

[docs] fix misspellings & typos (#18276)

2026-02-05 03:35:29 +00:00

epd_disaggregation.md

[DOC] add documents for encoder global mm cache (#20636)

2026-03-15 16:44:21 -07:00

expert_parallelism.md

[Feature] Integrate Elastic NIXL-EP into SGLang (#19248)

2026-03-11 17:37:43 +08:00

forward_hooks.md

Rename: --hooks to --forward-hooks (#13994)

2025-11-26 22:26:28 +08:00

hicache_best_practices.md

[HiCache] Support heterogeneous tp for hicache storage (#18541)

2026-02-25 00:13:57 -08:00

hicache_design.md

configuration file support and nixl integration augmentation for hicache-storage-backend-extra-config (#16602)

2026-01-22 14:31:48 -08:00

hicache_storage_runtime_attach_detach.md

[Scheduler] Unify idle checks into is_fully_idle() and fix weight update test (#20296)

2026-03-10 17:50:23 -07:00

hicache.rst

[HiCache][HA 1/N] Support HiCache storage runtime attach/detach (#15892)

2026-01-26 19:33:19 -08:00

hisparse_guide.md

[HiSparse]: Update HiSparse's user-guide (#22499)

2026-04-10 15:06:43 +08:00

hyperparameter_tuning.md

[Docs] Rename SGLang Router to SGLang Model Gateway (#17436)

2026-01-20 12:31:10 -08:00

lora.ipynb

[CI] fix: handle missing repo in lora notebook (#19700)

2026-03-02 10:27:32 -08:00

object_storage.md

Direct model loading from object storage with Runai Model Streamer (#17948)

2026-04-01 18:41:22 -07:00

observability.md

Update docs (#13391)

2025-11-16 19:36:33 -08:00

pd_disaggregation.md

Add staging buffer CI test and documentation for heterogeneous TP (#21921)

2026-04-06 14:00:20 +08:00

piecewise_cuda_graph.md

Piecewise Cuda Graph Docs (#19738)

2026-03-03 11:51:17 +08:00

pipeline_parallelism.md

[Doc] Update pipeline parallelism documentation (#17414)

2026-01-20 20:10:56 +08:00

quantization.md

CUTLASS NVFP4 GEMM improvement of SM120 (#21314)

2026-04-01 09:04:34 +08:00

quantized_kv_cache.md

add doc for quantized kv cache (#14348)

2025-12-04 13:01:05 -08:00

rfork.md

[1/2] Add ModelExpress coordination for remote instance weight loading - matching TP (#19920)

2026-03-18 13:38:32 -07:00

separate_reasoning.ipynb

[CI] feat: add early exit to wait_for_server when process dies (#18602)

2026-02-13 16:46:09 -08:00

server_arguments.md

[Spec][Ngram] 4/N: Remove max_match_window_size and min_match_window_size, matching all suffixes of the Trie (#21225)

2026-04-01 22:09:46 -07:00

sgl_model_gateway.md

Migrate all callers from /get_server_info to /server_info (#21463)

2026-04-01 21:17:50 -07:00

sglang_for_rl.md

[Feature] Implement update_weights_from_disk for SGLang-D (Diffusion … (#18306)

2026-02-18 11:24:07 -08:00

speculative_decoding.md

[Spec][Ngram] 6/N: Load an external corpus and construct a Suffix Automaton (#21425)

2026-04-06 00:11:14 -07:00

structured_outputs_for_reasoning_models.ipynb

update pre-commit config (#18860)

2026-02-16 00:18:31 +08:00

structured_outputs.ipynb

Add Lychee Doc Links Check to Local and CI (#19742)

2026-03-24 13:48:26 -07:00

tool_parser.ipynb

[CI] feat: add early exit to wait_for_server when process dies (#18602)

2026-02-13 16:46:09 -08:00

vlm_query.ipynb

Upgrade transformers==5.3.0 (#17784)

2026-03-18 13:50:43 -07:00