[misc] Use --cuda-graph-max-bs-decode in tests, examples, and docs (#29591)
This commit is contained in:
@@ -240,7 +240,7 @@ class TestDisaggregationMooncakeSpec(
|
||||
"4",
|
||||
"--speculative-num-draft-tokens",
|
||||
"16",
|
||||
"--cuda-graph-max-bs",
|
||||
"--cuda-graph-max-bs-decode",
|
||||
"8",
|
||||
"--dtype=float16",
|
||||
]
|
||||
|
||||
Reference in New Issue
Block a user