[Config] Retire get_global_server_args, and clear the deprecated flags that have a replacement (#38375)
This commit is contained in:
@@ -260,7 +260,7 @@ checkpoint's calibration scales automatically.
|
||||
is NVFP4-packed; the BF16 and FP8 checkpoints keep a dense head).
|
||||
The Ascend comparison in #35629 used a 910C with BF16 target weights,
|
||||
`--tp-size 2 --attention-backend ascend --mamba-ssm-dtype bfloat16
|
||||
--mamba-scheduler-strategy extra_buffer`, and disabled RadixCache for both
|
||||
--mamba-radix-cache-strategy extra_buffer`, and disabled RadixCache for both
|
||||
baseline and DFlash2 to exclude cache warm-up and prefix reuse. The DFlash2
|
||||
run added the three flags shown above.
|
||||
Accuracy used zero-shot GSM8K with greedy sampling, `max_new_tokens=2048`,
|
||||
|
||||
Reference in New Issue
Block a user