Scope streaming backlog coalescing to incremental_streaming_output mode (#21037)

Signed-off-by: Vladislav Nosivskoy <vladnosiv@gmail.com>
Co-authored-by: Lianmin Zheng <lianminzheng@gmail.com>
This commit is contained in:
Vladislav Nosivskoy
2026-03-27 17:29:54 -07:00
committed by GitHub
co-authored by Lianmin Zheng
parent a27651d5e0
commit c37200f5e4
2 changed files with 101 additions and 77 deletions
@@ -91,7 +91,7 @@ class TestEAGLEServerBasic(EagleServerBase):
if speculative_eagle_topk == 1:
self.assertGreater(avg_spec_accept_length, 2.5)
else:
self.assertGreater(avg_spec_accept_length, 3.49)
self.assertGreater(avg_spec_accept_length, 3.47)
# Wait a little bit so that the memory check happens.
time.sleep(4)