diff options
| author | Paul Buetow <paul@buetow.org> | 2026-05-25 21:16:41 +0300 |
|---|---|---|
| committer | Paul Buetow <paul@buetow.org> | 2026-05-25 21:16:41 +0300 |
| commit | ee67020aa88063eccc26ce2030111d365f8cf6c2 (patch) | |
| tree | 87e55590a771921975516762199057c526ed3357 /lib/hyperstack/vm_lifecycle.rb | |
| parent | 90493d2a3d1395488f77bbedd246e09e22908c96 (diff) | |
fix(inference_tester): add bounded-retry guard around vLLM chat inference
Retry up to 3 times with 15/30/45s backoff on Net::ReadTimeout,
Net::OpenTimeout, connection errors, non-200 HTTP, and JSON parse failures.
Prevents a single transient timeout from failing the whole test run.
Task referenced Manager#vllm_chat which no longer exists after refactor;
applied guard to InferenceTester#chat where the call actually lives.
Diffstat (limited to 'lib/hyperstack/vm_lifecycle.rb')
0 files changed, 0 insertions, 0 deletions
