summaryrefslogtreecommitdiff
path: root/lib/hyperstack/vm_lifecycle.rb
diff options
context:
space:
mode:
authorPaul Buetow <paul@buetow.org>2026-05-25 21:16:41 +0300
committerPaul Buetow <paul@buetow.org>2026-05-25 21:16:41 +0300
commitee67020aa88063eccc26ce2030111d365f8cf6c2 (patch)
tree87e55590a771921975516762199057c526ed3357 /lib/hyperstack/vm_lifecycle.rb
parent90493d2a3d1395488f77bbedd246e09e22908c96 (diff)
fix(inference_tester): add bounded-retry guard around vLLM chat inference
Retry up to 3 times with 15/30/45s backoff on Net::ReadTimeout, Net::OpenTimeout, connection errors, non-200 HTTP, and JSON parse failures. Prevents a single transient timeout from failing the whole test run. Task referenced Manager#vllm_chat which no longer exists after refactor; applied guard to InferenceTester#chat where the call actually lives.
Diffstat (limited to 'lib/hyperstack/vm_lifecycle.rb')
0 files changed, 0 insertions, 0 deletions