diff options
| author | Paul Buetow <paul@buetow.org> | 2026-04-06 20:47:39 +0300 |
|---|---|---|
| committer | Paul Buetow <paul@buetow.org> | 2026-04-06 20:47:39 +0300 |
| commit | eb800cdf31176584ee0b604f5bda65f0d2880909 (patch) | |
| tree | 0bf9ef9491137e9e5e6600f1819b1b8d048a24af /hyperstack-vm1-coder.toml | |
| parent | 0664ffcc62b2fb240286fde463635e510a41df84 (diff) | |
provisioner: support docker_image and pre_start_cmd for Gemma 4 startup
Adds docker_image and pre_start_cmd config fields to config.rb and
provisioning.rb so the Gemma 4 31B workarounds are baked in:
- docker_image = "vllm/vllm-openai:nightly" (stable lacks Gemma 4 support)
- pre_start_cmd = "pip install -q transformers==5.5.0" (stable pins <5)
- extra_docker_env = ["CUDA_VISIBLE_DEVICES=0"] (required with --entrypoint bash)
When pre_start_cmd is set, the provisioner switches to --entrypoint bash and
chains the patch command before launching vLLM, so create-both works end-to-end
without manual container replacement.
Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
Diffstat (limited to 'hyperstack-vm1-coder.toml')
0 files changed, 0 insertions, 0 deletions
