summaryrefslogtreecommitdiff
path: root/hyperstack-vm1-coder.toml
diff options
context:
space:
mode:
authorPaul Buetow <paul@buetow.org>2026-04-06 20:47:39 +0300
committerPaul Buetow <paul@buetow.org>2026-04-06 20:47:39 +0300
commiteb800cdf31176584ee0b604f5bda65f0d2880909 (patch)
tree0bf9ef9491137e9e5e6600f1819b1b8d048a24af /hyperstack-vm1-coder.toml
parent0664ffcc62b2fb240286fde463635e510a41df84 (diff)
provisioner: support docker_image and pre_start_cmd for Gemma 4 startup
Adds docker_image and pre_start_cmd config fields to config.rb and provisioning.rb so the Gemma 4 31B workarounds are baked in: - docker_image = "vllm/vllm-openai:nightly" (stable lacks Gemma 4 support) - pre_start_cmd = "pip install -q transformers==5.5.0" (stable pins <5) - extra_docker_env = ["CUDA_VISIBLE_DEVICES=0"] (required with --entrypoint bash) When pre_start_cmd is set, the provisioner switches to --entrypoint bash and chains the patch command before launching vLLM, so create-both works end-to-end without manual container replacement. Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
Diffstat (limited to 'hyperstack-vm1-coder.toml')
0 files changed, 0 insertions, 0 deletions