Best VPS for Ollama (2026): Where Cheap Hosting Hits Reality

Last verified: 26 July 2026

Ollama is the easiest way to run local LLMs. It also makes it easy to deploy something that does not actually work for your use case, because the install command is the same whether you have 8 GB of RAM or an H100. The framework will not tell you that 2 tokens per second is too slow for a chatbot.

Here is the brutally honest hosting math after testing Ollama on six different VPS configs.

Ollama Is a Wrapper, the Model Is the Cost

Ollama itself is light. Around 100 MB of Go binary and runtime overhead. Every resource decision is about the model: which one you run, in which quantization, and whether you have GPU.

CPU inference works for the install demo and breaks for daily use. The numbers I measured on a Hetzner CCX33 (8 vCPU, 32 GB RAM, no GPU):

• Llama 3.1 8B Q4_K_M: 5 to 7 tokens per second
• Llama 3.1 8B Q8_0: 2 to 3 tokens per second
• Llama 3.1 70B Q4 (when it fits): 0.5 tokens per second

On a Hetzner GEX44 (RTX 4000 SFF Ada, 20 GB VRAM) the binding constraint is VRAM, not speed, so start there:

• Llama 3.1 8B Q4: about 5 GB — fits easily, comfortably interactive
• Llama 3.1 13B Q4: about 8 GB — fits with room for a large context window
• Llama 3.1 13B Q8: about 14 GB — fits, but context headroom gets tight
• Qwen 2.5 32B Q4: about 19 GB — only just fits, almost no context headroom
• Llama 3.1 70B Q4: about 40 GB — does not fit; this needs the 96 GB GEX131

The CPU path is for batch jobs that you can leave overnight. The GPU path is what you need for anything interactive.

VPS Comparison for Ollama

Hetzner Cloud CCX23: For 7B CPU inference

The minimum I would consider for Ollama with a 7B model. 16 GB RAM fits the model plus context, and dedicated CPU keeps the 5 to 7 tokens per second steady. Use this for personal assistant work, document summarization, or any batch task where 2-second response times are acceptable.

Do not use this for chatbots or interactive applications. The latency makes it painful.

Pros:

• Cheapest realistic Ollama setup
• 16 GB RAM gives headroom for 7B model plus reasonable context
• Dedicated CPU keeps inference rate steady

Get Hetzner: Hetzner Cloud.

Hetzner Cloud CCX33: For 13B CPU dev work

32 GB RAM fits a 13B model with comfortable context. CPU inference at 2 to 3 tokens per second is fine for development and testing, painful for production. Use this when you need to validate that your prompts work on a 13B model before committing to GPU hosting.

Honest take: 138.49 EUR a month for slow CPU inference is hard to justify against renting a GPU hourly via Vast.ai for testing.

Hetzner GEX44: The serious production tier

234 EUR a month plus a one-off 114 EUR setup fee for an RTX 4000 SFF Ada with 20 GB VRAM is the cheapest dedicated GPU path to production Ollama in Europe. The 20 GB fits 7B and 13B models with generous context, and 32B at Q4 only just. It does not fit a 70B.

This is the right tier when:

• You serve a chatbot or interactive application on a 7B or 13B model
• Token cost would exceed 200 USD a month on API aggregators
• You need data residency or air-gapped deployment

The 64 GB of system RAM leaves room to run a Flowise or LangGraph orchestrator on the same machine. The GEX44 is offered in Falkenstein only.

If you need 70B, the next step up is the GEX131: an RTX PRO 6000 Blackwell with 96 GB of VRAM, 1,199 EUR a month plus a 599 EUR setup fee. That is a fivefold jump, and the point where renting by the hour elsewhere deserves a second look.

Get Hetzner: Hetzner Cloud.

Contabo VPS XL: For massive CPU batch jobs

27.49 EUR a month for 96 GB RAM lets you load 70B Q4 models on CPU. Inference at 0.5 to 1 token per second is unusable interactively but tolerable for overnight batch processing of document corpuses.

Pick this for niche batch use cases where total monthly throughput matters more than per-request latency.

Get Contabo: Contabo VPS.

What I Would Pick

For production Ollama with any interactive use on a 7B or 13B model: Hetzner GEX44 with GPU. For 70B: the GEX131, or hourly rental elsewhere if utilisation is low. For development and testing with 7B models: Hetzner CCX23. Skip CPU inference for 13B+ models unless you have a batch use case that genuinely fits. The token-per-second math does not work for anything else.

The broader VPS landscape sits at the SelfHostVPS comparison. Ollama pairs well with OpenWebUI, AnythingLLM, and most agent frameworks. See those guides for combined deployment recommendations.