AI server cost in 2026: buy, rent or colocate an 8-GPU server

What an 8-GPU AI server costs in 2026: purchase prices, hourly cloud rates, monthly rental and colocation, with every figure sourced and dated.

An open Supermicro GPU server with a row of NVIDIA graphics cards, power cables and AMD EPYC processor coolers
Photo: Client Project Hashcat Testing With an AMD Epyc Supermicro Nvidia GPU Server Using Proxmox (Lawrence Systems) 07 by Lawrence Systems, Wikimedia Commons, CC BY 3.0

There are four ways to get an 8-GPU AI server: buy it, rent GPUs by the hour, rent a whole machine by the month, or buy one and place it in someone else's data centre. Below are the published prices for each path in October 2026, using the NVIDIA RTX PRO 6000 Blackwell (96 GB) as the example card, so the numbers compare like with like.

If you... The path that usually fits Cost for 8 × RTX PRO 6000, published prices
need GPUs for days or a few weeks, or are still testing Hourly cloud $2.49 per GPU-hour on RunPod, about $14,540 a month if run 24/7
run steady work for months and do not want to own hardware Monthly dedicated server about $9,930 a month at NEOXIS; €11,622 to €13,949 at AIME in Berlin
will use the machine fully for three years or more and have people to run it Buy and colocate €168,524 to €241,261 to buy, plus rack space, power and your own time
need everything inside a hyperscaler (IAM, VPC, compliance) Hyperscaler instance $33.14 an hour for AWS g7e.48xlarge in US East, about $24,195 a month

All prices exclude VAT. The sections below show where each number comes from and what it leaves out.

Buying: €168,000 to €241,000 for the server alone

A European server reseller, Servermall, lists eight in-stock 4U servers with 8 × RTX PRO 6000 Blackwell on 12 October 2026. Before VAT they range from €168,524 (GIGABYTE G494-ZB4-AAP2, 2 × EPYC 9655, 768 GB RAM) to €241,261 (ASUS ESC8000A-E13P, 2 × EPYC 9845, 1.5 TB RAM). At the ECB rate of 9 October 2026 (1 EUR = 1.1206 USD), that is about $189,000 to $270,000. In the UK, Punch Technology lists an ASUS ESC8000A-E13P with 2 × EPYC 9555 and 768 GB at £201,576 including VAT.

The eight GPUs are the same in every configuration. The spread of more than €70,000 comes from the chassis, the processors and the amount of memory.

Spread over three years, the purchase alone works out to about €4,700 to €6,700 a month. That is before you plug it in anywhere.

Running it: power and colocation

An 8-GPU server needs a rack, cooling and power that most offices cannot provide. Our own server with 8 × RTX PRO 6000 Server Edition draws about 1.1 kW at idle and about 6.5 kW with all eight GPUs under full load, measured at the wall; a synthetic stress test of every CPU core and GPU at once pushes it just under 7 kW, which no real workload reaches. At 6.5 kW for a whole month (730 hours), that is about 4,750 kWh.

Electricity. The EU average price for business customers using 500 to 2,000 MWh a year was €0.1837 per kWh in the second half of 2025, without VAT (Eurostat). In Germany it was €0.2058 in the first half of 2026. At full load all month, that is about €870 to €980 a month for the server, before any cooling overhead your provider charges for.

Rack space. Colocation for AI is priced per kilowatt. CBRE reports Q1 2026 rates of $165 to $265 per kW a month across Europe's four main data centre markets, with Frankfurt at the top ($235 to $265). These are rates for deployments of 250 to 500 kW, so a single server will usually pay more. Even at those rates, reserving 7 kW costs about $1,150 to $1,850 a month, and electricity is often billed on top.

Add it up and owning one 8-GPU server in a colocation facility costs roughly €6,600 to €9,300 a month over three years, before:

  • Your time. Someone installs drivers, patches the OS, watches temperatures and handles failures.
  • Spare parts and downtime. A failed GPU or power supply is out of service until it is replaced.
  • Network. Transit and ports are often priced separately from rack space.

What you get in return is the hardware itself. After three years it still has resale value, and you can run it as long as it is useful.

Hourly cloud: flexible, but expensive at full time

Hourly rental is the right way to start: you pay only while the machine runs. On 12 October 2026, RunPod lists the RTX PRO 6000 (96 GB) at $2.49 per GPU-hour on its pricing page. Eight GPUs for a full month (730 hours) would cost about $14,540.

Hyperscalers cost more for the same card. AWS g7e.48xlarge has 8 × RTX PRO 6000 Blackwell Server Edition, 192 vCPUs and 2 TB of memory. On demand it costs $33.14 an hour in US East (N. Virginia), about $24,195 for a full month, and $56.36 an hour in Frankfurt. You pay for the cloud around it: managed networking, identity, storage and the rest of the AWS services.

The point where hourly stops making sense is simple to work out. At RunPod's listed rate, eight GPUs cost $19.92 an hour, so a $9,930 monthly server costs less as soon as you use all eight for about 500 hours a month, roughly two thirds of the time.

Monthly dedicated server: fixed price, nothing to run

A dedicated server rented by the month sits between the two. You get the whole machine with root access, the provider pays for power, cooling, rack space and the network, and the price is fixed for the term.

Few providers publish these prices. In our comparison of RTX PRO 6000 server prices in Europe, checked on 8 October 2026, AIME in Berlin listed 8 × RTX PRO 6000 at €11,622 to €13,949 a month, depending on the term.

Our own dedicated GPU server starts at $1.70 per GPU-hour, about $9,930 a month for the whole machine: 8 × RTX PRO 6000 Server Edition, 2 × EPYC 9754, 1.5 TB of RAM, 2 × 4 TB NVMe and a 1 Gbps unmetered uplink, in a data centre near Sofia, Bulgaria. Power, cooling, rack space and support are included, and there is no setup fee. The limits are honest ones: one location, one configuration, and a 1 Gbps uplink. Details are on the pricing page.

How the paths compare over time

The longer and steadier the work, the more owning pays off. The shorter or less certain, the more renting does.

  • Under a few months: hourly cloud. Nothing to commit to, and you learn what you actually need.
  • Several months to about two years: a monthly server. Over three years, owning in colocation (€6,600 to €9,300 a month) costs about the same as renting or a little less, but only if the machine is busy all the time and someone on your team runs it.
  • Three years and more, fully used, with your own team: buying starts to win, because the server keeps its resale value after the last payment.

One more cost is easy to miss: the GPUs you buy today stay the GPUs you have for as long as you own the server. A rented server can be swapped for a newer generation at the end of the term.

Questions

Why does the same GPU cost so much more on AWS? The hourly price includes AWS networking, storage integration, identity management and on-demand capacity in many regions. If you need those services, the price buys something. If you only need the GPUs, a specialised provider is cheaper.

Is power the main running cost? Not usually. At EU business rates, a full month at 6.5 kW is about €870 to €980. The purchase, spread over three years, costs about five to eight times that.

Do these prices include VAT? No. All purchase, rental and electricity prices in this article are without VAT, except Punch Technology's UK price, which the shop shows with VAT.

Can I rent fewer than eight GPUs? On hourly clouds, yes, usually one at a time. Our server is rented as a whole machine.

Sources

All pages were checked on 12 October 2026 unless stated otherwise.

SHARE