LLM cost calculator: cloud API vs local GPU
For a given workload, estimate monthly cost on a cloud API offering and the cost of running an equivalent open-weight model on your own GPU hardware, with amortisation, energy and labour made explicit. Not a benchmark: local throughput is estimated from hardware specifications with efficiency factors you can override below. All amounts in USD. EUR display
Breakeven and sensitivity
Breakeven volume: 1.68B tokens/month. Breakeven utilisation: 2.7%.
| Parameter | -50% | Base | +50% |
|---|---|---|---|
| Electricity ($/kWh) | $294.15 | $299.99 | $305.84 |
| Labour rate ($/h) | $239.99 | $299.99 | $359.99 |
| Hardware capex | $238.76 | $299.99 | $361.23 |
| Decode efficiency | $300.00 | $299.99 | $299.99 |
| Months | $/mo workload | $/mo capacity | $/Mtok workload | $/Mtok capacity |
|---|---|---|---|---|
| 24 | $384.15 | $400.04 | $38.41 | $0.0215 |
| 36 | $299.99 | $315.89 | $30.00 | $0.0170 |
| 48 | $257.92 | $273.81 | $25.79 | $0.0147 |
Monthly cost vs. tokens/month
Cloud cost scales linearly with volume; local cost steps up each time another box is needed. Log scale on tokens/month.