LLM cost calculator: cloud API vs local GPU

For a given workload, estimate monthly cost on a cloud API offering and the cost of running an equivalent open-weight model on your own GPU hardware, with amortisation, energy and labour made explicit. Not a benchmark: local throughput is estimated from hardware specifications with efficiency factors you can override below. All amounts in USD. EUR display

Fairness controls

Quality impact of fp8 quantisation is not modelled; this comparison is cost only.

Amortisation horizon
Workload
Or compute from requests/day
Cloud

$0.90 / month ($0.0904 / Mtok effective)

$0.0255 / 1M chars (o200k, blended slice)

Breakdown
Input$0.30
Output$0.58
Cache read$0.0259
Cache write$0.00
Batch saving-$0.00
Per-request fees$0.00
Other hosts of this model
Host$/month$/Mtok
DeepSeek V4 Flash (OpenRouter)$1.13$0.11
DeepSeek V4 Flash (DeepInfra, fp8)$1.13$0.11
DeepSeek V4 Flash (DigitalOcean)$1.23$0.12
DeepSeek V4 Flash (Fireworks AI)$1.32$0.13
DeepSeek V4 Flash (DeepInfra)$1.60$0.16
DeepSeek V4 Flash (DeepInfra, fp8+priority)$1.70$0.17
DeepSeek V4 Flash (NVIDIA)$1.71$0.17
DeepSeek V4 Flash (SiliconFlow, fp8)$1.72$0.17
DeepSeek V4 Flash (Venice)$1.73$0.17
DeepSeek V4 Flash (StreamLake, fp8)$1.76$0.18
DeepSeek V4 Flash (GMI Cloud, fp8)$1.76$0.18
DeepSeek V4 Flash (Baidu, fp8)$1.76$0.18
DeepSeek V4 Flash (Novita AI, fp8)$1.76$0.18
DeepSeek V4 Flash (Atlas Cloud, fp4)$1.76$0.18
DeepSeek V4 Flash (Novita AI)$1.76$0.18
DeepSeek V4 Flash (Crusoe, fp8)$1.76$0.18
DeepSeek V4 Flash (Parasail, fp8)$1.83$0.18
DeepSeek V4 Flash (Alibaba Cloud, fp8)$1.88$0.19
DeepSeek V4 Flash (Alibaba Cloud, fp8)$1.88$0.19
DeepSeek V4 Flash (Nebius AI Studio)$1.96$0.20
DeepSeek V4 Flash (Relace, fp4)$2.10$0.21
DeepSeek V4 Flash (Wafer)$2.38$0.24
DeepSeek V4 Flash (Azure AI Foundry)$2.89$0.29
DeepSeek V4 Flash (Mancer, fp8)$3.05$0.30
DeepSeek V4 Flash (Azure AI Foundry)$3.18$0.32
DeepSeek V4 Flash (Wafer, mxfp4)$3.56$0.36
DeepSeek V4 Flash (DeepSeek)$6.07$0.61
DeepSeek V4 Flash (OpenInference, fp4)$6.25$0.63
DeepSeek V4 Flash (Cloudflare Workers AI)$7.15$0.72
Local hardware
Custom hardware (used only when Hardware = Custom)
Cost assumptions
Advanced: measured throughput overrides
Cloud$0.90 / mo
Local, workload$– / Mtok
Local, capacity$– / Mtok
Cheapercloud

Breakeven and sensitivity

Breakeven volume: – tokens/month. Breakeven utilisation: –.

Monthly cost vs. tokens/month

Cloud cost scales linearly with volume; local cost steps up each time another box is needed. Log scale on tokens/month.

Assumptions

KeyValueSourceOverridden
hoursPerMonth730Units: a month is 730 hours (8,760 hours per year divided by 12)no
daysPerMonth30.4Workload: 30.4 days per month when converting requests per dayno
weightsOverheadFactor1.05Memory model: weights take 5% more memory than their raw sizeno
fixedOverheadGb2Memory model: 2 GB reserved for runtime and buffersno
tpEffPcie0.85Memory model: tensor-parallel efficiency over PCIeno
tpEffNvlink0.95Memory model: tensor-parallel efficiency over NVLinkno
tpEffUnified1Memory model: no tensor-parallel loss on a single unified-memory machineno
defaultContextTokens81928192 tokens; typical chat context, editableno
decodeEff0.7Throughput model: decode reaches 70% of memory-bandwidth speedyes
prefillEff0.5Throughput model: prefill reaches 50% of peak computeyes
batchEffK0.04Throughput model: batching efficiency 1 / (1 + 0.04 (n - 1))yes
utilisation0.3Throughput model: hardware busy 30% of the month, editableno
maxUtilisation0.95Throughput model: a box is never loaded above 95%no
sparesPct0.1Monthly cost: 10% added to hardware cost for sparesno
residualPct0.2Monthly cost: 20% of the GPU price recovered at the end of the horizonno
loadFactor0.8Monthly cost: GPUs draw 80% of rated power under loadyes
horizonMonths36Monthly cost: hardware written off over 36 months (24 and 48 offered)no
labourHours2Monthly cost: 2 hours of upkeep per month, editableno
labourRate60Monthly cost: $60 per hour of upkeep, editableno
hostingMonth0Monthly cost: no hosting or colocation fee unless you enter oneno
softwareMonth0Monthly cost: no software or support fee unless you enter oneno
electricityUsdKwh0.1453US commercial average retail price, EIA Electric Power Monthly table 5.6.A, July 2026 (14.53 cents per kWh)no
latencyTargetTps20Workload: an interactive stream should reach 20 tokens per secondno
tokenizerSliceblendedTokenizer normalisation: blended average over the measured corpus slicesyes