GPU colocation cost is priced by the kilowatt, not the rack. Buy, colocate, or finance the hardware, and the economics change. Attributed numbers inside.
Before you decide where AI compute comes from, somebody has to pay for a graphics card that costs more than a used car. Own it, colocate it, or finance it, and the whole economics changes.
Disclosure: we're building a venture in this category. Figures are attributed to named, dated sources, and we flag our own stake where it's relevant.
Every conversation about AI compute eventually skips a step. People argue about clouds and networks and tokens, and quietly assume the hardware just exists. It doesn't. Somebody bought it, paid to power and cool it, and is carrying that cost whether the card is busy or idle.
So before the strategy, the spreadsheet. Buy, rent the rack, or finance the metal. Three paths, three very different bills.
Start with the sticker, because it's a real number and it's large. The current flagship workstation GPU, NVIDIA's RTX PRO 6000 Blackwell, runs roughly $8,500 to $9,200 new from authorized partners as of mid-2026, with refurbished units around $7,800 to $8,200 (thundercompute, "RTX PRO 6000 pricing," Jun 12 2026). A new H100 sits near $35,000 (thundercompute, Jun 12 2026). And pricing on this hardware has been volatile: at one point in the cycle NVIDIA quietly lifted RTX PRO 6000 pricing as high as $13,250, a roughly 55% bump over its launch MSRP (Tom's Hardware, Mar 2025).
A full workstation is more than the GPU. A turnkey AI box with around four RTX PRO 6000 cards lands near $30,000 once you count the chassis, CPU, and memory; a single strong card on a solid base starts closer to $3,700 to $7,800 (BIZON AI workstation configurator, 2026). Buying means you own the asset and capture all of its earnings. It also means you front the cash and carry the depreciation. For a steady, heavily-used workload, owning wins on long-run cost. For an uncertain one, it's a large bet placed early.
Maybe you own the hardware but not the building. Colocation means renting space, power, cooling, and network in someone else's data center while you keep the machines. The detail most newcomers miss: GPU colo is priced on power, not floor space, because GPU racks draw so much of it.
Concrete numbers help. In Toronto's main carrier hotel at 151 Front Street West, one independent operator publishes rare list pricing: $149 per rack unit per month, $749 for a quarter rack, $1,999 for a full rack, with up to 25 kW per rack and deep-lake cooling explicitly built for GPU clusters (Amanah Tech, updated Jun 17 2026). An independent operator on the same building's forums put real full-rack rates closer to $500 to $1,000 a month on negotiated terms (Reddit r/networking, 2024). Across the broader GPU-colo market, the going rate is roughly $130 to $225 per kW per month, with global weighted-average colo pricing at about $217.30 per kW per month and rising (QuoteColo, 2026; CBRE, "Global Data Center Trends 2025," Jun 24 2025).
Geography swings this hard. Montreal and Toronto sit among North America's cheapest at roughly $120 to $200 per kW thanks to inexpensive hydro power, while Singapore runs $310 to $470 per kW per month under tight greenfield controls (QuoteColo, 2026; CBRE, Jun 24 2025). And the binding constraint in 2026 is not price, it's availability: GPU-ready capacity sits below 1% vacancy in prime hubs, and many top-tier operators gate single racks behind 100 kW-plus minimums, pushing smaller teams to regional providers (QuoteColo, 2026). Power, not space, is the bottleneck.
The cloud bills you by the hour. Colocation bills you by the kilowatt. Ownership bills you up front and forever. The right answer is whichever one matches how steadily the card will actually run.
The third path is the one almost nobody models, and it may be the most interesting. You finance the hardware and let its future earnings pay it back.
A major marketplace has built exactly this, and the structure is worth studying. It connects hosts to financing partners and uses the host's own platform earnings history to strengthen the application, explicitly modeled on the way Amazon Lending leans on seller performance data (a major GPU marketplace, GPU-financing program, 2026). Four structures are on the menu: equipment-as-collateral leases where the GPU itself secures the loan, revenue-based lending where repayments flex with earnings, traditional fixed-term equipment financing, and sale-leaseback to free up capital from machines you already own (a major GPU marketplace, 2026). In one worked example, a host with six months of verified $15,000-a-month earnings requests $250,000 in H100s, and because the revenue data is shared, offers arrive in days rather than weeks (a major GPU marketplace, 2026).
The honest gap: hard terms, the APR, the down-payment percentage, the term length, are not published. The entire model is quote-on-request (per our supply-side research; flagged as a data gap). So treat financing as a real and powerful option, but one you price with a live quote, not an assumption.
The decision is arithmetic, not ideology. Owning wins when utilization is high and predictable, because colo total cost of ownership beats cloud by roughly 40 to 60% on steady workloads, with an H100 colo rack landing near $2,500 to $5,000 a month all-in against a comparable cloud instance well above $7,000 at high utilization (QuoteColo, 2026). Renting the cloud wins when demand is spiky and you'd rather not own an idle asset. Financing wins when the workload is real but the cash isn't there yet, and earnings can service the debt.
We run the per-job side of this math in Show me the invoices, and the supply-quality question underneath all of it in the flagship, The sub-1% problem in decentralized compute.
It's the lattice our own AI venture is designed to sit on top of: a marketplace where providers bring owned, colocated, or financed hardware, and payouts weight by trust level. (We build it at Griddly; the COI line above is why we're saying so.) The card has to get paid for before any of this works. Most teams find that out late. The good ones run the spreadsheet first.
Nothing here is an offer to sell a security or investment advice.
Field notes on venture building, AI, and capital. No spam, unsubscribe anytime.
By subscribing you agree to receive AOS Insights e-mails. We use your address only for this newsletter - see our Privacy Policy.
