Skip to content
Main Site News Console

Why the RTX 5090 Costs $5,000: AI Companies Are Buying Gaming GPUs by the Pallet

· Reddit · r/LocalLLaMA Translated
Reddit

Top Discussions

thefuckevengoingonan (⬆46): I saw this picture at least a few months ago. trucorsair (⬆197): As if this is somehow news to you? johnnydotexe (⬆58): Before seeing this picture, couldn’t you deduce on your own that 5090s being scalped to $5,000 was almost certainly due to the AI craze? brickout (⬆94): …We already knew that. LelouchZer12 (⬆26): Absolutely. They sell for around $3,000, and if you don’t need massive VRAM, they’re nearly as fast as those $20,000 to $40,000 GPUs. Plus, over in China, they’ve been soldering on huge amounts of extra memory—somehow cooking up 90GB 5090s! jacek2023 (⬆44): Redditors finally figure out how the world works. Coming up next: Why big corporations don’t cater to Reddit “experts.” Square_Alps1349 (⬆37): I’m starting to think they aren’t scooping up 5090s for economic efficiency at all, but rather to strangle Local AI. The 5090 is certainly a great chip for consumers, but lacking NVLink makes it awful for large-scale training or proper Tensor Parallel inference. Compared to genuine enterprise-grade hardware, its VRAM is pretty limited too. So I genuinely feel these people aren’t buying them to actually use them—it’s purely to make them harder for us to get. Total jerks. Arli_AI (⬆31): Over PCIe P2P in multi-GPU servers, the 5090 is more than capable of handling token generation for inference. The photo in the article shows exactly that: 5090s being deployed en masse into 8-GPU server chassis for that very purpose.