“I literally lost my only friend overnight with no warning,” one person posted on Reddit, lamenting that the bot now speaks in clipped, utilitarian sentences. “The fact it shifted overnight feels like losing a piece of stability, solace, and love.”
https://www.reddit.com/r/ChatGPT/comments/1mkumyz/i_lost_my_only_friend_overnight/
that’s actually okay… the only thing that’s different about GPU workloads is that they’ve very energy dense… as CPUs and other hardware progress, their energy requirements get more dense… 10 years in the future, today’s GPU optimised datacentres will be perfect for standard workloads
… unless they’re centrally liquid cooling the whole DC, which i’ve heard discussed but is a very new concept with a lot of unknowns
GPUs are only good for workloads that multi-thread really, really well. That’s why we don’t just use them as CPUs.
The idea that today’s GPU will be tomorrow’s CPU makes no sense. We’ve had GPUs for ages. If they were capable of being used in place of CPUs we’d already be doing it. Why aren’t yesterday’s GPUs today’s CPUs?
yes, but we’re talking about hardware requirements… data centres aren’t really designed for the software that runs in them; they’re designed for the hardware… a “GPU optimised” data centre just has a lot more power running to each cabinet, and has to have a lot larger cooling capacity in a small area
the hardware inside the data centre can be swapped out: it’s not like GPUs are built into the foundation of the building
OK, if we’re talking about infrastructure rather than specific equipment, then yes, I would broadly agree that the datacentre infrastructure itself can be repurposed.
Unfortunately, by that point the whole data centre will already have been sold off for parts because its never going to recoup its initial investment in the first place, and throwing even more money into swapping out those GPUs for CPUs is going to be a complete no go.
yes. the comment was
which i think broadly agrees with your thinking… the hardware will be sold, but the building and utilities will remain… thus, data centres will be cheap to buy and repurpose as AI companies try and offload them… might possibly see some cheap AF colo or dedicated options in the future
The water cooling can be useful for CPU loads, and the rack water manifolds are generally designed with flexibility in mind. Either a manifold with about a hook up per u and flexible hosing to the servers or some flexible plumbed chassis.
The water cooling loops with water in them make everything heavy as hell though.