“I get asked all the time what I think about training versus inference – I'm telling you all to stop talking about training versus inference.” So declared OpenAI VP Peter Hoeschele at Oracle’s AI ...
Every GPU cluster has dead time. Training jobs finish, workloads shift and hardware sits dark while power and cooling costs keep running. For neocloud operators, those empty cycles are lost margin.