You have to split your code so numerically intense parallel routines are offloaded to the GPU and serial work remains on the CPUs. The GPU is a distinct device, and you have to move data back and forth between these devices. The latter takes energy, the former takes money. Perhaps with GenAI coding assistants, this hybrid computing model can be made easier to implement.