Google DeepMind unveiled a way to train advanced AI models across distributed data centers. Known as decoupled distributed low-communication (DiLoCo), the architecture isolates local disruptions such ...