Free Open-Source Artificial Intelligence @lemmy.world Even_Adder @lemmy.dbzer0.com 12 mo. ago

DiLoCo: Distributed Low-Communication Training of Language Models