Meta's Next Llama AI Models Are Training on a GPU Cluster ‘Bigger Than Anything’ Else
Meta is leading in AI development with Llama 4, using a cluster of 100,000 H100 chips for training. Their open-source approach with Llama models is gaining popularity among startups and researchers. Other competitors like OpenAI and Google are also developing advanced AI models with new capabilities. Energy consumption and costs are significant challenges.