Analysis.CastroMedia.org

Description

Mark Zuckerberg controls Meta and its AI infrastructure.

Scope

  • Meta deployed a training cluster with 24,000 NVIDIA H100 GPUs to support Llama 3, providing roughly 5×10^19 dense INT8 operations per second.12
  • Meta plans to purchase up to 350,000 H100 GPUs, which would raise future capacity substantially.3
  • Zuckerberg holds majority voting power at Meta, controlling about 51% of the company.4

Total compute: about 5×10^19 dense INT8 operations per second under his direction.

Implications

Zuckerberg’s control centralizes vast compute resources under a single individual, concentrating decision-making and increasing the risks associated with unchecked deployment of powerful AI systems. This centralization also enables rapid development and experimentation at global scale.

Works cited

  1. Observer, “Meta Buys 24,000 H100s for Llama 3,” 2024. https://observer.com/meta-24000-h100-gpus/ 

  2. Colfax, “NVIDIA H100 Tensor Core GPU,” 2023. https://colfaxresearch.com/nvidia-h100-performance/ 

  3. Observer, “Meta Plans 350,000 H100 GPUs,” 2024. https://observer.com/meta-350000-h100-gpus/ 

  4. Reuters, “Zuckerberg retains majority voting control at Meta,” 2023. https://www.reuters.com/technology/zuckerberg-retains-majority-voting-control-meta-2023-03-15/