Created: May 02, 2021
Modified: May 02, 2021
Modified: May 02, 2021
datacenter
This page is from my personal notes, and has not been specifically reviewed for public consumption. It might be incomplete, wrong, outdated, or stupid. Caveat lector.- How much compute does a typical Google data center have? Where would it fall on the supercomputer rankings?
- The top computer on the TOP500 list currently does 500kTflops/second.
- GPT3 required flops to train.
- A Tesla p100 is 5Tflops per second
- 45 TFlops per TPU times 200k would be 9 million TFLOPs