Microsoft has held a Build 2020 conference for developers from all over the world, and they live-streamed it online. Among some of the announcements, Microsoft has announced a new supercomputer dedicated to the OpenAI company, which works on building Artificial General Intelligence (AGI). The new supercomputer is a part of Microsoft's Azure cloud infrastructure and it will allow OpenAI developers to train very large scale machine learning models in the cloud. The supercomputer is said to be the fifth most powerful supercomputer in the world with specifications of "more than 285,000 CPU cores, 10,000 GPUs and 400 gigabits per second of network connectivity for each GPU server."

Specific information wasn't announced and we don't know what CPUs and GPUs go into this machine, but we can speculate that the latest Nvidia A100 "Ampere" GPU could be used. The company hasn't yet submitted its entry to the Top500 website, so we can't keep track of the FLOPs count and see what power it holds.