Simultaneously running all the A100s forced Redmond to consider how it placed them and their power supplies. The company won't say precisely how much the endeavor cost, but executive vice president Scott Guthrie put the number above several hundred million dollars.Īlso read: Has Nvidia won the AI training market? However, Microsoft didn't have the hardware in-house for what OpenAI needed.Īfter acquiring Nvidia's chips, Microsoft had to rethink how it arranged such a massive number of GPUs to prevent overheating and power outages. The challenge facing the companies started in 2019 after Microsoft invested $1 billion into OpenAI while agreeing to build an AI supercomputer for the startup. Microsoft announced a new array utilizing Nvidia's newer H100 GPUs this week. The news comes as Microsoft announces a significant upgrade to its AI supercomputer to further its homegrown generative AI initiative.Īccording to Bloomberg, OpenAI trained ChatGPT on a supercomputer Microsoft built from tens of thousands of Nvidia A100 GPUs. Forward-looking: A new report has revealed the enormous amount of Nvidia GPUs used by Microsoft and the innovations it took in arranging them to help OpenAI train ChatGPT.

Bitwarden ff