Jul 2, 2024 8:16 PM CDT Updated Jul 2, 2024 9:17 PM CDT 2 minutes & 35 seconds read time Elon Musk's AI startup is training its next-generation Grok 3 LLM model, which is being trained on a monster 100,000 x NVIDIA H100 AI GPUs. In a new post on X, the SpaceX and Tesla founder talked about his xAI start-up, replying to @BasedBeffJezos on X who was replying to @BasedBeffJezos who posted a video from Aidan Gomez, the CEO and co-founder of Cohere, who said "models training on each other's data is like a human centipede effect". This is where Musk replied, saying: "Sadly quite true. It takes a lot of work to purge LLMs from the internet training data. Grok 2, which comes out in August, will be a giant improvement in this regard". This is where @BasedBeffJezos said "Grok 2 in August will be Based AGI". Musk replied again, saying: "Grok 3 end of year after training on 100K H100s should be really something special". Popular Now: