xAI using inference compute and reasoning to synthesize/curate training data: Grok processes Wikipedia, books, PDFs, websites to identify false/incomplete information and generate corrected versions for next training run

“we're we're running a lot of using a lot of of inference compute and um and reasoning to look at all of the source data which is really the corpus of human knowledge and then uh thinking about each piece of information and then adding mod adding what's missing um and correcting correcting mistakes and removing falsehoods from the from that training data... Grock is using um heavy amounts of inference compute to say to look at as an example a Wikipedia page and say uh what is true, partially true or false or missing uh in this page. Now rewrite the page to in to correct the remove the falsehoods”