Nvidia and Mistral AI's super-accurate small language model works on laptops and PCs
Nvidia and Mistral AI have released a new small language model that purportedly features “state-of-the-art” accuracy in a tiny footprint. The new LM is known as theMistral-NemMo-Minitron 8B, a miniaturized version of NeMo 12B that has been pruned from 12 billion to 8 billion parameters. The new 8 billion-parameter small language model was shrunken down through two different AI optimization methods, said Bryan Catanzaro, VP of deep learning research at Nvidia,in a blog post....