Nvidia’s $3,000 ‘Personal AI Supercomputer’ Will Let You Ditch the Data Center

Spread the love

Nvidia already sells a boatload of proprietary computer chips that every major company makes Artificial intelligence Model but now in such a moment when the public interest Dr Open source And with do-it-yourself AI on the rise, the company announced that it will offer a “personal AI supercomputer,” starting at $3,000 later this year that anyone can use in their own home or office.

Nvidia’s new desktop machine, dubbed Digits, goes on sale in May and is about the size of a small book. It includes an Nvidia “superchip” called the GB10 Grace Blackwell optimized to accelerate the calculations needed to train and run AI models, and is equipped with 128GB of unified memory and up to 4TB of NVMe storage to handle especially large AI programs.

Jensen Huang, Nvidia’s founder and CEO, announced the new system along with several other AI offerings during a keynote speech today. CESAn annual confab for the computer industry held in Las Vegas (you can see all the biggest announcements Wired CES Live Blog)

“Putting an AI supercomputer on the desk of every data scientist, AI researcher and student empowers them to engage and shape the age of AI,” Huang said in a statement released ahead of his keynote.

Nvidia says Digit Machine, which stands for “Deep Learning GPU Intelligence Training System,” will be able to run a single large language model with up to 200 billion parameters, a rough measure of a model’s complexity and size. To do this today, you have to rent space from a cloud provider like AWS or Microsoft, or build a custom system with a handful of chips designed to run AI. If two Digit machines are connected using a proprietary high-speed interconnect link, Nvidia says they’ll be able to run most capable Mater has an open source version of the Llama model available, which has 405 billion parameters.

The figures are fanciful and will make it easier for researchers to experiment with models that come close to the fundamental power OpenAI’s GPT-4 or Google’s Gemini In their office or basement. But the best versions of those proprietary models inside the giant data centers owned by Microsoft and Google are probably bigger and more powerful than anything that can handle the digits.

Nvidia is one of its biggest beneficiaries The AI ​​Boom. Its stock price has skyrocketed over the past few years as tech companies clamor to buy large quantities of the advanced hardware chips it makes, a critical component for developing sophisticated AI. The company has proven adept at optimizing hardware and software for AI, and its product roadmap has become an important signal of where the industry is expected to go next.

When it’s released, Digit will be the most powerful consumer computing hardware Nvidia offers. It already sells a range of chipsets for AI development called Jetson that start at roughly $250. They can run small AI models and can either be used like a mini desktop computer or installed on a robot to test various AI programs.

Leave a Reply

Your email address will not be published. Required fields are marked *