Next-Gen AI Is Coming to a Desktop Near You

Image credit: iStockphoto/Jacob Wackerhausen

Digital transformation, especially in the Generative AI and digitalization realm, is taking a seismic leap forward. In collaboration with a host of global manufacturers, NVIDIA has rolled out a line of high-powered NVIDIA RTX™ workstations tailored for modern development and content creation needs.

These cutting-edge systems, hailing from renowned names like BOXX, Dell Technologies, HP, and Lenovo, hinge on the dynamic NVIDIA RTX 6000 Ada Generation GPUs. Additionally, they come integrated with the NVIDIA AI Enterprise and the NVIDIA Omniverse™ Enterprise software, ensuring a seamless and efficient working experience.

Bob Pette, NVIDIA's vice president for professional visualization, said, "Few workloads are as challenging as generative AI and digitalization applications, which require a full-stack approach to computing." Pette emphasized that with these latest NVIDIA-powered RTX workstations, professionals can create vast digitalized environments, heralding a new era in generative AI.

And the specifications are nothing short of impressive: the new RTX workstations can host up to four NVIDIA RTX 6000 Ada GPUs. Each of these GPUs comes packed with 48GB of memory. A singular desktop workstation can deliver up to 5,828 TFLOPS of AI performance with a staggering 192GB of GPU memory.

On the software front, NVIDIA AI Enterprise 4.0, which was also introduced today, encompasses NVIDIA NeMo™—an end-to-end solution for shaping foundational models for Generative AI. It also brings NVIDIA RAPIDS™ libraries to the table, catering to data science applications and other tools for standard enterprise AI use cases.

Omniverse Enterprise stands as a beacon for industrial digitalization. It offers teams a platform to craft interoperable 3D workflows and OpenUSD applications, fostering collaboration on intricate 3D datasets.

Jason Schnitzer, chief technology officer at Yurts, which is looking to bring LLMs to enterprises, hailed the efforts. He stated, “Yurts provides a full-stack generative AI solution aligning with multiple form factors, deployment models and budgets of our customers. We’ve achieved this by leveraging LLMs for various natural language processing tasks and incorporating the RTX 6000 Ada. From private data centers to workstation-sized solutions that fit under a desk, Yurts remains committed to scaling our platform and offering alongside NVIDIA.”

Moreover, the NVIDIA AI Workbench, set to be available in early access soon, promises a unified toolkit. This will enable developers to design, tweak, and execute generative AI models with unparalleled ease.

The newly introduced NVIDIA RTX 5000, RTX 4500, and RTX 4000 GPUs carry forward NVIDIA's legacy with the latest technologies. They boast up to 2x the single-precision floating-point throughput and advanced AI training performance.

From architectural firm Lake|Flato, Dan Stine reflected on the advancements, saying, "The NVIDIA RTX 5000 Ada GPU demonstrates NVIDIA's impressive generational performance improvements—it has significantly increased our efficiency in creating stereo panoramas using Enscape."

For those waiting for these powerhouses, RTX workstations with up to four RTX 6000 Ada GPUs, NVIDIA AI Enterprise, and NVIDIA Omniverse Enterprise will be available from system builders this fall.

Image credit: iStockphoto/Jacob Wackerhausen