CIOs and IT leaders have called it the most disruptive technology ever, and it’s now fast becoming mainstream.
Artificial intelligence (AI) has emerged as an increasingly important part of the world of technology.
More than 91% of companies surveyed continue to invest in artificial intelligence and are increasing.
However, deploying AI workloads at speed and scale requires software and hardware to work together across data centers and edge locations.
Fundamental IT infrastructure such as GPUs and CPU-based processors must offer significant capacity and performance leaps to run AI efficiently. Without high performance levels, AI workloads can take months or years to run. This enables organizations to accelerate AI progress.
Dell Technologies’ recent developments in hardware and software solutions are advancing AI, reflecting AI software capabilities that do just that.
Specifically, Dell Technologies’ next-generation products offer an 8-10x performance improvement, according to MLCommons. ®MLPerf™ Benchmark. Dell Technologies’ upgraded portfolio of solutions includes GPU-optimized servers for AI training and CPU-powered servers for his AI inference across the enterprise, both of which are essential coexisting elements of AI deployments.
MLCommons MLPerf result
The benchmark used MLPerf Inference, an updated version 3.0 from MLCommons. The latest results are displayed here. Benchmarks include categories such as image classification, object detection, natural language processing, speech recognition, recommender systems, and medical image segmentation.
While the inference benchmark rules haven’t changed significantly, Dell Technologies has expanded its submissions with new generations of Dell PowerEdge servers, including new PowerEdge XE9680, XR7620, and XR5610 servers and new accelerators from partners. Submissions were made with VMware running on NVIDIA AI Enterprise software and NVIDIA accelerators, with Intel-based CPU-only results.
Dell Technologies next-generation processor results stand out for the highly demanding use cases of AI training, generative AI model training and tuning, and AI inference. When compared to previous generation hardware, the results show a significant improvement in performance.
- 8-10 times Improved performance.
- 6-8 times Improved performance.
More detailed results can be found here.
AI in action
AI data center and edge deployments require a highly interdependent ecosystem of up-level software and hardware capabilities, including a mix of GPU-based and CPU-based processors.
Each industry and organization can tailor their infrastructure based on their unique needs, preferences and requirements.
For example, consider a pharmaceutical company using AI modeling and simulation for drug discovery.
Modern development is based on chemists discovering highly active molecules that are also negative for neurotoxicity. There are trillions of compounds to consider and evaluate.
Each search takes almost two months and thousands of dollars, limiting the number of searches and tests you can run. With AI, simulations can interrogate more molecules much faster and cheaper, opening up a world of new possibilities.
To accelerate drug discovery (thousands of diseases, only hundreds of treatments), pharma companies need powerful processors to efficiently and effectively process large and diverse data sets and
Retailers typically use AI differently than pharmaceutical companies. Retail use cases often revolve around video images used to enhance security, enhance intrusion detection, and support self-checkout functionality. To power newly discovered capabilities in these areas, retailers need more powerful GPU-optimized processors to process image-based data streams.
Evolution of AI
New generative AI use cases, such as digital assistants and software development co-pilots, are emerging as the next frontier for AI. That’s why at Dell Technologies, innovation never rests. When it comes to technology infrastructure, Dell Technologies and its partners are constantly innovating to reach new performance levels and help redefine what’s possible.
Exponential Performance Boost for NVIDIA GPU-Optimized Servers and Bringing AI Inference to Intel’s Servers® Zeon®The base server is creating the necessary AI foundation. With these results, Dell Technologies helps organizations accelerate their AI transformation with precision and efficiency, including new AI training and inference software, generative AI models, AI DevOps tools, and AI applications.
***
Dell Technologies. To help your organization move forward, Dell Technologies is driving your AI journey, including enterprise generative AI. With best-in-class IT infrastructure and solutions to run AI workloads, and advisory and support services to roadmap AI initiatives, Dell helps organizations accelerate their digital transformation and accelerate intelligent outcomes. to
Intel. The compute required for AI models has spotlighted performance, cost, and energy efficiency as top concerns for enterprises today. Intel’s commitment to the democratization and sustainability of AI enables broad access to the benefits of AI technologies, including generative AI, through an open ecosystem. Intel’s AI hardware accelerators, including new built-in accelerators, deliver performance and performance-per-watt improvements to meet the growing needs of AI performance, price, and sustainability.
