In just a few years, advances in generative AI (GenAI) technology have turbocharged the pace of AI innovation across many major industries. GenAI systems—such as large language models (LLMs)—can process and learn from enormous stores of diverse data and use the resulting knowledge to produce complex, creative responses to user queries. LLMs have the power to transform and optimize the ways that businesses gather, manage, and analyze data; create content; conduct research and development; support customers; and much more. For many organizations, the potential upsides of tools like LLMs are exciting, but the idea of deploying the necessary cloud infrastructure is daunting. However, a comprehensive AI solution comprised of the Dell APEX Cloud Platform, Red Hat OpenShift AI, and 4th Generation Intel Xeon Scalable processors can make the path to a powerful GenAI application quicker than some may expect.
We documented the process of setting up a Dell APEX Cloud Platform with Red Hat OpenShift AI solution and installing the popular pre-trained Llama 2 LLM. During the process, we followed the guidance of official Dell Validated Design and Red Hat OpenShift documentation. While we needed to make a few adjustments along the way, the Dell and Red Hat instructions enabled us to finish deploying an AI-ready on-premises cloud infrastructure solution in less than two hours.
In addition to being quick to deploy, the 4th Gen Intel Xeon Scalable processorpowered solution performed well while running Llama 2. To test performance, we had a single user query the LLM while we measured the latency of the solution’s response. We used 10 sample queries and observed that the LLM began its responses in under one second.
The Intel-powered Dell APEX Cloud Platform for Red Hat OpenShift solution worked well for our LLM use case. For businesses interested in adding the innovative power of generative AI to their operations, the quickly deployable and powerful Dell and Red Hat solution can help them get off to a fast start.
To learn more about how we deployed GenAI with Dell APEX Cloud Platform for Red Hat OpenShift, check out the report and infographic below.
Principled Technologies is more than a name: Those two words power all we do. Our principles are our north star, determining the way we work with you, treat our staff, and run our business. And in every area, technologies drive our business, inspire us to innovate, and remind us that new approaches are always possible.
