Hewlett Packard, Nvidia Offer Private Cloud for Secure Generative AI Models

New tool enables enterprises to run generative AI workloads securely on private clouds

Ben Wodecki, Jr. Editor

June 19, 2024

2 Min Read
Digital representation of secure cloud computing
Getty Images

Hewlett Packard Enterprise (HPE) is teaming with Nvidia to offer a jointly developed tool for privately running generative AI models and workloads in the cloud.

Announced during HPE’s Discover event, HPE Private Cloud AI integrates Nvidia’s computing and software technologies with HPE’s storage solutions, allowing users to run generative AI workloads efficiently and securely.

The platform enables enterprises to conduct inference and fine-tuning tasks using proprietary data, enabling the development and deployment of flexible and secure generative AI solutions.

“Generative AI and accelerated computing are fueling a fundamental transformation as every industry races to join the industrial revolution,” said Jensen Huang, Nvidia founder and CEO. “Never before have Nvidia and HPE integrated our technologies so deeply, combining the entire Nvidia AI computing stack along with HPE’s private cloud technology, to equip enterprise clients and AI professionals with the most advanced computing infrastructure and services to expand the frontier of AI.”

HPE Private Cloud AI includes Nvidia AI Enterprise software, tools designed to streamline generative AI application development, such as the new NIM microservice, which helps users optimize AI model inference.

Related:Nvidia CEO: Generative AI, Accelerated Computing to Redefine the Future

HPE software also comes with tools to help monitor the AI model and data compliance. HPE’s GreenLake cloud service lets users automate and manage endpoints and data across hybrid environments.

The new solution also comes with an integrated AI infrastructure stack that allows enterprise users to manage and deploy AI workloads across various platforms, including HPE GreenLake for File Storage, Nvidia Spectrum-X Ethernet networking and powerful GPUs such as Nvidia’s H100 Tensor Cores.

HPE Private Cloud AI will be made generally available in fall 2024.

Other announcements from Discover 2024 include Nvidia extending support to several HPE supercomputing and server solutions, including that Cray XD670 now supports eight Nvidia H200 Tensor Core GPUs, making it an ideal computing solution for companies looking to power large language models.

“Generative AI holds immense potential for enterprise transformation, but the complexities of fragmented AI technology contain too many risks and barriers that hamper large-scale enterprise adoption and can jeopardize a company’s most valuable asset: its proprietary data,” said Antonio Neri, HPE’s president and CEO. “To unleash the immense potential of generative AI in the enterprise, HPE and Nvidia co-developed a turnkey private cloud for AI that will enable enterprises to focus their resources on developing new AI use cases that can boost productivity and unlock new revenue streams.”

Related:Microsoft, Meta, Google Launch New AI Connectivity Standard for Data Centers

Read more about:

ChatGPT / Generative AI

About the Author(s)

Ben Wodecki

Jr. Editor

Ben Wodecki is the Jr. Editor of AI Business, covering a wide range of AI content. Ben joined the team in March 2021 as assistant editor and was promoted to Jr. Editor. He has written for The New Statesman, Intellectual Property Magazine, and The Telegraph India, among others. He holds an MSc in Digital Journalism from Middlesex University.

Keep up with the ever-evolving AI landscape
Unlock exclusive AI content by subscribing to our newsletter!!

You May Also Like