Qualcomm CEO: LLMs Coming to Personal Devices, CES 2024

Language models running at the edge in consumer devices will learn from your data continuously to serve as a very personal AI assistant

Deborah Yao, Editor

January 12, 2024

2 Min Read
Qualcomm CEO Cristiano AmonCES

At a Glance

  • Qualcomm CEO Cristiano Amon said language models running on personal devices will become your very personal AI assistant.
  • These models will continuously learn from your data on your device to anticipate your needs.
  • Responses such as text and image generations will be faster since models do not have to go to the cloud.

Qualcomm CEO Cristiano Amon said the next step for generative AI is at the edge – on consumer electronics devices.

During a keynote speech at CES 2024, Amon said that generative AI is entering only its second inning (out of nine in a baseball analogy). This phase will be characterized by large language models running on devices like smartphones.

“The AI is going to develop differently from the cloud and the devices,” said the chipmaker’s CEO. He said people currently access ChatGPT and other generative AI models in the cloud, but “on the device, the AI is running pervasively.”

That means an AI model running on a smartphone would take all your data from the device to continuously learn from it and predict what you will do next – essentially becoming your own personal AI assistant specializing in your life.

In the cloud, generative AI does not know things like your location, your behaviors and other personal information.

“Everything that you type (on your phone) could be a query for the AI,” Amon said.

For example, if you text a friend asking to get together, the AI could check your availability and even suggest places to go based on places you have visited in the past. Or if you tell a friend about a place you visited, the AI could bring up the photos and ask if you want to share them.

Related:Stanford’s Renowned AI Experts Agree, Clash on State of AI at CES 2024

“That is very exciting and transformative,” Amon said.

“It is going to be this assistant with you that is running pervasively,” he said. That means the response will be instant, and since the data will stay on your device, it will remain private, Amon added.

He said Qualcomm’s X Elite PC platform that features its Oryon CPU can run generative AI models with up to 13 billion parameters on the device. PCs with this chip should start shipping from manufacturers in mid-2024.

Here, “generative AI is actually a tailwind,” Amon said. “We put ourselves on a mission, in a partnership with Microsoft to build next-generation PCs.”

X Elite PCs can run Microsoft’s generative AI assistant, Copilot.

“As Windows changes to an AI and a Copilot experience, X Elite is the platform that is going to take that next-generation Windows experience to consumers,” said Amon.

Read more about:

ChatGPT / Generative AI

About the Author(s)

Deborah Yao


Deborah Yao runs the day-to-day operations of AI Business. She is a Stanford grad who has worked at Amazon, Wharton School and Associated Press.

Keep up with the ever-evolving AI landscape
Unlock exclusive AI content by subscribing to our newsletter!!

You May Also Like