Can't find files or other content and information on your PC? Ask Nvidia's Chat with RTX chatbot

Ben Wodecki, Jr. Editor

February 14, 2024

2 Min Read
Nvidia logo

At a Glance

  • Nvidia’s new Chat with RTX demo runs on your PC with users able to connect a model to their own files.

Nvidia is throwing its hat into the chatbot ring with Chat with RTX, a new chatbot that runs on your PC.

Chat with RTX is just a demo app for now, but it lets users connect a large language model to their own content and files to personalize their experience. That means no more digging around for ages trying to find a specific document, file or information. Just ask Chat with RTX.

Users can ask the chatbot questions or even select YouTube videos. And because it runs locally on your device, user data and files are more secure.

The chatbot supports a variety of file formats, including text, pdf, doc/docx, and xml. Users simply point the app at the folder containing your files and it loads them into the library in a matter of seconds. Users can also provide the URL of YouTube videos they want the chatbot to cover.

You can choose which language model you want to the chatbot to use. Nvidia’s demo showcases the app using both Llama 2 and Mistral.

Access Nvidia Chat with RTX

You can download Chat with RTX here. It is a sizable file and requires at least 16GB of RAM and a GPU equivalent to Nvidia’s GeForce RTX 30 or 40 Series.

To use Chat with RTX, you will need a Windows PC with Windows 11.

The Chat with RTX demo is built off of the TensorRT-LLM RAG reference project. Developers can use that reference on GitHub to then develop and deploy their own RAG-based applications for RTX.

Related:Nvidia Upgrades AI Chip, Says Inference Costs Will Drop 'Significantly'

Nvidia’s meteoric rise continues

Nvidia’s chatbot demo comes as its market value closed above Amazon's yesterday to $1.8 trillion - and it is nearly on par with another AI leader, Google parent Alphabet. The chipmaker is the now fourth most valuable company in the U.S., after Microsoft ($3 trillion), Apple ($2.88 trillion) and Alphabet ($1.81 trillion). Nvidia's stock has risen five-fold since January 2023.

Nvidia reportedly has a roughly 80% to 85% market share in advanced AI chips, which has been driving its stock price since AI demand has been on the rise. Microsoft's tie-up with another AI leader, OpenAI, has let it leap past Apple as the most valuable company in the U.S.

Read more about:

ChatGPT / Generative AI

About the Author(s)

Ben Wodecki

Jr. Editor

Ben Wodecki is the Jr. Editor of AI Business, covering a wide range of AI content. Ben joined the team in March 2021 as assistant editor and was promoted to Jr. Editor. He has written for The New Statesman, Intellectual Property Magazine, and The Telegraph India, among others. He holds an MSc in Digital Journalism from Middlesex University.

Keep up with the ever-evolving AI landscape
Unlock exclusive AI content by subscribing to our newsletter!!

You May Also Like