Nvidia's Customizable Chatbot You Can Run on Your PC

Nvidia is throwing its hat into the chatbot ring with Chat with RTX, a new chatbot that runs on your PC.

Chat with RTX is just a demo app for now, but it lets users connect a large language model to their own content and files to personalize their experience. That means no more digging around for ages trying to find a specific document, file or information. Just ask Chat with RTX.

Users can ask the chatbot questions or even select YouTube videos. And because it runs locally on your device, user data and files are more secure.

The chatbot supports a variety of file formats, including text, pdf, doc/docx, and xml. Users simply point the app at the folder containing your files and it loads them into the library in a matter of seconds. Users can also provide the URL of YouTube videos they want the chatbot to cover.

You can choose which language model you want to the chatbot to use. Nvidia’s demo showcases the app using both Llama 2 and Mistral.

Access Nvidia Chat with RTX

You can download Chat with RTX here. It is a sizable file and requires at least 16GB of RAM and a GPU equivalent to Nvidia’s GeForce RTX 30 or 40 Series.

To use Chat with RTX, you will need a Windows PC with Windows 11.

The Chat with RTX demo is built off of the TensorRT-LLM RAG reference project. Developers can use that reference on GitHub to then develop and deploy their own RAG-based applications for RTX.

Related:Nvidia Upgrades AI Chip, Says Inference Costs Will Drop 'Significantly'

Nvidia’s meteoric rise continues

Nvidia’s chatbot demo comes as its market value closed above Amazon's yesterday to $1.8 trillion - and it is nearly on par with another AI leader, Google parent Alphabet. The chipmaker is the now fourth most valuable company in the U.S., after Microsoft ($3 trillion), Apple ($2.88 trillion) and Alphabet ($1.81 trillion). Nvidia's stock has risen five-fold since January 2023.

Nvidia reportedly has a roughly 80% to 85% market share in advanced AI chips, which has been driving its stock price since AI demand has been on the rise. Microsoft's tie-up with another AI leader, OpenAI, has let it leap past Apple as the most valuable company in the U.S.