This Day in AI Brand
blogs.nvidia.com
- NVIDIA has released Chat with RTX, a free tech demo that allows users with NVIDIA RTX GPUs to create a personalized GPT chatbot on Windows PCs, utilizing local files for quick, contextually relevant answers without needing an internet connection.
- The chatbot leverages retrieval-augmented generation (RAG), NVIDIA TensorRT-LLM software, and RTX acceleration, supporting various file formats and the ability to integrate knowledge from YouTube videos for enhanced query responses.
- Chat with RTX runs locally on Windows RTX PCs, ensuring fast response times and data privacy, with future development opportunities for LLM-based applications using the TensorRT-LLM RAG developer reference project available on GitHub.
Comment
11 points