Build a Custom LLM with ChatRTX | NVIDIA - 0 views
-
Janos Haits on 06 Apr 24"ChatRTX is a demo app that lets you personalize a GPT large language model (LLM) connected to your own content-docs, notes, or other data. Leveraging retrieval-augmented generation (RAG), TensorRT-LLM, and RTX acceleration, you can query a custom chatbot to quickly get contextually relevant answers. And because it all runs locally on your Windows RTX PC or workstation, you'll get fast and secure results."