- Joined
- Jan 14, 2023
- Messages
- 684 (1.34/day)
| System Name | Asus G16 |
|---|---|
| Processor | i9 13980HX |
| Motherboard | Asus motherboard |
| Cooling | 2 fans |
| Memory | 32gb 4800mhz cl40 |
| Video Card(s) | 4080 laptop |
| Storage | 16tb, x2 8tb SSD |
| Display(s) | QHD+ 16:10 (2560x1600, WQXGA) 240hz |
| Power Supply | 330w psu |
I guess more AI hype is rolling out, today Nvdia released "NVIDIA Chat with RTX". Its only a demo atm. Its 35gb in size.
I'm gonna try it out.
Chat With RTX is a demo app that lets you personalize a GPT large language model (LLM) connected to your own content—docs, notes, videos, or other data. Leveraging retrieval-augmented generation (RAG), TensorRT-LLM, and RTX acceleration, you can query a custom chatbot to quickly get contextually relevant answers. And because it all runs locally on your Windows RTX PC or workstation, you’ll get fast and secure results.
System Requirements
I'm gonna try it out.
Chat With RTX is a demo app that lets you personalize a GPT large language model (LLM) connected to your own content—docs, notes, videos, or other data. Leveraging retrieval-augmented generation (RAG), TensorRT-LLM, and RTX acceleration, you can query a custom chatbot to quickly get contextually relevant answers. And because it all runs locally on your Windows RTX PC or workstation, you’ll get fast and secure results.
System Requirements
| Platform | Windows |
| GPU | NVIDIA GeForce™ RTX 30 or 40 Series GPU or NVIDIA RTX™ Ampere or Ada Generation GPU with at least 8GB of VRAM |
| RAM | 16GB or greater |
| OS | Windows 11 |
| Driver | 535.11 or later |