• Welcome to TechPowerUp Forums, Guest! Please check out our forum guidelines for info related to our community.

Chat with NVIDIA RTX Tech Demo

Joined
Feb 11, 2009
Messages
5,536 (0.96/day)
System Name Cyberline
Processor Intel Core i7 2600k -> 12600k
Motherboard Asus P8P67 LE Rev 3.0 -> Gigabyte Z690 Auros Elite DDR4
Cooling Tuniq Tower 120 -> Custom Watercoolingloop
Memory Corsair (4x2) 8gb 1600mhz -> Crucial (8x2) 16gb 3600mhz
Video Card(s) AMD RX480 -> RX7800XT
Storage Samsung 750 Evo 250gb SSD + WD 1tb x 2 + WD 2tb -> 2tb MVMe SSD
Display(s) Philips 32inch LPF5605H (television) -> Dell S3220DGF
Case antec 600 -> Thermaltake Tenor HTCP case
Audio Device(s) Focusrite 2i4 (USB)
Power Supply Seasonic 620watt 80+ Platinum
Mouse Elecom EX-G
Keyboard Rapoo V700
Software Windows 10 Pro 64bit
"Some of the answers are plainly wrong. But here, too, they do look very credible at first look."

the problem with all AI chats, Chat GPT/Co-Pilot has already burned me, ask them about stuff you know about and see how much bs it spouts.
 
Joined
Feb 16, 2005
Messages
599 (0.08/day)
Location
Germany,Hannover
System Name ChaosMoes
Processor Intel® Core™ i5-3570K no OC yet
Motherboard Asrock Z77 Extreme4
Cooling Scythe Ninja 3 Rev. B
Memory 16GB 2xPatriot DIMM 8 GB DDR3-1866 Kit (PV38G186C9KRD, Viper 3 Venom Red)
Video Card(s) ASRock Radeon RX 590 Phantom Gaming X 8GB GDDR5 188€@13.07.19 Amazon Sale
Storage Samsung 840 Pro SSD 256GB, + ST32000645NS Seagate Constellation 109€ reichelt.de 2012
Display(s) 27" Phillips PHL 276E9Q 189€ @ Saturn(Germany) 1.09.2018
Case Zaria A20 !!!THANK YOU TECHPOWERUP.COM!!!
Audio Device(s) onboard Sound
Power Supply SeaSonic Prime Ultra Titanium 750W
Mouse Logitech M705
Keyboard Microsoft SideWinder X4 Keyboard
Software Windows 10 Pro x64
no 20xx Series support :-( so no test for me...

Can i use the AI and run it for hours and create a better Ai than itself :)

How does it answer to thing it does not have in its language models can it lear by itself?

Ask indecrectly maybe?
 
Joined
Dec 25, 2020
Messages
6,509 (4.63/day)
Location
São Paulo, Brazil
System Name "Icy Resurrection"
Processor 13th Gen Intel Core i9-13900KS Special Edition
Motherboard ASUS ROG MAXIMUS Z790 APEX ENCORE
Cooling Noctua NH-D15S upgraded with 2x NF-F12 iPPC-3000 fans and Honeywell PTM7950 TIM
Memory 32 GB G.SKILL Trident Z5 RGB F5-6800J3445G16GX2-TZ5RK @ 7600 MT/s 36-44-44-52-96 1.4V
Video Card(s) ASUS ROG Strix GeForce RTX™ 4080 16GB GDDR6X White OC Edition
Storage 500 GB WD Black SN750 SE NVMe SSD + 4 TB WD Red Plus WD40EFPX HDD
Display(s) 55-inch LG G3 OLED
Case Pichau Mancer CV500 White Edition
Power Supply EVGA 1300 G2 1.3kW 80+ Gold
Mouse Microsoft Classic Intellimouse
Keyboard Generic PS/2
Software Windows 11 IoT Enterprise LTSC 24H2
Benchmark Scores I pulled a Qiqi~
"2017's GeForce RTX" Really weird to read that about Titan V. That was a $3000 hyper-premium GPU that was essentially carved out of the most advanced datacenter part that existed at the time. I know this is typical PR embellishment, but why insist on deceptive marketing while you're ahead? This is just as bad as the comparisons between 3090 and 4070 Super with FG and RR on.
 
Joined
Jan 14, 2019
Messages
12,167 (5.74/day)
Location
Midlands, UK
System Name Nebulon B
Processor AMD Ryzen 7 7800X3D
Motherboard MSi PRO B650M-A WiFi
Cooling be quiet! Dark Rock 4
Memory 2x 24 GB Corsair Vengeance DDR5-4800
Video Card(s) AMD Radeon RX 6750 XT 12 GB
Storage 2 TB Corsair MP600 GS, 2 TB Corsair MP600 R2
Display(s) Dell S3422DWG, 7" Waveshare touchscreen
Case Kolink Citadel Mesh black
Audio Device(s) Logitech Z333 2.1 speakers, AKG Y50 headphones
Power Supply Seasonic Prime GX-750
Mouse Logitech MX Master 2S
Keyboard Logitech G413 SE
Software Windows 10 Pro
Joined
Feb 14, 2012
Messages
2,352 (0.51/day)
System Name msdos
Processor 8086
Motherboard mainboard
Cooling passive
Memory 640KB + 384KB extended
Video Card(s) EGA
Storage 5.25"
Display(s) 80x25
Case plastic
Audio Device(s) modchip
Power Supply 45 watts
Mouse serial
Keyboard yes
Software disk commander
Benchmark Scores still running
There are guides on YT for installing "unrestricted" local AI chat bots.
 
Joined
Jan 20, 2019
Messages
1,514 (0.72/day)
Location
London, UK
System Name ❶ Oooh (2024) ❷ Aaaah (2021) ❸ Ahemm (2017)
Processor ❶ 5800X3D ❷ i7-9700K ❸ i7-7700K
Motherboard ❶ X570-F ❷ Z390-E ❸ Z270-E
Cooling ❶ ALFIII 360 ❷ X62 + X72 (GPU mod) ❸ X62
Memory ❶ 32-3600/16 ❷ 32-3200/16 ❸ 16-3200/16
Video Card(s) ❶ 3080 X Trio ❷ 2080TI (AIOmod) ❸ 1080TI
Storage ❶ NVME/SSD/HDD ❷ <SAME ❸ SSD/HDD
Display(s) ❶ 1440/165/IPS ❷ 1440/144/IPS ❸ 1080/144/IPS
Case ❶ BQ Silent 601 ❷ Cors 465X ❸ Frac Mesh C
Audio Device(s) ❶ HyperX C2 ❷ HyperX C2 ❸ Logi G432
Power Supply ❶ HX1200 Plat ❷ RM750X ❸ EVGA 650W G2
Mouse ❶ Logi G Pro ❷ Razer Bas V3 ❸ Logi G502
Keyboard ❶ Logi G915 TKL ❷ Anne P2 ❸ Logi G610
Software ❶ Win 11 ❷ 10 ❸ 10
Benchmark Scores I have wrestled bandwidths, Tussled with voltages, Handcuffed Overclocks, Thrown Gigahertz in Jail
Are we gonna be taxed with yet another feature most of us gamers dont care about? I don't believe in green freebies.
 

bug

Joined
May 22, 2015
Messages
13,712 (3.97/day)
Processor Intel i5-12600k
Motherboard Asus H670 TUF
Cooling Arctic Freezer 34
Memory 2x16GB DDR4 3600 G.Skill Ripjaws V
Video Card(s) EVGA GTX 1060 SC
Storage 500GB Samsung 970 EVO, 500GB Samsung 850 EVO, 1TB Crucial MX300 and 2TB Crucial MX500
Display(s) Dell U3219Q + HP ZR24w
Case Raijintek Thetis
Audio Device(s) Audioquest Dragonfly Red :D
Power Supply Seasonic 620W M12
Mouse Logitech G502 Proteus Core
Keyboard G.Skill KM780R
Software Arch Linux + Win10
it definitely is not an advert. nvidia sent the link, the reviewer's guide, which is pretty basic and that's it

also consider that we're listing several failures and criticism .. assuming you read the review
I wanted to, but I stopped at Windows-only.
 

AFroN

New Member
Joined
Feb 6, 2024
Messages
1 (0.00/day)
Anybody installed this? The first time I installed it, it was just fully broken and then after reinstalling I get "Environment with 'env_nvd_rag' not found."
I know where that directory is but I'm not exactly sure what do add and where in the environment variables. Anybody knows?
 
Last edited:
Joined
May 7, 2020
Messages
261 (0.16/day)
Truthfulness of these relatively small model that can run natively on your PC have always been problematic, however, I think the most exciting aspect is how much easier to set it up to churn through new data, you found some random piece of data, could be youtube video, some document, you feed the your pet AI, and it churns out some seemingly convincing enough response.

Currently, it is definitely not reliable enough, but hey this is a tech demo, and it is doing tech demo thing.
 
Low quality post by umeng2002
Low quality post by Fluffmeister
Joined
Dec 22, 2011
Messages
3,890 (0.83/day)
Processor AMD Ryzen 7 3700X
Motherboard MSI MAG B550 TOMAHAWK
Cooling AMD Wraith Prism
Memory Team Group Dark Pro 8Pack Edition 3600Mhz CL16
Video Card(s) NVIDIA GeForce RTX 3080 FE
Storage Kingston A2000 1TB + Seagate HDD workhorse
Display(s) Samsung 50" QN94A Neo QLED
Case Antec 1200
Power Supply Seasonic Focus GX-850
Mouse Razer Deathadder Chroma
Keyboard Logitech UltraX
Software Windows 11
RTX, what color panties are you wearing, and are they ray-traced?

That's not bad, I'd also try.. If AMD fans only care about native res and loads of VRAM, why are they such a bunch of whiny bitches?

I might download this just to ask.
 
Joined
Nov 4, 2005
Messages
11,960 (1.72/day)
System Name Compy 386
Processor 7800X3D
Motherboard Asus
Cooling Air for now.....
Memory 64 GB DDR5 6400Mhz
Video Card(s) 7900XTX 310 Merc
Storage Samsung 990 2TB, 2 SP 2TB SSDs, 24TB Enterprise drives
Display(s) 55" Samsung 4K HDR
Audio Device(s) ATI HDMI
Mouse Logitech MX518
Keyboard Razer
Software A lot.
Benchmark Scores Its fast. Enough.
"Some of the answers are plainly wrong. But here, too, they do look very credible at first look."

the problem with all AI chats, Chat GPT/Co-Pilot has already burned me, ask them about stuff you know about and see how much bs it spouts.
CoPilot AKA.........Here let me google that for you.....on Edge....


This is merely a compressed text file pivot tables on a GPU, Rainbow tables in reverse for common questions and WOW you are able to hold them in VMEM and since you have enough that it seems its fast using matrix and radix FFT sorting to spit out an answer. Its interpretive google.

I'm not trying to piss on it, its just a garden variety dataset with a decent UI on top, its the windows 3.1 of "AI".
 

jashworth

New Member
Joined
Feb 14, 2024
Messages
1 (0.00/day)
Love that you did a review - but please AI will not allow us to get stupider - think of things logically - were all your articles dated - Then ask it to compare the last year of GPU's.

It getting the TDP wrong is interesting - it can't be classified as a hallucination because hallucinations happen because of inner workings of the model and are not caused by the articles themselves - meaning the RAG failed in this case.

Ask it to write a review of the 3060 and 3060 ti graphics cards by comparing them - that would be an intelligent question. AI is not for chatBotting or replacing Google - it is about productive work - it is garbage in and garbage out - if your prompts suck - or if your text database isn't good then it will suck too. It might be you had too many articles - i doubt nvidia's indexing in the RAG database is capable of handling that large a dataset at this time.
 
Joined
Nov 1, 2020
Messages
5 (0.00/day)
>You can, however, override this limitation by editing the installer's config file that's found in a sub-folder of the installer executable (ask us in the comments, if you need more guidance).

Can someone guide me which command to change?
 

W1zzard

Administrator
Staff member
Joined
May 14, 2004
Messages
27,693 (3.70/day)
Processor Ryzen 7 5700X
Memory 48 GB
Video Card(s) RTX 4080
Storage 2x HDD RAID 1, 3x M.2 NVMe
Display(s) 30" 2560x1600 + 19" 1280x1024
Software Windows 10 64-bit
>You can, however, override this limitation by editing the installer's config file that's found in a sub-folder of the installer executable (ask us in the comments, if you need more guidance).

Can someone guide me which command to change?

open llama13b.nvi in the installer's RAG subfolder with notepad and edit the "15" GB value to "1" GB

1707890760829.png


were all your articles dated
of course

Ask it to write a review of the 3060
The NVIDIA GeForce RTX 3060 is a powerful graphics card that brings the strengths of the RTX 30 Series to a wider audience. With its efficient, high-performance architecture and the second generation of NVIDIA RTX, the RTX 3060 delivers amazing hardware raytracing capabilities and support for NVIDIA DLSS and other technologies.
One of the key features of the RTX 3060 is its raytracing capabilities. The card has 25 RT-TFLOPs for raytracing, which is 10x more than the GTX 1060. This allows the RTX 3060 to handle cutting-edge titles such as Cyberpunk 2077 and Fortnite with RTX On at 60 frames per second.
The RTX 3060 also has 13 shader-TFLOPs and 101 tensor-TFLOPs, which power NVIDIA DLSS and other technologies. This allows the card to boost frame rates while generating beautiful, crisp game images and gives gamers the performance headroom to maximize raytracing settings and increase output resolutions.
In terms of performance, the RTX 3060 is a formidable upgrade opportunity and the foundation of a gaming PC platform powerful enough to handle cutting-edge titles. It supports the trifecta of GeForce gaming innovations: NVIDIA DLSS, NVIDIA Reflex and NVIDIA Broadcast, which accelerate performance and enhance image quality.
The RTX 3060 also has a compact two-fan design and utilizes only 2 slots, making it suitable for builds of all sizes. Despite its smaller footprint, the RTX 3060 does not shy away from offering all the bells and whistles of the RTX 30 series, making it perfect for gaming and content creation at all levels.
Overall, the NVIDIA GeForce RTX 3060 is a powerful and versatile graphics card that delivers unparalleled performance and features to gamers and creators everywhere. Its efficient, high-performance architecture and the second generation of NVIDIA RTX make it a top choice for anyone looking to upgrade their gaming or content creation setup.

it is garbage in and garbage out - if your prompts suck - or if your text database isn't good then it will suck too
No doubt, there is always room for fine-tuning, but where does it end?

If I give it my own review's conclusion and ask it to summarize, I get:

The GeForce RTX 3060 is a graphics card from NVIDIA that uses the Ampere architecture. It has 12 GB of GDDR6 memory and is designed for mid-range gaming. The card is based on the GA106 GPU and has a 192-bit memory bus. It is available in a near-reference implementation from Palit and has a factory overclock to 1875 MHz. The card is faster than the NVIDIA baseline and is also faster than the RTX 2070, RTX 2060 Super, and original RTX 2060. The card has a 70°C temperature and is powered by 190 W. The card is designed for gaming and has a focus on low temperatures. The card is also designed to be energy efficient and has a lower power consumption than the bigger Ampere chips. The card has a hash-rate limiter that is tied to the driver, system firmware, and silicon to prevent tampering. The card is also designed to be overclocked and has a 5% difference between the best and worst overclocker. The card is available for $329 and is expected to sell out quickly.


1707891266503.png

Looks like this won't be replacing my writing any time soon :D
 
Last edited:

dgianstefani

TPU Proofreader
Staff member
Joined
Dec 29, 2017
Messages
4,989 (2.00/day)
Location
Swansea, Wales
System Name Silent
Processor Ryzen 7800X3D @ 5.15ghz BCLK OC, TG AM5 High Performance Heatspreader
Motherboard ASUS ROG Strix X670E-I, chipset fans replaced with Noctua A14x25 G2
Cooling Optimus Block, HWLabs Copper 240/40 + 240/30, D5/Res, 4x Noctua A12x25, 1x A14G2, Mayhems Ultra Pure
Memory 32 GB Dominator Platinum 6150 MT 26-36-36-48, 56.6ns AIDA, 2050 FCLK, 160 ns tRFC, active cooled
Video Card(s) RTX 3080 Ti Founders Edition, Conductonaut Extreme, 18 W/mK MinusPad Extreme, Corsair XG7 Waterblock
Storage Intel Optane DC P1600X 118 GB, Samsung 990 Pro 2 TB
Display(s) 32" 240 Hz 1440p Samsung G7, 31.5" 165 Hz 1440p LG NanoIPS Ultragear, MX900 dual gas VESA mount
Case Sliger SM570 CNC Aluminium 13-Litre, 3D printed feet, custom front, LINKUP Ultra PCIe 4.0 x16 white
Audio Device(s) Audeze Maxwell Ultraviolet w/upgrade pads & LCD headband, Galaxy Buds 3 Pro, Razer Nommo Pro
Power Supply SF750 Plat, full transparent custom cables, Sentinel Pro 1500 Online Double Conversion UPS w/Noctua
Mouse Razer Viper Pro V2 8 KHz Mercury White w/Tiger Ice Skates & Pulsar Supergrip tape
Keyboard Wooting 60HE+ module, TOFU-R CNC Alu/Brass, SS Prismcaps W+Jellykey, LekkerV2 mod, TLabs Leath/Suede
Software Windows 11 IoT Enterprise LTSC 24H2
Benchmark Scores Legendary
Joined
Sep 17, 2014
Messages
22,278 (6.02/day)
Location
The Washing Machine
Processor 7800X3D
Motherboard MSI MAG Mortar b650m wifi
Cooling Thermalright Peerless Assassin
Memory 32GB Corsair Vengeance 30CL6000
Video Card(s) ASRock RX7900XT Phantom Gaming
Storage Lexar NM790 4TB + Samsung 850 EVO 1TB + Samsung 980 1TB + Crucial BX100 250GB
Display(s) Gigabyte G34QWC (3440x1440)
Case Lian Li A3 mATX White
Audio Device(s) Harman Kardon AVR137 + 2.1
Power Supply EVGA Supernova G2 750W
Mouse Steelseries Aerox 5
Keyboard Lenovo Thinkpad Trackpoint II
Software W11 IoT Enterprise LTSC
Benchmark Scores Over 9000
AI...

All I see here is a glorified search machine, still, I'm sorry. So now you can burn several hundred watts locally to search within a limited dataset and wonder if the answer is actually correct. Yay!

I'm not seeing the magic, honestly.
 
Joined
Jul 10, 2015
Messages
754 (0.22/day)
Location
Sokovia
System Name Alienation from family
Processor i7 7700k
Motherboard Hero VIII
Cooling Macho revB
Memory 16gb Hyperx
Video Card(s) Asus 1080ti Strix OC
Storage 960evo 500gb
Display(s) AOC 4k
Case Define R2 XL
Power Supply Be f*ing Quiet 600W M Gold
Mouse NoName
Keyboard NoNameless HP
Software You have nothing on me
Benchmark Scores Personal record 100m sprint: 60m
it definitely is not an advert. nvidia sent the link, the reviewer's guide, which is pretty basic and that's it

also consider that we're listing several failures and criticism .. assuming you read the review
Maybe it trained on comments text too and you just make it dumb by mistake.
 
Joined
Apr 19, 2018
Messages
1,227 (0.51/day)
Processor AMD Ryzen 9 5950X
Motherboard Asus ROG Crosshair VIII Hero WiFi
Cooling Arctic Liquid Freezer II 420
Memory 32Gb G-Skill Trident Z Neo @3806MHz C14
Video Card(s) MSI GeForce RTX2070
Storage Seagate FireCuda 530 1TB
Display(s) Samsung G9 49" Curved Ultrawide
Case Cooler Master Cosmos
Audio Device(s) O2 USB Headphone AMP
Power Supply Corsair HX850i
Mouse Logitech G502
Keyboard Cherry MX
Software Windows 11
AI...

All I see here is a glorified search machine, still, I'm sorry. So now you can burn several hundred watts locally to search within a limited dataset and wonder if the answer is actually correct. Yay!

I'm not seeing the magic, honestly.
A.I. is just the latest tech PR buzzword to sell more product. It offers little value, and it certainly offers very little in the way of intelligence, as you simply can't trust the output at all.

And love the block on the RTX20x0 series. Bloody nGreedia. :banghead:
 
Joined
Aug 24, 2014
Messages
10 (0.00/day)
Processor i7 4790K
Motherboard AsRock z97 Extreme 9
Cooling Lepa Aquacharger 120
Memory TridentX 2400 cr1
Video Card(s) r9 390x + liquid
...no one is commenting about the GTX 275 AMP!
 
Joined
Feb 3, 2012
Messages
132 (0.03/day)
Location
Medina, Ohio
System Name Daily driver
Processor i9 13900k
Motherboard Z690 Aorus Master
Cooling Custom loop
Memory 2x16 GB GSkill DDR5 @ 6000
Video Card(s) RTX4090 FE
Storage 2x 2TB 990 Pro SSD 1x 2TB 970 evo SSD, 1x 4TB HDD
Display(s) LG 32" 2560x1440
Case Fractal Design Meshify 2 XL
Audio Device(s) onboard
Power Supply beQuiet Dark Power 12 1000W
Mouse Razer Death adder
Keyboard Razer blackwidow v3
VR HMD n/a
Software Windows 11 pro
Benchmark Scores Heaven 4.0 @ 2560x1440 270.5 FPS
...no one is commenting about the GTX 275 AMP!
did someone say gtx200 series? you got my attention.
where was this mentioned?
 
Joined
Mar 29, 2014
Messages
448 (0.12/day)
It's mostly different components in the GPU. RTX is dedicated ray tracing hardware, AI (and DLSS) uses tensor cores (matrix math hardware).
Nvidia has been at this for a long time. I saw them at a supercomputing trade show in 2009 and wondered why a video card company was there. A couple years later, I was told we needed to build some supercomputing software that worked with their hardware and I didn't understand why. I left the company, came back a couple years later and got dragged into a project where I found out why.

Nvidia has the software that provides the base for the AI software, and other things. AMD, and Intel aren't even close at this point in time. AMD is working on this, but their software just is not there. They just abandoned a CUDA compatability library that they were working on, so maybe they are working on something else. At the moment, Nvidia owns this market.


Yeah it's interesting software and does some useful things. But it's still not solid. It gets lots of simple things right, and lots of complicated detailed things wrong. Definitely not trustworthy for important stuff, as at least one lawyer found out when he submitted some documents written by AI to the courts.
Correct. The problem lies in the fact Nvidia lied to it's gaming customers by claiming all this new hardware was for better gaming, but in truth it was always targeted for AI.
 

bug

Joined
May 22, 2015
Messages
13,712 (3.97/day)
Processor Intel i5-12600k
Motherboard Asus H670 TUF
Cooling Arctic Freezer 34
Memory 2x16GB DDR4 3600 G.Skill Ripjaws V
Video Card(s) EVGA GTX 1060 SC
Storage 500GB Samsung 970 EVO, 500GB Samsung 850 EVO, 1TB Crucial MX300 and 2TB Crucial MX500
Display(s) Dell U3219Q + HP ZR24w
Case Raijintek Thetis
Audio Device(s) Audioquest Dragonfly Red :D
Power Supply Seasonic 620W M12
Mouse Logitech G502 Proteus Core
Keyboard G.Skill KM780R
Software Arch Linux + Win10
Correct. The problem lies in the fact Nvidia lied to it's gaming customers by claiming all this new hardware was for better gaming, but in truth it was always targeted for AI.
Spot on! Because hardware cannot serve more than one purpose, right? :wtf:
 
Top