Chat with NVIDIA RTX Tech Demo

[ZoneDymo]

"Some of the answers are plainly wrong. But here, too, they do look very credible at first look."

the problem with all AI chats, Chat GPT/Co-Pilot has already burned me, ask them about stuff you know about and see how much bs it spouts.

 

[Baum]

no 20xx Series support :-( so no test for me...

Can i use the AI and run it for hours and create a better Ai than itself

How does it answer to thing it does not have in its language models can it lear by itself?

Ask indecrectly maybe?

 

[Dr. Dro]

"2017's GeForce RTX" Really weird to read that about Titan V. That was a $3000 hyper-premium GPU that was essentially carved out of the most advanced datacenter part that existed at the time. I know this is typical PR embellishment, but why insist on deceptive marketing while you're ahead? This is just as bad as the comparisons between 3090 and 4070 Super with FG and RR on.

 

[AusWolf]

Something no one asked for yet we get it anyway

Exactly my thoughts. Canvas is awesome, but I don't see why I would ever need this thing.

 

[xorbe]

There are guides on YT for installing "unrestricted" local AI chat bots.

 

[wheresmycar]

Are we gonna be taxed with yet another feature most of us gamers dont care about? I don't believe in green freebies.

 

[bug]

it definitely is not an advert. nvidia sent the link, the reviewer's guide, which is pretty basic and that's it

also consider that we're listing several failures and criticism .. assuming you read the review

I wanted to, but I stopped at Windows-only.

 

[AFroN]

Anybody installed this? The first time I installed it, it was just fully broken and then after reinstalling I get "Environment with 'env_nvd_rag' not found."
I know where that directory is but I'm not exactly sure what do add and where in the environment variables. Anybody knows?

 

[Verpal]

Truthfulness of these relatively small model that can run natively on your PC have always been problematic, however, I think the most exciting aspect is how much easier to set it up to churn through new data, you found some random piece of data, could be youtube video, some document, you feed the your pet AI, and it churns out some seemingly convincing enough response.

Currently, it is definitely not reliable enough, but hey this is a tech demo, and it is doing tech demo thing.

 

[umeng2002]

RTX, what color panties are you wearing, and are they ray-traced?

 

[Fluffmeister]

RTX, what color panties are you wearing, and are they ray-traced?

That's not bad, I'd also try.. If AMD fans only care about native res and loads of VRAM, why are they such a bunch of whiny bitches?

I might download this just to ask.

 

[Steevo]

"Some of the answers are plainly wrong. But here, too, they do look very credible at first look."

the problem with all AI chats, Chat GPT/Co-Pilot has already burned me, ask them about stuff you know about and see how much bs it spouts.

CoPilot AKA.........Here let me google that for you.....on Edge....


This is merely a compressed text file pivot tables on a GPU, Rainbow tables in reverse for common questions and WOW you are able to hold them in VMEM and since you have enough that it seems its fast using matrix and radix FFT sorting to spit out an answer. Its interpretive google.

I'm not trying to piss on it, its just a garden variety dataset with a decent UI on top, its the windows 3.1 of "AI".

 

[95Viper]

Stick to discussing the topic and keep it clean.

 

[jashworth]

Love that you did a review - but please AI will not allow us to get stupider - think of things logically - were all your articles dated - Then ask it to compare the last year of GPU's.

It getting the TDP wrong is interesting - it can't be classified as a hallucination because hallucinations happen because of inner workings of the model and are not caused by the articles themselves - meaning the RAG failed in this case.

Ask it to write a review of the 3060 and 3060 ti graphics cards by comparing them - that would be an intelligent question. AI is not for chatBotting or replacing Google - it is about productive work - it is garbage in and garbage out - if your prompts suck - or if your text database isn't good then it will suck too. It might be you had too many articles - i doubt nvidia's indexing in the RAG database is capable of handling that large a dataset at this time.

 

[TheDoomSlayer]

>You can, however, override this limitation by editing the installer's config file that's found in a sub-folder of the installer executable (ask us in the comments, if you need more guidance).

Can someone guide me which command to change?

 

[W1zzard]

>You can, however, override this limitation by editing the installer's config file that's found in a sub-folder of the installer executable (ask us in the comments, if you need more guidance).

Can someone guide me which command to change?

open llama13b.nvi in the installer's RAG subfolder with notepad and edit the "15" GB value to "1" GB

were all your articles dated

of course

Ask it to write a review of the 3060

The NVIDIA GeForce RTX 3060 is a powerful graphics card that brings the strengths of the RTX 30 Series to a wider audience. With its efficient, high-performance architecture and the second generation of NVIDIA RTX, the RTX 3060 delivers amazing hardware raytracing capabilities and support for NVIDIA DLSS and other technologies.
One of the key features of the RTX 3060 is its raytracing capabilities. The card has 25 RT-TFLOPs for raytracing, which is 10x more than the GTX 1060. This allows the RTX 3060 to handle cutting-edge titles such as Cyberpunk 2077 and Fortnite with RTX On at 60 frames per second.
The RTX 3060 also has 13 shader-TFLOPs and 101 tensor-TFLOPs, which power NVIDIA DLSS and other technologies. This allows the card to boost frame rates while generating beautiful, crisp game images and gives gamers the performance headroom to maximize raytracing settings and increase output resolutions.
In terms of performance, the RTX 3060 is a formidable upgrade opportunity and the foundation of a gaming PC platform powerful enough to handle cutting-edge titles. It supports the trifecta of GeForce gaming innovations: NVIDIA DLSS, NVIDIA Reflex and NVIDIA Broadcast, which accelerate performance and enhance image quality.
The RTX 3060 also has a compact two-fan design and utilizes only 2 slots, making it suitable for builds of all sizes. Despite its smaller footprint, the RTX 3060 does not shy away from offering all the bells and whistles of the RTX 30 series, making it perfect for gaming and content creation at all levels.
Overall, the NVIDIA GeForce RTX 3060 is a powerful and versatile graphics card that delivers unparalleled performance and features to gamers and creators everywhere. Its efficient, high-performance architecture and the second generation of NVIDIA RTX make it a top choice for anyone looking to upgrade their gaming or content creation setup.

it is garbage in and garbage out - if your prompts suck - or if your text database isn't good then it will suck too

No doubt, there is always room for fine-tuning, but where does it end?

If I give it my own review's conclusion and ask it to summarize, I get:

The GeForce RTX 3060 is a graphics card from NVIDIA that uses the Ampere architecture. It has 12 GB of GDDR6 memory and is designed for mid-range gaming. The card is based on the GA106 GPU and has a 192-bit memory bus. It is available in a near-reference implementation from Palit and has a factory overclock to 1875 MHz. The card is faster than the NVIDIA baseline and is also faster than the RTX 2070, RTX 2060 Super, and original RTX 2060. The card has a 70°C temperature and is powered by 190 W. The card is designed for gaming and has a focus on low temperatures. The card is also designed to be energy efficient and has a lower power consumption than the bigger Ampere chips. The card has a hash-rate limiter that is tied to the driver, system firmware, and silicon to prevent tampering. The card is also designed to be overclocked and has a 5% difference between the best and worst overclocker. The card is available for $329 and is expected to sell out quickly.

Looks like this won't be replacing my writing any time soon

 

[dgianstefani]

View attachment 334473
Looks like this won't be replacing my writing any time soon

Don't worry I'd replace them with synonyms

 

[Vayra86]

AI...

All I see here is a glorified search machine, still, I'm sorry. So now you can burn several hundred watts locally to search within a limited dataset and wonder if the answer is actually correct. Yay!

I'm not seeing the magic, honestly.

 

[Anymal]

it definitely is not an advert. nvidia sent the link, the reviewer's guide, which is pretty basic and that's it

also consider that we're listing several failures and criticism .. assuming you read the review

Maybe it trained on comments text too and you just make it dumb by mistake.

 

[W1zzard]

Maybe it trained on comments text too and you just make it dumb by mistake.

I exported only the post text, not the comments

 

[stimpy88]

AI...

All I see here is a glorified search machine, still, I'm sorry. So now you can burn several hundred watts locally to search within a limited dataset and wonder if the answer is actually correct. Yay!

I'm not seeing the magic, honestly.

A.I. is just the latest tech PR buzzword to sell more product. It offers little value, and it certainly offers very little in the way of intelligence, as you simply can't trust the output at all.

And love the block on the RTX20x0 series. Bloody nGreedia.

 

[prazola]

...no one is commenting about the GTX 275 AMP!

 

[mxthunder]

...no one is commenting about the GTX 275 AMP!

did someone say gtx200 series? you got my attention.
where was this mentioned?

 

[Redwoodz]

It's mostly different components in the GPU. RTX is dedicated ray tracing hardware, AI (and DLSS) uses tensor cores (matrix math hardware).
Nvidia has been at this for a long time. I saw them at a supercomputing trade show in 2009 and wondered why a video card company was there. A couple years later, I was told we needed to build some supercomputing software that worked with their hardware and I didn't understand why. I left the company, came back a couple years later and got dragged into a project where I found out why.

Nvidia has the software that provides the base for the AI software, and other things. AMD, and Intel aren't even close at this point in time. AMD is working on this, but their software just is not there. They just abandoned a CUDA compatability library that they were working on, so maybe they are working on something else. At the moment, Nvidia owns this market.


Yeah it's interesting software and does some useful things. But it's still not solid. It gets lots of simple things right, and lots of complicated detailed things wrong. Definitely not trustworthy for important stuff, as at least one lawyer found out when he submitted some documents written by AI to the courts.

Correct. The problem lies in the fact Nvidia lied to it's gaming customers by claiming all this new hardware was for better gaming, but in truth it was always targeted for AI.

 

[bug]

Correct. The problem lies in the fact Nvidia lied to it's gaming customers by claiming all this new hardware was for better gaming, but in truth it was always targeted for AI.

Spot on! Because hardware cannot serve more than one purpose, right?