NVIDIA Fine-Tunes Llama3.1 Model to Beat GPT-4o and Claude 3.5 Sonnet with Only 70 Billion Parameters

[kondamin]

Would have been nice if intel hadnt duped 3dxpoint so a TB of that could be put on a 5090

 

[Minus Infinity]

IIRC 4 bit quants should allow it to run on PC(high end). Id love to one day run model of this size locally!

Arrow Lake NPU is surely up to the task

 

[Legacy-ZA]

Up - 1 R

Yep, it works fine.

I was just about to... erm, yeah, you got here first.

Glad to see all that VRAM going to "good use" while we have to pay top dollar for a mediocre amount so our games don't stutter, nVstuttterrrrrrrr here are all your "R"s Mr A.I.

 

[StimpsonJCat]

If A.I. especially from nGreedia is so good, how come it's been 2 years since they announced that they would use A.I. to create graphics drivers for their cards...? Just marketing BS, as somebody has already shown in this thread. All it's good for is language, fake voices and A.I. image generation.

 

[AleksandarK]

If A.I. especially from nGreedia is so good, how come it's been 2 years since they announced that they would use A.I. to create graphics drivers for their cards...? Just marketing BS, as somebody has already shown in this thread. All it's good for is language, fake voices and A.I. image generation.

NVIDIA already uses AI to design chips, so don't underestimate the power of AI so soon. For something its good, for some things not so much

 

[StimpsonJCat]

NVIDIA already uses AI to design chips, so don't underestimate the power of AI so soon. For something its good, for some things not so much

Well it was nV themselves that said they will use A.I. to write their display drivers. They of all people would know if it could do it or not. My point is that A.I. beyond certain low-level functions, is not the be-all-and-end all it is hyped to be if even NV can't make use of it in 2 years.

Just look at the "new" perma-beta NV App... It's been a year, and they still haven't been able to add even half the functionality of their 20-year-old control panel. If A.I. was what NV promise it is, why can't they get it to do anything meaningful for them?

We have learned that anything NV announces doesn't necessarily mean that they will deliver it. I feel for the most part, A.I. is fool's gold.

 

[LittleBro]

NVIDIA already uses AI to design chips, so don't underestimate the power of AI so soon. For something its good, for some things not so much

If so called "AI" is really used by Nvidia to design their chips, then god help us. Wonder how many transistors in that chip are just a waste of sand.

If you let lots of electronics schemes through the model, it will still deliver another scheme based on provided data. It can't really think, so don't expect an improvement. I'm not saying that it can't yield some useful stuff, but the chances are really low.