• Welcome to TechPowerUp Forums, Guest! Please check out our forum guidelines for info related to our community.

One setting that makes antialiasing look much more like it's supposed to on nvidia Maxwell and above chips

Joined
May 20, 2020
Messages
1,283 (0.91/day)
A lot of testing with different cards later and I can say there's only one setting that makes AA on nvidia newer chips look like it should (where otherwise it didn't look/work correctly)
and no there's no forcing AA through control panel and no setting it through it either; you can leave everything factory default.
You open up nv_profile_inspector and go under Antialiasing - Gamma Correction and set it to ON_IF_FOS (0x00000001 - feasible or sensible: my guess :) ) and there should be no need anymore for any exotic SS modes or flags setting.
Now I usually do force 16xAF, 4x (8x) AA, 4x (8x) Transparency SuperSampling through nv_control_panel, but I have a lot of older games where there's no other way to get AA.
Please test it and report your findings.
 
Joined
Mar 21, 2019
Messages
478 (0.26/day)
Location
Texas
System Name i'm done in
Processor AMD 5950x
Motherboard MSI MAG B550 Tomahawk
Cooling Thermalright Peerless Assassin 120 SE
Memory GSkil 64gb 3600 cl16
Video Card(s) Power Color R7900xtx Hell Hound oh hell ya
Storage 2x wd sn770 2tb 1-4tb wd- hd 2x8tb wd hd actually 1 fire cuda
Display(s) LG Ultra Gear 1440p 32" 165hz hdr monitor might go oled
Case Corsair 4000D Air Flow
Power Supply EVGA SuperNOVA 1000w G5 80+ Gold
Mouse logitech and roccet wcord
Keyboard logitech
Software W10 forever
higher resolution sometimes works better than AA.
 
Joined
May 20, 2020
Messages
1,283 (0.91/day)
One final change - since the ON_IF_FOS (0x00000001) is not good enough for all programs - combination with ON_ALWAYS (=default = 0x00000002) is though,
which results in 0x00000003 or AA_MODE_GAMMACORRECTION_MASK as explained in NV_API's Gamma Correction Enumeration.
You paste into nv_profile_inspector/"Global profile" the 0x00000003 value for AA - Gamma correction and Maxwell (GTX 9xx) and up cards always produce good AA-ed (multisampled) image.
Thank you and goodbye. :)
 
Joined
Feb 24, 2009
Messages
2,886 (0.52/day)
Location
Riverside, California
Processor AMD Ryzen 7 7800X3D
Motherboard AsRock X670E Phantom Gaming Lightning
Cooling Be Quiet! Dark Rock 4
Memory G.SKILL Trident Z5 Neo DDR5-6000 32GB (2 x 16GB)
Video Card(s) Sapphire Radeon RX 7900 XTX
Storage Samsung 980 PRO Series 1TB, Samsung 980 PRO Series 1TB, Crucial P3 NVMe M.2 2TB
Display(s) LG OLED55G2PUA
Case Lian Li O11 Dynamic XL ROG Certified
Audio Device(s) Digital out to high end dac and amps.
Power Supply EVGA GQ 1000W
Mouse Logitech G600
Keyboard Logitech G413 Carbon
VR HMD Oculus Rift CV1, Oculus Rift S, Quest 2, Quest 3
Software Windows 10 Pro
higher resolution sometimes works better than AA.
That is true most of the time. I run at 4k and some games still require AA. Many do not though!
 
Joined
May 20, 2020
Messages
1,283 (0.91/day)
Well of course today we have really large resolutions and DSR and such supersampling, but I grew up with graphics cards so to speak from Cirrus Logic VLB in my 486 DX2 66MHz and ATI 3D Charger (2MB) with Voodoo1 (4MB) in my Cyrix 200+ and on and I remember how nice everything looked with 4xS on my GeForce4 Ti 4200 but even much better with my Radeon 9800 PRO and 4xAA 8xAF, now that was a real jump in image quality. Can anyone say Smoooooothvision? :)
Anyhow AA means a lot to me still; one never forgets how it's supposed to look from the Radeon 9800 PRO era and even HD 6950 - the best one yet but finally the GTX's can match it now and more with its 8xAA and 8xTransparencySS. But enough of rambling. :D
 
Joined
Jun 3, 2010
Messages
2,540 (0.50/day)
If I read correctly, this enables transparency antialiasing which is necessary for subpixel aa.
 
Joined
May 20, 2020
Messages
1,283 (0.91/day)
This setting only turns on proper Gamma Correction (if it's used) so games look good/proper on particular NVIDIA GPUs. Whether you use AA from NV control panel or in-game is your choice.
 

Mussels

Freshwater Moderator
Staff member
Joined
Oct 6, 2004
Messages
58,413 (8.21/day)
Location
Oystralia
System Name Rainbow Sparkles (Power efficient, <350W gaming load)
Processor Ryzen R7 5800x3D (Undervolted, 4.45GHz all core)
Motherboard Asus x570-F (BIOS Modded)
Cooling Alphacool Apex UV - Alphacool Eisblock XPX Aurora + EK Quantum ARGB 3090 w/ active backplate
Memory 2x32GB DDR4 3600 Corsair Vengeance RGB @3866 C18-22-22-22-42 TRFC704 (1.4V Hynix MJR - SoC 1.15V)
Video Card(s) Galax RTX 3090 SG 24GB: Underclocked to 1700Mhz 0.750v (375W down to 250W))
Storage 2TB WD SN850 NVME + 1TB Sasmsung 970 Pro NVME + 1TB Intel 6000P NVME USB 3.2
Display(s) Phillips 32 32M1N5800A (4k144), LG 32" (4K60) | Gigabyte G32QC (2k165) | Phillips 328m6fjrmb (2K144)
Case Fractal Design R6
Audio Device(s) Logitech G560 | Corsair Void pro RGB |Blue Yeti mic
Power Supply Fractal Ion+ 2 860W (Platinum) (This thing is God-tier. Silent and TINY)
Mouse Logitech G Pro wireless + Steelseries Prisma XL
Keyboard Razer Huntsman TE ( Sexy white keycaps)
VR HMD Oculus Rift S + Quest 2
Software Windows 11 pro x64 (Yes, it's genuinely a good OS) OpenRGB - ditch the branded bloatware!
Benchmark Scores Nyooom.
What games have you seen this effect on?
 
Joined
May 20, 2020
Messages
1,283 (0.91/day)
All kinds of games, OpenGL and D3D. With multisampling gamma correction on Maxwell and up GPU's is not done properly if the 0x00000003 mode is not used.
 

Mussels

Freshwater Moderator
Staff member
Joined
Oct 6, 2004
Messages
58,413 (8.21/day)
Location
Oystralia
System Name Rainbow Sparkles (Power efficient, <350W gaming load)
Processor Ryzen R7 5800x3D (Undervolted, 4.45GHz all core)
Motherboard Asus x570-F (BIOS Modded)
Cooling Alphacool Apex UV - Alphacool Eisblock XPX Aurora + EK Quantum ARGB 3090 w/ active backplate
Memory 2x32GB DDR4 3600 Corsair Vengeance RGB @3866 C18-22-22-22-42 TRFC704 (1.4V Hynix MJR - SoC 1.15V)
Video Card(s) Galax RTX 3090 SG 24GB: Underclocked to 1700Mhz 0.750v (375W down to 250W))
Storage 2TB WD SN850 NVME + 1TB Sasmsung 970 Pro NVME + 1TB Intel 6000P NVME USB 3.2
Display(s) Phillips 32 32M1N5800A (4k144), LG 32" (4K60) | Gigabyte G32QC (2k165) | Phillips 328m6fjrmb (2K144)
Case Fractal Design R6
Audio Device(s) Logitech G560 | Corsair Void pro RGB |Blue Yeti mic
Power Supply Fractal Ion+ 2 860W (Platinum) (This thing is God-tier. Silent and TINY)
Mouse Logitech G Pro wireless + Steelseries Prisma XL
Keyboard Razer Huntsman TE ( Sexy white keycaps)
VR HMD Oculus Rift S + Quest 2
Software Windows 11 pro x64 (Yes, it's genuinely a good OS) OpenRGB - ditch the branded bloatware!
Benchmark Scores Nyooom.
That's a really vague and unhelpful answer dude

AA gamma correction is on by default in modern Nvidia drivers, too - this might be an issue with you over-riding games settings with your forced ones
 
Joined
May 20, 2020
Messages
1,283 (0.91/day)
That's a really vague and unhelpful answer dude

AA gamma correction is on by default in modern Nvidia drivers, too - this might be an issue with you over-riding games settings with your forced ones
Dude, that's your belief, but I don't care and by the way forcing AA has nothing to do with it (tested it). I found the thing that solves NV_AA (though late) without any flag hunting and editing endless profiles and even published it. As I said - test it and report findings (0x00000002 vs 0x00000003 where applicable - obviously not for titles that can't use multisampling).
 
Joined
Sep 17, 2014
Messages
20,780 (5.97/day)
Location
The Washing Machine
Processor i7 8700k 4.6Ghz @ 1.24V
Motherboard AsRock Fatal1ty K6 Z370
Cooling beQuiet! Dark Rock Pro 3
Memory 16GB Corsair Vengeance LPX 3200/C16
Video Card(s) ASRock RX7900XT Phantom Gaming
Storage Samsung 850 EVO 1TB + Samsung 830 256GB + Crucial BX100 250GB + Toshiba 1TB HDD
Display(s) Gigabyte G34QWC (3440x1440)
Case Fractal Design Define R5
Audio Device(s) Harman Kardon AVR137 + 2.1
Power Supply EVGA Supernova G2 750W
Mouse XTRFY M42
Keyboard Lenovo Thinkpad Trackpoint II
Software W10 x64
Tried this but I honestly can't tell a difference.

Can you post something like an example of what was supposed to be improved? Maybe I'm missing something here :D
 
Joined
May 20, 2020
Messages
1,283 (0.91/day)
Odd. :D
Well of course I mean I see difference in just about every game and now AA looks the same as ATI's that I enjoyed so many years.
A really obvious example: Unreal (original) with OpenGL with oldunreal Forum driver (I'm ut405player there). Also there is my OpenGL config posted there with update too.
map isvkran32 - through big red door with turbo-lift up and then you're at those green steps. AA there always looked jagged (and that's 16xAF 8xAA 8xTSS) but now it's really smooth.
Unreal_GFGTX980LP4_gamma-correction_0x00000003_step.png

Used to look like this (with NV_CP gamma)
Unreal_0x00000002_step.png

While I now see there isn't such a difference that I've taken screenshots, I surely see it while playing. I guess my monitor is at fault for that I don't know. But works for me and I shared it. :)

Crazy - now I tested another monitor and same bad results when on screen but not in screenshot (card's RAM).
I guess DVI-D ain't digital enough for these new tech wonders (and GTX980 ain't nothing new), what a messed up world!
0x00000003 is the solution for older monitors then. :ohwell:
 
Last edited:

Mussels

Freshwater Moderator
Staff member
Joined
Oct 6, 2004
Messages
58,413 (8.21/day)
Location
Oystralia
System Name Rainbow Sparkles (Power efficient, <350W gaming load)
Processor Ryzen R7 5800x3D (Undervolted, 4.45GHz all core)
Motherboard Asus x570-F (BIOS Modded)
Cooling Alphacool Apex UV - Alphacool Eisblock XPX Aurora + EK Quantum ARGB 3090 w/ active backplate
Memory 2x32GB DDR4 3600 Corsair Vengeance RGB @3866 C18-22-22-22-42 TRFC704 (1.4V Hynix MJR - SoC 1.15V)
Video Card(s) Galax RTX 3090 SG 24GB: Underclocked to 1700Mhz 0.750v (375W down to 250W))
Storage 2TB WD SN850 NVME + 1TB Sasmsung 970 Pro NVME + 1TB Intel 6000P NVME USB 3.2
Display(s) Phillips 32 32M1N5800A (4k144), LG 32" (4K60) | Gigabyte G32QC (2k165) | Phillips 328m6fjrmb (2K144)
Case Fractal Design R6
Audio Device(s) Logitech G560 | Corsair Void pro RGB |Blue Yeti mic
Power Supply Fractal Ion+ 2 860W (Platinum) (This thing is God-tier. Silent and TINY)
Mouse Logitech G Pro wireless + Steelseries Prisma XL
Keyboard Razer Huntsman TE ( Sexy white keycaps)
VR HMD Oculus Rift S + Quest 2
Software Windows 11 pro x64 (Yes, it's genuinely a good OS) OpenRGB - ditch the branded bloatware!
Benchmark Scores Nyooom.
It certainly could be something with your monitor, if you've altered its default sharpness values
 
Joined
May 20, 2020
Messages
1,283 (0.91/day)
I have Samsung 2253BW it's old I know, but it worked with my Radeons but with GTX980 it's just not cooperating. I wonder why not?
And I didn't alter anything really, just lowered the brightness and contrast some on the monitor itself, it doesn't even have sharpness settings... I did install factory color profile and it's really the same with or without it.
 

Aquinus

Resident Wat-man
Joined
Jan 28, 2012
Messages
13,147 (2.96/day)
Location
Concord, NH, USA
System Name Apollo
Processor Intel Core i9 9880H
Motherboard Some proprietary Apple thing.
Memory 64GB DDR4-2667
Video Card(s) AMD Radeon Pro 5600M, 8GB HBM2
Storage 1TB Apple NVMe, 4TB External
Display(s) Laptop @ 3072x1920 + 2x LG 5k Ultrafine TB3 displays
Case MacBook Pro (16", 2019)
Audio Device(s) AirPods Pro, Sennheiser HD 380s w/ FIIO Alpen 2, or Logitech 2.1 Speakers
Power Supply 96w Power Adapter
Mouse Logitech MX Master 3
Keyboard Logitech G915, GL Clicky
Software MacOS 12.1
Dude, that's your belief, but I don't care and by the way forcing AA has nothing to do with it (tested it). I found the thing that solves NV_AA (though late) without any flag hunting and editing endless profiles and even published it. As I said - test it and report findings (0x00000002 vs 0x00000003 where applicable - obviously not for titles that can't use multisampling).
Then why don't you provide some solid examples of what you've tried this out with instead of just saying, "All kinds of games." I suspect people are asking because they want to validate your claims, which they can't do if they don't know what your testing process and methodology is, assuming you have one.
 
Joined
May 20, 2020
Messages
1,283 (0.91/day)
Indeed. It would appear that the monitor is to blame because in the screenshots nothing can be seen; I would have to test a display port monitor to see if the issue persists.
For now that 0x3 is a bandage or a hack to fix what appears to be a whole another issue... I'm quite surprised really and there I was so certain the 0x3 was the cure. :laugh:
 
Joined
Sep 17, 2014
Messages
20,780 (5.97/day)
Location
The Washing Machine
Processor i7 8700k 4.6Ghz @ 1.24V
Motherboard AsRock Fatal1ty K6 Z370
Cooling beQuiet! Dark Rock Pro 3
Memory 16GB Corsair Vengeance LPX 3200/C16
Video Card(s) ASRock RX7900XT Phantom Gaming
Storage Samsung 850 EVO 1TB + Samsung 830 256GB + Crucial BX100 250GB + Toshiba 1TB HDD
Display(s) Gigabyte G34QWC (3440x1440)
Case Fractal Design Define R5
Audio Device(s) Harman Kardon AVR137 + 2.1
Power Supply EVGA Supernova G2 750W
Mouse XTRFY M42
Keyboard Lenovo Thinkpad Trackpoint II
Software W10 x64
Those Samsungs arent exactly known for color accuracy but certainly for oversaturation and other tweaks. Ive had them in front of me years ago. Compared to a decent IPS its night and day.

I have Samsung 2253BW it's old I know, but it worked with my Radeons but with GTX980 it's just not cooperating. I wonder why not?
And I didn't alter anything really, just lowered the brightness and contrast some on the monitor itself, it doesn't even have sharpness settings... I did install factory color profile and it's really the same with or without it.

You might want to go through the NVCP color settings instead before you start tweaking individual things outside of it. Not cooperating, is quite simply nonsensical. Back to stock settings and go from there. Color profiles dont do much if anything on sRGB. Color space is quite limited.

Gamma should be neutral on the GPU side first, then you tweak monitor however possible to hit your gamma value 2.1~2.3 depending on preference. Ideally 2.2. You can check the color response on this site then;


If results are still poor after this, you can tweak the gamma curve on the GPU side. But its always going to crush something along the way, or create some banding, etc. Perfect accuracy simply requires a neutral curve across all greyscale values and colors. And those Syncmasters are not going to offer it.
 
Last edited:
Joined
May 20, 2020
Messages
1,283 (0.91/day)
I have checked those LCD monitor test pages a few times before and now and everything looks ok there, I think I need to buy another monitor.
Would a Dell P2217 be good for now compared to this Samsung garb? There are a few used ones available... I'm quite perplexed and here I thought I had a decent monitor.
blush_2.gif
 
Joined
Sep 17, 2014
Messages
20,780 (5.97/day)
Location
The Washing Machine
Processor i7 8700k 4.6Ghz @ 1.24V
Motherboard AsRock Fatal1ty K6 Z370
Cooling beQuiet! Dark Rock Pro 3
Memory 16GB Corsair Vengeance LPX 3200/C16
Video Card(s) ASRock RX7900XT Phantom Gaming
Storage Samsung 850 EVO 1TB + Samsung 830 256GB + Crucial BX100 250GB + Toshiba 1TB HDD
Display(s) Gigabyte G34QWC (3440x1440)
Case Fractal Design Define R5
Audio Device(s) Harman Kardon AVR137 + 2.1
Power Supply EVGA Supernova G2 750W
Mouse XTRFY M42
Keyboard Lenovo Thinkpad Trackpoint II
Software W10 x64
I have checked those LCD monitor test pages a few times before and now and everything looks ok there, I think I need to buy another monitor.
Would a Dell P2217 be good for now compared to this Samsung garb? There are a few used ones available... I'm quite perplexed and here I thought I had a decent monitor. View attachment 219188

If its about accuracy and regular 60 fps gaming, get an LG IPS at the bottom of the stack. Fwiw IPS is the best option anyway, VA at lower end is hit/miss, with a lot of potential misses. At high refresh rate this changes to an advantage for VA because bang/buck heavily leans in favor of VA compared to high refresh IPS.

Is 22 inch enough for you? The mainstream bog standard diagonal for 1080p is 24 inch. A new IPS should be around 100~150 bucks and its certainly preferable to another used-up ancient LCD. Uniformity and color accuracy do suffer over time as panels are used. It can be quite a bad experience diving into that second hand.

And even new TN, which could offer some more features within budget, is going to be miles better than past gen smaller diagonal panels.
 
Joined
May 20, 2020
Messages
1,283 (0.91/day)
Thank you so much.
I'll be using gamma correction 0x00000003 for now and with "DitherAlgo6"=dword:00000003 and "DitherAlgo8"=dword:00000003 (at active driver's registry location, you find its location at HKLM/Hardware/Devicemap/Video/Device/Video0), just looks so much better despite all attempts - nothing beats it.
But yeah I'll look at new 24" IPS monitors. Although 22" with resolution 1680x1050 is plenty good enough for me.
 
Last edited:
Joined
May 20, 2020
Messages
1,283 (0.91/day)
New finding (it might be just on my monitor though) - I now have the method to prove the first image with Gamma_Correction_MASK (0x00000003) in my upper post looks better than the second image with nvdia standard gamma correction (0x00000002):
Open both in any image viewing program that has the option to increase Gamma to 2.2 (under Image -> Color Corrections in Irfanview) and the first image with Gamma_correction_MASK will remain anti-aliased and
the second image with nvidia CP-standard color correction (0x00000002) will become jagged, as if not anti-aliased at all (and both were made with 8x multisampling).
 
Joined
Jun 3, 2010
Messages
2,540 (0.50/day)
the second image with nvidia CP-standard color correction (0x00000002) will become jagged
You cannot have alpha antialiasing(transparency antialiasing) if your gradients don't work.

It will calculate, but will nullify with wrong coefficient.
 
Joined
Jun 3, 2010
Messages
2,540 (0.50/day)
Except those surfaces aren't alpha!
All surfaces are alpha if you are using it to resolve blending in the viewing perspective. Alpha textures are applied to texture sampling to make antialiasing by default. That is how the rasterizer does its thing. There is no separate aa hardware. They are just z blenders and texture samplers.
 
Top