• Welcome to TechPowerUp Forums, Guest! Please check out our forum guidelines for info related to our community.

Page file size?

Status
Not open for further replies.
I remember a long long time ago I had 768mb of ram and was trying to play NWN 1. It ran like trash. This was back when Windows XP was dominant. To fix the issue I came a cross a post about modifying the virtual memory amount. I set it to 4GB and the game ran amazing.

Years have passed since that day. I have been through numerous phases.

-Run it with 4GB
-Dont run it at all
-Run it with 1GB
-Let Windows decide.

The only conclusion I have been able to come to without actually designing it myself is the following.

- Running it with 4GB for several years proved to be an amazing benefit back when 1GB of DDR1 RAM was hundreds of dollars a stick. I kept it like this for many many years and never had a single issue. That said I could never ultimately decide whether or not it still provided the same benefit as it had for me that day. I also realized with the onset of bigger games in the early 2000s and the low storage capability of affordable HDDs at that time that 4GB was too much for a data hoarder or someone that needed or had many programs installed. A cycle that would crop backup with the presentation of the first wave of 32 and 64gb SSDs. With the added bonus of destroying them back when NAND structure was very weak. Of course this was back with XP and memory management in windows OSs comes very far with almost every release.

-Not running it at all seemed like a fantastic prospect when RAM and total board compatibility grew and became affordable. This became a popular practice around Windows Vista. When "4GB Vista Ready" kits were introduced at around the $200 mark. Memory management was better for software in general obviously looking the other way at Vistas memory usage in general compared to XP at the time it was a product of change and higher OS consumption was starting to be accepted when we looked more closely at the technology that was going to be implemented in future OSs like transparent shells and security measures that loaded system processes in memory.

Memory management was getting better and running without a pagefile worked for me for a very long time, however like anything humans are unpredictable and imperfect. Some programs were coded using old techniques and peoples refusal to leave the past behind meant compatibility modes that would break Windows memory management algorithms causing memory leaks. These caused users and myself on many different occasions issues as our systems would break because of the unforeseen consequences of bad programming and maybe bad practice. Of course then and even now, who can be certain running without one is bad practice? If not for the memory leaks of management protocols would we consistently see adverse effects? Of course we also had the issue with the crashes themselves. With no pagefile we could not analyse crash dumps.

-Running with 1GB of RAM was another popular midpoint starting with Windows 7 when we started to see less and less of the issues we encountered with Vista. The framework and best practices for software was more outlined for developers and the kernel code cleaned up and improved so 7 itself used less resources. However with the improvements most were still unsure if the likelihood of issues was going down because some were now running pagefiles that were not previously, or because now RAM stepped into the DD3 erra, becoming cheaper and more plentiful with the added software improvements simply became less of an issue because we now rarely reached the threshold. Of course one obvious added benefit is that in some small capacity we were now able to analyse some smaller crash dumps with the added pagefile thus making some bluescreens and dumps that weren't 1:1 copies of system memory readable.

-Windows managed pagefile was a proof of concept and the last in my line of thinking. I did all other varients before settling on what MS setup for me on day 1. I did this more as an academic exercise, for all I knew current OSs would be aware enough to correct issues I had once had like NWN not working. However I have seen 3 different combinations of issues. Of course one of which is all systems GO. Working as intended with the onset of better cheaper and bigger SSDs and memory Windows pagefile usage was something that slowly stopped being considered when size was thought about. Correctly working it is under the total system amount and automatically scales to need. I have seen no issues with this model.

With everything however there are PROs and CONs one of which is when automatic adjustment does not work. Over the years memory topology and management has changed. All of it for the better, but systems arent perfect. I have seen automatic configuration 1:1 match my system memory which becomes a serious concern when disks are getting thrashed by the sheer size of the pagefile. It is also an issue in this aspect when system memory started becoming incredibly cheap during the DDR3 speed races when 1333 and 1600mhz sticks were as low as $1X for gigs of capacity. This quickly killed systems that were still running reliable smaller SSDs while running deep density sticks because of there cost effectiveness.

I have also seen Windows management use double system memory which still ties into what I just wrote but more importantly is the issue of it not correcting itself. whether it is double, 1:1 or in the unfortunate event of my recent dealing with scientific simulations were memory consumption was very high causing BSODs because Windows Memory Management was not automatically expanding the paging file the issues with Automatically setting a paging size isnt usually due to the size at which it is set automatically. The problem comes later when it FAILS to shrink or expand it. This brings in all the issues discussed above without the added benefit of being able to say you did it to yourself.

In closing I monitor my paging files for inconsistency due to Windows or software that manipulates its value incorrectly. However I will say that I do have it automatically set for every system I own now. That isnt too say I will not change it like I already have several times, only that I currently see no issues with it as is as long as it keeps working in what I believe to be an acceptable capacity.

Am I going to banish someones thought or personal ideals about this setting? No, I will not. I do not know what there situation or needs are and I have manipulated it myself on multiple occasions because of real or perceived problems with it being automatically set.

That said I also think there is no wrong way to eat a reeses.
 
The pagefile still exists, so perhaps it's still needed.
This is key. The Page File, virtual memory, and memory management (both in the OS and hardware) have gone through many changes since the PF was first introduced in Windows 3.0 - then known as the "swap file". Windows knows how much RAM we have installed on our systems. It would be a simple matter to code Windows to disable the PF if it was not needed or it provided some benefit to disable it - just as it automatically disables defragging on SSDs when it senses the SSD. But Windows does not disable it, ever.

The developers at Microsoft are some pretty sharp people with the ultimate goal of coding the OS to optimize our hardware resources. This is something even Microsoft marketing weenies understand. Since there is no reason for the marketing weenies to interfere with the PF settings, there is no reason to assume the developers are lazy and have not coded modern versions Windows to properly analyze our VM usage and set the PF settings accordingly.
 
This is key. The Page File, virtual memory, and memory management (both in the OS and hardware) have gone through many changes since the PF was first introduced in Windows 3.0 - then known as the "swap file". Windows knows how much RAM we have installed on our systems. It would be a simple matter to code Windows to disable the PF if it was not needed or it provided some benefit to disable it - just as it automatically disables defragging on SSDs when it senses the SSD. But Windows does not disable it, ever.

The developers at Microsoft are some pretty sharp people with the ultimate goal of coding the OS to optimize our hardware resources. This is something even Microsoft marketing weenies understand. Since there is no reason for the marketing weenies to interfere with the PF settings, there is no reason to assume the developers are lazy and have not coded modern versions Windows to properly analyze our VM usage and set the PF settings accordingly.
God forbid those weenies at m$ should design an OS without a pagefile, doubt they will ever get rid of it.
 
If you use photoshop type programs you need a swap/page as well. If worried about drive space use a ram drive and put it on there. I do never have issues ever.

Just set it and forget seriously.
 
If you use photoshop type programs you need a swap/page as well. If worried about drive space use a ram drive and put it on there. I do never have issues ever.

Just set it and forget seriously.
video editing too.

Ram drive as page file? hahaha

TBH any professional program worth its price would program its own source page file to a mapped SSD/HDD.
 
Last edited:
Just leave it as auto, and if you worry about your ssd, then just leave it as auto on a mechanical drive, or an usb stick. Readyboost still exist xD.
 
Just leave it as auto, and if you worry about your ssd, then just leave it as auto on a mechanical drive, or an usb stick. Readyboost still exist xD.
Eh Readyboost won't let me fondle it so I just let my HDDs take the brunt for the pagefile.

Dumb Readyboost won't let me put my 2gb flash drive to use for once. :ohwell:
 
I remember Readyboost helping a lot on those old 1GB Atom netbooks.
 
Eh Readyboost won't let me fondle it so I just let my HDDs take the brunt for the pagefile.

Dumb Readyboost won't let me put my 2gb flash drive to use for once. :ohwell:
You're not supposed to fondle your dongle! :roll:

IIRC Readyboost was designed to only compliment platter drives and totally useless on SSDs
 
God forbid those weenies at m$ should design an OS without a pagefile, doubt they will ever get rid of it.
Don't be critical of the developers - or at least don't blame the developers for the actions of the marketing weenies, bean counters, and the "business" decision makers.

The developers are the real pros at MS who know their stuff and they push out top-tier software. Just about every messed up thing at Microsoft is due to some poor decision forced upon and beyond the control of the actual software developers. :(

As far as Page Files on RAM drives, I don't see the point. It seems counterintuitive to me. If disk space is that precious, uninstall unused programs, move some files to a different drive and delete unneeded files - viable temporary measures while you save your pennies to buy more disk space for a permanent solution. And with the price of disk space, even SSD space being so low and still dropping, saving enough pennies should not take long.

Seriously, if you have space on your SSD, that is the best place for the PF (unless it is an antique first generation SSD). Modern SSDs just don't suffer from the read/write limitations of first generation SSDs. There is no reason to expect a mechanical HD will last longer than any current generation SSD.

If you have SSDs in your system, why not take full advantage of the vastly superior performance they offer?
 
ASRock-XFast-RAM.3.png


Argue with Asrock...
 
Argue with Asrock...
Not sure who you are talking to, or what it is you are suggesting to argue about. I don't believe anyone said it cannot be done.

My point is putting a PF in RAM is like having integrated graphics. A potentially big chunk of RAM is stolen and now dedicated for some other purpose. And in the case of using RAM for the PF, it is likely much of that stolen RAM will go unused much of the time. So again, for me, that seems counterintuitive and an inefficient use of system RAM.
 
A while ago I was reading somewhere that some applications crash without a pagefile, don't know about games though.

I don't know when or how it happened, but at one point the paging file was turned off on my computer. I didn't turn it off and I thought windows defaulted to having it as auto managed....

I have 16GB RAM, 250GB SSD and 2 HDDs for storage. I had just gotten my GTX 980Ti and I was playing Shadow of Mordor at 5760x1080, everything maxed out. I kept running into low memory issues and the game would minimize to desktop and show me the low memory message.

The game was easily using upwards of 6GB of VRAM, but I didn't see my RAM make any jumps while gaming. I found my paging file was off and I turned it back on. Windows to auto manage set it to some stupid amount that wouldn't be beneficial so I just manually set it to 4096MB and I haven't had any problems since.
 
I'm using 16MB which is the recommended minimum. I've also set BSOD dumps to be minidumps only. This way I still have the debugging capability on BSOD's, but the system is running everything from RAM. If you turn off pagefile, you won't get any memory dumps and that can suck sometimes if you're trying to figure out why something is crashing.
How do you even get a BSOD these days? Haven't seen one since Windows Fista.
 
I've been getting UNEXPECTED_STORE_EXCEPTION in Windows 10. No one seems to know why they happen and they are pretty common. I think it has something to do with Universal Windows Platform applications.

Page file, under normal circumstances, shouldn't cause a BSOD. Only way it would is if the device the page file is on is failing and has a read, write, or data integrity error.
 
I have 128GB of RAM, Windows 10 set it to 256GB for me. The Virtual RAM amount depends on your applications. For me I constant use 90~110GB of RAM so Windows 10 set it to a high 256GB to prevent me from crashing.
 
256GB? Wow! It has been a long time I have seen Windows set a PF larger than the amount of RAM you have. What does it say is currently allocated? I have 16GB of RAM installed and Windows set a max PF of 2938MB with 2432MB currently allocated.
 
Don't be critical of the developers - or at least don't blame the developers for the actions of the marketing weenies, bean counters, and the "business" decision makers.

The developers are the real pros at MS who know their stuff and they push out top-tier software. Just about every messed up thing at Microsoft is due to some poor decision forced upon and beyond the control of the actual software developers. :(

As far as Page Files on RAM drives, I don't see the point. It seems counterintuitive to me. If disk space is that precious, uninstall unused programs, move some files to a different drive and delete unneeded files - viable temporary measures while you save your pennies to buy more disk space for a permanent solution. And with the price of disk space, even SSD space being so low and still dropping, saving enough pennies should not take long.

Seriously, if you have space on your SSD, that is the best place for the PF (unless it is an antique first generation SSD). Modern SSDs just don't suffer from the read/write limitations of first generation SSDs. There is no reason to expect a mechanical HD will last longer than any current generation SSD.

If you have SSDs in your system, why not take full advantage of the vastly superior performance they offer?

Easy there Trigger! I wasnt attacking the developers, I was generalizing, but they are part of a team and do have some feedback, even if its a little slice. IMO, its the management that makes the poor decisions that messes stuff up.

The pagefile HAS outlived its usefulness now that memory sizes scaled up faster then [HDD] disk access times did before SSDs, what most people dont realize is that its so damn easy to incorporate a type of Ram disk into developing programs. We are out of the dark ages of programming now, everything is only limited by the programmers skill level. M$ should do away with the pagefile and put the burden on developers to create their own routines to make up for it.
The nice thing about larger amounts memory becoming a standard is that most games, and what ever else, cant fill 32 gigs of memory easily.

If your system is constantly using a page file, you prolly dont have enough memory. windows is still picky about its pagefile, it doesnt matter either HDD/SSD, above 8 GB memory, 50MB per GB is sufficient, under 8GB let windows manage it.
 
Last edited:
256GB? Wow! It has been a long time I have seen Windows set a PF larger than the amount of RAM you have. What does it say is currently allocated? I have 16GB of RAM installed and Windows set a max PF of 2938MB with 2432MB currently allocated.

Post #24 of this thread: https://www.techpowerup.com/forums/threads/virtual-memory-with-large-ram.222489/

Genome assembly and alignment takes a huge amount of RAM. Somehow I was stupid enough to believe that 128GB is enough.


Here is a screenshot of a relative low work load day. I am just running some transcriptome assembly, not even genome size. And it easily chews around 38GB. That is with only ONE pipeline running. Usually I parallel assemble 2~3 projects to max out RAM. However if I am doing genome assembly and alignment I can only perform one at a time. That was the 90~110GB usage I was talking about.



Take home message of the day: DO NOT DISABLE PAGE FILE!. Windows knows better than you.
thumbnail_38gb.jpg

MasuRCA.jpg
 
Easy there Trigger! I wasnt attacking the developers,
You were talking about the designers of Windows leaving out the PF and that is not a management decision. To be sure, I am a hardware guy so my kind are always butting heads with programmers. But I still will not stand by idle when they are bashed (even by association) without due cause. So I was just making sure the record was set straight - not admonishing you..

The pagefile HAS outlived its usefulness now that memory sizes scaled up faster then [HDD] disk access times did before SSDs,
:( Oh, but now I will. To suggest virtual memory (PF + RAM) is wholly dependent on RAM size and disk speed makes it is clear you don't fully understand memory management either. The page file is still useful, or else it would not be used. Again, Microsoft does not benefit by coding in something that provides no usefulness. That is a waste of coder resources and would introduce unnecessary delays and more parts that could fail.

If the PF was not useful and the computer had gobs of RAM and SSDs, MS would code in disabling the PF. But they know otherwise is better.

So do Linux developers but they don't disable it either. In fact, Linux is capable of using several swap files at the same time on the same disk to cache pages of data to speed up performance.

And Microsoft cannot mandate every computer have 128GB of RAM, or SSDs either.
Take home message of the day: DO NOT DISABLE PAGE FILE!. Windows knows better than you.
:clap: They sure do.
 
I have 128GB of RAM, Windows 10 set it to 256GB for me. The Virtual RAM amount depends on your applications. For me I constant use 90~110GB of RAM so Windows 10 set it to a high 256GB to prevent me from crashing.

When I first went from 8GB to 16 GB windows 7 set up a 32GB page file, on my 120GB SSD. :laugh: I have never used more than 5GB. So I manually set it to a couple of GB, but in Win10 the settings reverted for some reason...
 
...

:( Oh, but now I will. To suggest virtual memory (PF + RAM) is wholly dependent on RAM size and disk speed makes it is clear you don't fully understand memory management either.
Thats not what I said. I understand enough to know that accesss times to a HDD are longer than to a SSD, thats all most people really know or care about. I dont need to know exact times, I'm not a MS programmer, I only dabble anymore. And I still think M$ can do better with its memory management.

The page file is still useful, or else it would not be used. Again, Microsoft does not benefit by coding in something that provides no usefulness. That is a waste of coder resources and would introduce unnecessary delays and more parts that could fail.

If the PF was not useful and the computer had gobs of RAM and SSDs, MS would code in disabling the PF. But they know otherwise is better.
There are still older programs that use the PF, I know that, but they wont be around forever. Future programs will use PF less often, and as I said earlier, there is enough RAM for them not use the PF. Part speculation ofcourse. (I think now you are blowing this out of proportion. gobs, indeed. :roll:)

So do Linux developers but they don't disable it either. In fact, Linux is capable of using several swap files at the same time on the same disk to cache pages of data to speed up performance.[/QUOTE]
I really dont give a damn what Linus developers do, I dont play in Linux. I will concede that the PF has its limited uses, but generally its still useless to the average user who doesnt know what it is. I can only speak for myself when I say that I find 100MB is enough to not make windows crash. I spent my share years fixing computers for others, my low opinion of M$ is mine, take it or leave it but dont ... nvm.

And Microsoft cannot mandate every computer have 128GB of RAM, or SSDs either.
....
No I suppose they cant, but being mostly a gamer, game developers can set required specs, and if gamers want to play that game above the shit settings (low/extremely low), they'll comply.
 
Just FYI
I just did a clean install with 32 Gb of Ram. Windows 10 Pro set my page file to

capture002.jpg


Its appears W10 has done a better job of keeping it under control
 
Next thing we know we'll see someone with a 1TB SSD with the whole thing being used for pagefile but only gets 2GB of memory to chew on.
 
There are still older programs that use the PF

If you read back through this thread, you will see there are still many current programs that expect to find and will use the PF - regardless the amount of installed RAM. You seem to be implying that is a bad thing. It is not.

If you read back through the 1/2 dozen links that show the advantages to the PF, you would learn how memory management works with the PF. Also a good thing.
And I still think M$ can do better with its memory management.
I really dont give a damn what Linus developers do, I dont play in Linux.
my low opinion of M$ is mine, take it or leave it
I think that last statement says it all. Your bias has clouded your view of the facts. Microsoft is stupid for still using the PF, but all the developers of the many versions of Linux which also use a page file don't matter because you don't play in Linux? Yeah right! :rolleyes:

So I absolutely believe you when you say you are not a MS programmer! And as to your opinion, I'll take you up on your offer and leave it, and stick with the opinions of the many real experts (as seen in all the provided links above).

I think it is important to note that memory management is also controlled by the CPUs via on-die memory managers used by both AMD and Intel. And these management protocols are not dictated strictly by Microsoft but through extensive cooperative effort by the CPU makers, various OS makers (not just MS) and others. Yes, MS has the major hand with Windows, and until Man can create perfection, there's always room for improvement. But the fact is, Windows knows how to manage virtual memory very well. If the PF did not provide any benefits, it would not be used.
 
Last edited:
Status
Not open for further replies.
Back
Top