• Welcome to TechPowerUp Forums, Guest! Please check out our forum guidelines for info related to our community.

COMPRESSING Drives

WOOKZ

New Member
Joined
Apr 13, 2009
Messages
112 (0.02/day)
Location
SYD AUS
System Name WOOKZ_KRAIT
Processor i7 920 DO STEP
Motherboard RAMPAGE 2 EXTREME
Cooling THORS HAMMER X DUAL FANS
Memory 6 GIG G SKILL 1600 Trident
Video Card(s) GTX 295 DUEL PCB
Storage 2X 150 GIG WD RAPTORS{OS} [WD 1 TB STORAGE] USB 500 Gig Ex FOR Backup
Display(s) 27'' HD
Case ANTEC 1200
Audio Device(s) CARD WITH BOARD
Power Supply CORSAIR HX 1000Watt MODULAR
Software WIN 7 ULTIMATE 64
does compression of the OS drive hamper proformance
 
Joined
Jun 29, 2009
Messages
321 (0.06/day)
System Name i5
Processor Intel Core i5 750 @ 3.2ghz 1.1v
Motherboard MSI P55-GD65
Cooling Deepcool ICEEGDE 400 Ni + Deepcool Rockman
Memory Kingston 12GB DDR3 1333MHz
Video Card(s) Crossfire 2x AMD R9 270 2GB
Storage Seagate Barracuda 7200.12 1TB
Display(s) Acer 22" AL2216W 1680x1050
Case 120mm,140mm,220mm fans.
Audio Device(s) Realtek HD
Power Supply Topower SilentCool 500w
Software Windows 7
i'll say YES
 

i789

New Member
Joined
Sep 29, 2009
Messages
145 (0.03/day)
Location
point roberts, wa
since you have to decompressing your OS when you use it, so I say you will take performance hit but depends on how much you compress it, the difference is going from small to a lot.
 

newtekie1

Semi-Retired Folder
Joined
Nov 22, 2005
Messages
28,472 (4.25/day)
Location
Indiana, USA
Processor Intel Core i7 10850K@5.2GHz
Motherboard AsRock Z470 Taichi
Cooling Corsair H115i Pro w/ Noctua NF-A14 Fans
Memory 32GB DDR4-3600
Video Card(s) RTX 2070 Super
Storage 500GB SX8200 Pro + 8TB with 1TB SSD Cache
Display(s) Acer Nitro VG280K 4K 28"
Case Fractal Design Define S
Audio Device(s) Onboard is good enough for me
Power Supply eVGA SuperNOVA 1000w G3
Software Windows 10 Pro x64
Definitely, not only does every file have to be decompressed before use, but the decompression and compression on every file access adds system overhead. The compression is smart enough to not compress the most commonly used OS files, but it still gives a pretty big hit on performance.
 

[Ion]

WCG Team Assistant
Joined
Sep 15, 2009
Messages
13,391 (2.52/day)
Location
Raleigh, North Carolina, United States
System Name Niedersachsen / Ribe / Minsk
Processor i3 3240 / i7-3520M / 4x Opteron 6376 @ 2.86GHz
Motherboard BIOSTAR H61M / HP Q77 / Supermicro H8QG7
Cooling Stock / Stock / 4x 1U G34
Memory 1x8GB / 2x4GB / 4x4GB
Video Card(s) GTX260 / Intel HD 4000 / nVidia GT310
Storage 80GB Intel SSD / 256GB Intel SSD / 2x 60GB SSD (RAID1)
Display(s) Dell 3007 + HP 2245w / 12.1" 1366x768 / None
Case Antec NSK3480 / HP / Supermicro 1U
Audio Device(s) Onboard
Power Supply Enermax 500W / HP 130W / Supermicro Gold 1400W
Keyboard IBM Model M
Software Windows 7 (Niedersachsen/Ribe) / Linux Mint 17.2 (Minsk)
Yep, I had it set on my laptop because of the small disk (60GB), but it made things far slower, so now I just keep all of my junk on the 500GB disk in my desktop.
 
Joined
Oct 2, 2004
Messages
13,791 (1.94/day)
The hit is not all that high, even on lower end laptops. But it's there. Besides, with Windows Vista and above, you won't be able to compress system files when UAC is enabled. So, you'll be able to only compress data files.
 
Joined
May 20, 2004
Messages
10,487 (1.45/day)
Definitely, not only does every file have to be decompressed before use, but the decompression and compression on every file access adds system overhead. The compression is smart enough to not compress the most commonly used OS files, but it still gives a pretty big hit on performance.

Pretty big hit? Happen to have some numbers on that?

From what I know there are even some cases where NTFS compression improves performance, can't find a decent article atm though. I haven't run any benchmarks on compressed drives in ages, though one of the drives in my server is compressed and I don't notice any performance issues (perhaps it's a few % lower, but certainly not a "pretty big hit"). I'm guessing performance increases basically can happen when compression is high enough to reduce disk access enough to matter (ie 50% compression > 50% less reading from disk) and CPU's being able to decompress faster than it would take the disk to read that other 50%. Though I can't back that up with any actual facts.
 
Joined
May 20, 2004
Messages
10,487 (1.45/day)

It's the legacy disk, thus no RAID applies (for those who think it's some array). The controller doesn't have on board cache either that affects anything.




A bit hard to read due to the cached read, but the write speeds seem fine, even though you can't read it very precise.
 

Mussels

Freshwater Moderator
Staff member
Joined
Oct 6, 2004
Messages
58,413 (8.21/day)
Location
Oystralia
System Name Rainbow Sparkles (Power efficient, <350W gaming load)
Processor Ryzen R7 5800x3D (Undervolted, 4.45GHz all core)
Motherboard Asus x570-F (BIOS Modded)
Cooling Alphacool Apex UV - Alphacool Eisblock XPX Aurora + EK Quantum ARGB 3090 w/ active backplate
Memory 2x32GB DDR4 3600 Corsair Vengeance RGB @3866 C18-22-22-22-42 TRFC704 (1.4V Hynix MJR - SoC 1.15V)
Video Card(s) Galax RTX 3090 SG 24GB: Underclocked to 1700Mhz 0.750v (375W down to 250W))
Storage 2TB WD SN850 NVME + 1TB Sasmsung 970 Pro NVME + 1TB Intel 6000P NVME USB 3.2
Display(s) Phillips 32 32M1N5800A (4k144), LG 32" (4K60) | Gigabyte G32QC (2k165) | Phillips 328m6fjrmb (2K144)
Case Fractal Design R6
Audio Device(s) Logitech G560 | Corsair Void pro RGB |Blue Yeti mic
Power Supply Fractal Ion+ 2 860W (Platinum) (This thing is God-tier. Silent and TINY)
Mouse Logitech G Pro wireless + Steelseries Prisma XL
Keyboard Razer Huntsman TE ( Sexy white keycaps)
VR HMD Oculus Rift S + Quest 2
Software Windows 11 pro x64 (Yes, it's genuinely a good OS) OpenRGB - ditch the branded bloatware!
Benchmark Scores Nyooom.
when you use file compression, in order to read them they have to get uncompressed into system memory, and written temporarily back on the HDD.


its not an optimal solution at all.


XP/vista/etc already compress some files, mostly system restore/SP uninstall folders and such.
 

W1zzard

Administrator
Staff member
Joined
May 14, 2004
Messages
26,958 (3.71/day)
Processor Ryzen 7 5700X
Memory 48 GB
Video Card(s) RTX 4080
Storage 2x HDD RAID 1, 3x M.2 NVMe
Display(s) 30" 2560x1600 + 19" 1280x1024
Software Windows 10 64-bit
there is a break even point, when the drive takes longer to read the data than the cpu needs to compress/decompress it and you have that amount of cpu power idle anyway
 

Mussels

Freshwater Moderator
Staff member
Joined
Oct 6, 2004
Messages
58,413 (8.21/day)
Location
Oystralia
System Name Rainbow Sparkles (Power efficient, <350W gaming load)
Processor Ryzen R7 5800x3D (Undervolted, 4.45GHz all core)
Motherboard Asus x570-F (BIOS Modded)
Cooling Alphacool Apex UV - Alphacool Eisblock XPX Aurora + EK Quantum ARGB 3090 w/ active backplate
Memory 2x32GB DDR4 3600 Corsair Vengeance RGB @3866 C18-22-22-22-42 TRFC704 (1.4V Hynix MJR - SoC 1.15V)
Video Card(s) Galax RTX 3090 SG 24GB: Underclocked to 1700Mhz 0.750v (375W down to 250W))
Storage 2TB WD SN850 NVME + 1TB Sasmsung 970 Pro NVME + 1TB Intel 6000P NVME USB 3.2
Display(s) Phillips 32 32M1N5800A (4k144), LG 32" (4K60) | Gigabyte G32QC (2k165) | Phillips 328m6fjrmb (2K144)
Case Fractal Design R6
Audio Device(s) Logitech G560 | Corsair Void pro RGB |Blue Yeti mic
Power Supply Fractal Ion+ 2 860W (Platinum) (This thing is God-tier. Silent and TINY)
Mouse Logitech G Pro wireless + Steelseries Prisma XL
Keyboard Razer Huntsman TE ( Sexy white keycaps)
VR HMD Oculus Rift S + Quest 2
Software Windows 11 pro x64 (Yes, it's genuinely a good OS) OpenRGB - ditch the branded bloatware!
Benchmark Scores Nyooom.
Why? Source?

i remember it from a course i took, which made me go and format my HDD's to a 64K cluster size... which then made XP impossible to install due to service pack 2 cracking the shits about not being able to compress its uninstaller.

its half related, but its WHY i remember it.


will google for details now


ding, found it


http://support.microsoft.com/kb/307987

You may notice a decrease in performance when you work with NTFS-compressed files. When you open a compressed file, Windows automatically decompresses it for you, and when you close the file, Windows compresses it again. This process may decrease your computer performance.

underline my emphasis



more
http://support.microsoft.com/kb/251186/EN-US/
NTFS compression has the following performance characteristics. When you copy or move a compressed NTFS file to a different folder, NTFS decompresses the file, copies or moves the file to the new location, and then recompresses the file. This behavior occurs even when the file is copied or moved between folders on the same computer.

it may be me interpreting it wrong, but it clearly sounds like its decompressing it to a file and not leaving it in memory
 

W1zzard

Administrator
Staff member
Joined
May 14, 2004
Messages
26,958 (3.71/day)
Processor Ryzen 7 5700X
Memory 48 GB
Video Card(s) RTX 4080
Storage 2x HDD RAID 1, 3x M.2 NVMe
Display(s) 30" 2560x1600 + 19" 1280x1024
Software Windows 10 64-bit
it [ntfs compression] decompresses to memory

it's not even half related .. it's 0 related .. well it uses the same word, but that's it
 
Joined
May 20, 2004
Messages
10,487 (1.45/day)
i remember it from a course i took, which made me go and format my HDD's to a 64K cluster size... which then made XP impossible to install due to service pack 2 cracking the shits about not being able to compress its uninstaller.

its half related, but its WHY i remember it.


will google for details now

The installer doesn't work on file system level though.
 

Mussels

Freshwater Moderator
Staff member
Joined
Oct 6, 2004
Messages
58,413 (8.21/day)
Location
Oystralia
System Name Rainbow Sparkles (Power efficient, <350W gaming load)
Processor Ryzen R7 5800x3D (Undervolted, 4.45GHz all core)
Motherboard Asus x570-F (BIOS Modded)
Cooling Alphacool Apex UV - Alphacool Eisblock XPX Aurora + EK Quantum ARGB 3090 w/ active backplate
Memory 2x32GB DDR4 3600 Corsair Vengeance RGB @3866 C18-22-22-22-42 TRFC704 (1.4V Hynix MJR - SoC 1.15V)
Video Card(s) Galax RTX 3090 SG 24GB: Underclocked to 1700Mhz 0.750v (375W down to 250W))
Storage 2TB WD SN850 NVME + 1TB Sasmsung 970 Pro NVME + 1TB Intel 6000P NVME USB 3.2
Display(s) Phillips 32 32M1N5800A (4k144), LG 32" (4K60) | Gigabyte G32QC (2k165) | Phillips 328m6fjrmb (2K144)
Case Fractal Design R6
Audio Device(s) Logitech G560 | Corsair Void pro RGB |Blue Yeti mic
Power Supply Fractal Ion+ 2 860W (Platinum) (This thing is God-tier. Silent and TINY)
Mouse Logitech G Pro wireless + Steelseries Prisma XL
Keyboard Razer Huntsman TE ( Sexy white keycaps)
VR HMD Oculus Rift S + Quest 2
Software Windows 11 pro x64 (Yes, it's genuinely a good OS) OpenRGB - ditch the branded bloatware!
Benchmark Scores Nyooom.
The installer doesn't work on file system level though.

i'd install XP, it'd go well, then it'd BSOD on boot.

ok w1zz, so its 0.00001% related - like i said, its just WHY i remembered it.
 

Mussels

Freshwater Moderator
Staff member
Joined
Oct 6, 2004
Messages
58,413 (8.21/day)
Location
Oystralia
System Name Rainbow Sparkles (Power efficient, <350W gaming load)
Processor Ryzen R7 5800x3D (Undervolted, 4.45GHz all core)
Motherboard Asus x570-F (BIOS Modded)
Cooling Alphacool Apex UV - Alphacool Eisblock XPX Aurora + EK Quantum ARGB 3090 w/ active backplate
Memory 2x32GB DDR4 3600 Corsair Vengeance RGB @3866 C18-22-22-22-42 TRFC704 (1.4V Hynix MJR - SoC 1.15V)
Video Card(s) Galax RTX 3090 SG 24GB: Underclocked to 1700Mhz 0.750v (375W down to 250W))
Storage 2TB WD SN850 NVME + 1TB Sasmsung 970 Pro NVME + 1TB Intel 6000P NVME USB 3.2
Display(s) Phillips 32 32M1N5800A (4k144), LG 32" (4K60) | Gigabyte G32QC (2k165) | Phillips 328m6fjrmb (2K144)
Case Fractal Design R6
Audio Device(s) Logitech G560 | Corsair Void pro RGB |Blue Yeti mic
Power Supply Fractal Ion+ 2 860W (Platinum) (This thing is God-tier. Silent and TINY)
Mouse Logitech G Pro wireless + Steelseries Prisma XL
Keyboard Razer Huntsman TE ( Sexy white keycaps)
VR HMD Oculus Rift S + Quest 2
Software Windows 11 pro x64 (Yes, it's genuinely a good OS) OpenRGB - ditch the branded bloatware!
Benchmark Scores Nyooom.
weee, a PDF!


its not like i'm going to disagree with evidence here, i was merely stating what i had been taught (and until now, beleived due to lack of contrary evidence)


edit: i read that, and dont see it mentioned specifically whether or not decompressed files are left in ram, or decompressed to the drive.


edit 2: thinking about it, what i learned may have been the compression used on fat32 drives (if there was one?) it was around the early XP days when i did this course.
 
Last edited:
Joined
May 20, 2004
Messages
10,487 (1.45/day)
weee, a PDF!


its not like i'm going to disagree with evidence here, i was merely stating what i had been taught (and until now, beleived due to lack of contrary evidence)


edit: i read that, and dont see it mentioned specifically whether or not decompressed files are left in ram, or decompressed to the drive.


edit 2: thinking about it, what i learned may have been the compression used on fat32 drives (if there was one?) it was around the early XP days when i did this course.

FAT32 doesn't have compression, you're probably speaking of things like drivespace/doublespace/norton speeddisk/etc. Those do not work on file system level.


I just formatted a 128MB USB stick as NTFS and enabled compression. I wrote a 56MB file to it twice. So ther eis no space to decompress anything. When I double click either file it instantly opens, so it's not decompressing the whole file, just the stream of data. Also, it's not storing any of this to the stick. You could argue it's storing elsewhere, I doubt that. Test that yourself by using a single drive for the OS and filling it completely. I'm pretty sure the system won't crash because it can't read files.
 

Mussels

Freshwater Moderator
Staff member
Joined
Oct 6, 2004
Messages
58,413 (8.21/day)
Location
Oystralia
System Name Rainbow Sparkles (Power efficient, <350W gaming load)
Processor Ryzen R7 5800x3D (Undervolted, 4.45GHz all core)
Motherboard Asus x570-F (BIOS Modded)
Cooling Alphacool Apex UV - Alphacool Eisblock XPX Aurora + EK Quantum ARGB 3090 w/ active backplate
Memory 2x32GB DDR4 3600 Corsair Vengeance RGB @3866 C18-22-22-22-42 TRFC704 (1.4V Hynix MJR - SoC 1.15V)
Video Card(s) Galax RTX 3090 SG 24GB: Underclocked to 1700Mhz 0.750v (375W down to 250W))
Storage 2TB WD SN850 NVME + 1TB Sasmsung 970 Pro NVME + 1TB Intel 6000P NVME USB 3.2
Display(s) Phillips 32 32M1N5800A (4k144), LG 32" (4K60) | Gigabyte G32QC (2k165) | Phillips 328m6fjrmb (2K144)
Case Fractal Design R6
Audio Device(s) Logitech G560 | Corsair Void pro RGB |Blue Yeti mic
Power Supply Fractal Ion+ 2 860W (Platinum) (This thing is God-tier. Silent and TINY)
Mouse Logitech G Pro wireless + Steelseries Prisma XL
Keyboard Razer Huntsman TE ( Sexy white keycaps)
VR HMD Oculus Rift S + Quest 2
Software Windows 11 pro x64 (Yes, it's genuinely a good OS) OpenRGB - ditch the branded bloatware!
Benchmark Scores Nyooom.
good test dan, ah well.
my guess would be that if it WAS storing it somewhere, it would be on the C:\ drive in a temp folder - perhaps test with a large file, open it, and then see if your free space lowers?

i need to get proven wrong on something at least once a month, or my ego gets too big :p
 
Joined
May 20, 2004
Messages
10,487 (1.45/day)
good test dan, ah well.
my guess would be that if it WAS storing it somewhere, it would be on the C:\ drive in a temp folder - perhaps test with a large file, open it, and then see if your free space lowers?

i need to get proven wrong on something at least once a month, or my ego gets too big :p

It's file system level compression, why would it use Windows directories? I doubt the file system actually asks Windows where to store files.

I think it's best to compare to playing porn on your computer. You select the middle of the movie (the part where they lez it out), the system reads only that part of the movie and decompresses those frames on the fly. It does not decompress the whole movie on the disk before it can play anything, it does not require temporary files of any kind. It's instant access to compressed data without fancy requirements. And sure there probably is some small buffer in the memory, but I doubt it's large enough for you to notice it.
 

Mussels

Freshwater Moderator
Staff member
Joined
Oct 6, 2004
Messages
58,413 (8.21/day)
Location
Oystralia
System Name Rainbow Sparkles (Power efficient, <350W gaming load)
Processor Ryzen R7 5800x3D (Undervolted, 4.45GHz all core)
Motherboard Asus x570-F (BIOS Modded)
Cooling Alphacool Apex UV - Alphacool Eisblock XPX Aurora + EK Quantum ARGB 3090 w/ active backplate
Memory 2x32GB DDR4 3600 Corsair Vengeance RGB @3866 C18-22-22-22-42 TRFC704 (1.4V Hynix MJR - SoC 1.15V)
Video Card(s) Galax RTX 3090 SG 24GB: Underclocked to 1700Mhz 0.750v (375W down to 250W))
Storage 2TB WD SN850 NVME + 1TB Sasmsung 970 Pro NVME + 1TB Intel 6000P NVME USB 3.2
Display(s) Phillips 32 32M1N5800A (4k144), LG 32" (4K60) | Gigabyte G32QC (2k165) | Phillips 328m6fjrmb (2K144)
Case Fractal Design R6
Audio Device(s) Logitech G560 | Corsair Void pro RGB |Blue Yeti mic
Power Supply Fractal Ion+ 2 860W (Platinum) (This thing is God-tier. Silent and TINY)
Mouse Logitech G Pro wireless + Steelseries Prisma XL
Keyboard Razer Huntsman TE ( Sexy white keycaps)
VR HMD Oculus Rift S + Quest 2
Software Windows 11 pro x64 (Yes, it's genuinely a good OS) OpenRGB - ditch the branded bloatware!
Benchmark Scores Nyooom.
hahhaha, porn references. awesome.


(i'm not arguing with you on this, merely getting as much information as i can)
 
Top