• Welcome to TechPowerUp Forums, Guest! Please check out our forum guidelines for info related to our community.

Create solid file without corrupt files

Status
Not open for further replies.
Joined
Mar 15, 2023
Messages
184 (0.24/day)
I have 120 to 150gb of zip, rar, 7zip, exe and other files and folders and I would like to create a single solid archive without corrupting any files, what do you recommend?
 
Joined
Jul 25, 2006
Messages
13,952 (2.04/day)
Location
Nebraska, USA
System Name Brightworks Systems BWS-6 E-IV
Processor Intel Core i5-6600 @ 3.9GHz
Motherboard Gigabyte GA-Z170-HD3 Rev 1.0
Cooling Quality Fractal Design Define R4 case, 2 x FD 140mm fans, CM Hyper 212 EVO HSF
Memory 32GB (4 x 8GB) DDR4 3000 Corsair Vengeance
Video Card(s) EVGA GEForce GTX 1050Ti 4Gb GDDR5
Storage Samsung 850 Pro 256GB SSD, Samsung 860 Evo 500GB SSD
Display(s) Samsung S24E650BW LED x 2
Case Fractal Design Define R4
Power Supply EVGA Supernova 550W G2 Gold
Mouse Logitech M190
Keyboard Microsoft Wireless Comfort 5050
Software W10 Pro 64-bit
I like 7-Zip too but no compression program can absolutely ensure corruption will not occur during the compression or decompression process. Therefore, ALWAYS have multiple backup copies, preferably with at least one stored "off-site".

Also, if any of these are critical files you must not lose, make your file, then unzip it and make sure no corruption occurs BEFORE you delete your original source files.

Last, if you are doing this to save space, don't count on saving much, if any at all. Zip, rar, and 7zip files are already compressed. In fact, the end result can end up with the single file taking up more space than the total space used by the individual files. This is because compression programs add overhead information to the compressed file so it knows how to decompress and separate the individual files during the unzipping process.

And if your .exe and other files are from recent programs, developers these days are pretty good at getting rid of most of the "air" in files. This is because most programs these days are downloaded. Smaller means faster download times and less bandwidth for transfers and storage.
 
Joined
Jul 30, 2019
Messages
3,721 (1.77/day)
System Name Still not a thread ripper but pretty good.
Processor Ryzen 9 7950x, Thermal Grizzly AM5 Offset Mounting Kit, Thermal Grizzly Extreme Paste
Motherboard ASRock B650 LiveMixer (BIOS/UEFI version P3.08, AGESA 1.2.0.2)
Cooling EK-Quantum Velocity, EK-Quantum Reflection PC-O11, D5 PWM, EK-CoolStream PE 360, XSPC TX360
Memory Micron DDR5-5600 ECC Unbuffered Memory (2 sticks, 64GB, MTC20C2085S1EC56BD1) + JONSBO NF-1
Video Card(s) XFX Radeon RX 5700 & EK-Quantum Vector Radeon RX 5700 +XT & Backplate
Storage Samsung 4TB 980 PRO, 2 x Optane 905p 1.5TB (striped), AMD Radeon RAMDisk
Display(s) 2 x 4K LG 27UL600-W (and HUANUO Dual Monitor Mount)
Case Lian Li PC-O11 Dynamic Black (original model)
Audio Device(s) Corsair Commander Pro for Fans, RGB, & Temp Sensors (x4)
Power Supply Corsair RM750x
Mouse Logitech M575
Keyboard Corsair Strafe RGB MK.2
Software Windows 10 Professional (64bit)
Benchmark Scores RIP Ryzen 9 5950x, ASRock X570 Taichi (v1.06), 128GB Micron DDR4-3200 ECC UDIMM (18ASF4G72AZ-3G2F1)
I have 120 to 150gb of zip, rar, 7zip, exe and other files and folders and I would like to create a single solid archive without corrupting any files, what do you recommend?
You can use 7zip in store-only mode so it won't try and recompress your already compressed files. Essentially it becomes a large single file storage container unless you also choose to split it. In any case if you encounter bit-rot (or corruption) in your huge file (assuming long term storage) the recovery of your 150GB file may be uncertain so you want to make sure to have sufficient backup copies. It's also a good idea to test your archive after you create it just to be sure it's okay before you put it away and periodically after you put it away because storage can fail over time.

Also 7zip has a test archive option to check for errors.
 
Last edited:
Joined
Jan 10, 2011
Messages
1,621 (0.31/day)
Location
[Formerly] Khartoum, Sudan.
System Name 192.168.1.1~192.168.1.100
Processor AMD Ryzen5 5600G.
Motherboard Gigabyte B550m DS3H.
Cooling AMD Wraith Stealth.
Memory 16GB Crucial DDR4.
Video Card(s) Gigabyte GTX 1080 OC (Underclocked, underpowered).
Storage Samsung 980 NVME 500GB && Assortment of SSDs.
Display(s) ViewSonic VA2406-MH 75Hz
Case Bitfenix Nova Midi
Audio Device(s) On-Board.
Power Supply SeaSonic CORE GM-650.
Mouse Logitech G300s
Keyboard Kingston HyperX Alloy FPS.
VR HMD A pair of OP spectacles.
Software Ubuntu 24.04 LTS.
Benchmark Scores Me no know English. What bench mean? Bench like one sit on?
If you don't mind sharing this info, Why do you want to do that?
 
Joined
Mar 15, 2023
Messages
184 (0.24/day)
I don't want to split the file just create an archive but I don't know which format 7zip, rar or zip and I don't intend to compress anything just compress and at the end of the compression test within winrar if there was no corruption
 
Joined
Jul 25, 2006
Messages
13,952 (2.04/day)
Location
Nebraska, USA
System Name Brightworks Systems BWS-6 E-IV
Processor Intel Core i5-6600 @ 3.9GHz
Motherboard Gigabyte GA-Z170-HD3 Rev 1.0
Cooling Quality Fractal Design Define R4 case, 2 x FD 140mm fans, CM Hyper 212 EVO HSF
Memory 32GB (4 x 8GB) DDR4 3000 Corsair Vengeance
Video Card(s) EVGA GEForce GTX 1050Ti 4Gb GDDR5
Storage Samsung 850 Pro 256GB SSD, Samsung 860 Evo 500GB SSD
Display(s) Samsung S24E650BW LED x 2
Case Fractal Design Define R4
Power Supply EVGA Supernova 550W G2 Gold
Mouse Logitech M190
Keyboard Microsoft Wireless Comfort 5050
Software W10 Pro 64-bit
I personally feel that the .zip format is more universal and compatible with more compression programs. So I would use that.

But like Shihab, I am curious as to your intent. To me, zipping all your files into one is like putting all your eggs into one basket. A risky move.
 
Joined
Mar 15, 2023
Messages
184 (0.24/day)
putting in a file allows me 1 corruption test for all files

Inside Winrar, what is the best configuration to perform good compression?
 
Joined
Aug 15, 2016
Messages
486 (0.15/day)
Processor Intel i7 4770k
Motherboard ASUS Sabertooth Z87
Cooling BeQuiet! Shadow Rock 3
Memory Patriot Viper 3 RedD 16 GB @ 1866 MHz
Video Card(s) XFX RX 480 GTR 8GB
Storage 1x SSD Samsung EVO 250 GB 1x HDD Seagate Barracuda 3 TB 1x HDD Seagate Barracuda 4 TB
Display(s) AOC Q27G2U QHD, Dell S2415H FHD
Case Cooler Master HAF XM
Audio Device(s) Magnat LZR 980, Razer BlackShark V2, Altec Lansing 251
Power Supply Corsair AX860
Mouse Razer DeathAdder V2
Keyboard Razer Huntsman Tournament Edition
Software Windows 10 Pro x64
If your intent is to check for corruption of files, there's no need to archive all the files together. You can use something like this: https://code.kliu.org/hashcheck/

I've been using it for years. Just select all files and/or folders, right click and create a hashsum with the prefered type. Just run the created checksum to check for corruption.

Answering to your compression question: it really depends on the type of files you are trying to compress. Some of those files (like game files archives) tend to be compressed originally. You can't do all that much, unless you're looking for some "heavy duty" applications, like combinations of FreeArc, srep, Precomp, etc. Note that the decompression speed, will be very much slower. There's no point in compressing a video file using WinRAR with heavier compression algorithm, you're decreasing the decompression time considerably, while getting maybe 1% smaller file size. Just store such files in archive without any compression (store only).
 
Last edited:
Joined
Apr 12, 2013
Messages
7,832 (1.78/day)
Inside Winrar, what is the best configuration to perform good compression?
Archive format - RAR, Compression method - best, Dictionary size - 1GB, also check create solid archive+add recovery record. Use at least 5% for recovery.
 

izy

Joined
Jun 30, 2022
Messages
1,076 (1.04/day)
I used 7-zip to archive all the files (including windows system files) from some old HDDs after ive upgraded to SSDs (from some older work laptops), i didnt want to keep them as a folder as its slower to move them after and i never had a problem accessing any of the files so far, no corrupted files but you never know.
 
Joined
Oct 4, 2023
Messages
88 (0.15/day)
I can sorta understand your reasoning of having a single file to check for corruption
Like R0H1T said winrar supports a feature called recovery record which can recover the archive from some corruption
Another format that could be of interest to you is microsoft WIM format, as that supports single-instance storage/deduplication meaning only one of the same hash/file is stored and all other copies are referenced and thus saving space when having multiple copies of files with exact same data
 
Joined
Mar 15, 2023
Messages
184 (0.24/day)
Archive format - RAR, Compression method - best, Dictionary size - 1GB, also check create solid archive+add recovery record. Use at least 5% for recovery.
Is this the best compression method to protect from corruption? Is zip more compatible than rar?
 
Joined
Jul 25, 2006
Messages
13,952 (2.04/day)
Location
Nebraska, USA
System Name Brightworks Systems BWS-6 E-IV
Processor Intel Core i5-6600 @ 3.9GHz
Motherboard Gigabyte GA-Z170-HD3 Rev 1.0
Cooling Quality Fractal Design Define R4 case, 2 x FD 140mm fans, CM Hyper 212 EVO HSF
Memory 32GB (4 x 8GB) DDR4 3000 Corsair Vengeance
Video Card(s) EVGA GEForce GTX 1050Ti 4Gb GDDR5
Storage Samsung 850 Pro 256GB SSD, Samsung 860 Evo 500GB SSD
Display(s) Samsung S24E650BW LED x 2
Case Fractal Design Define R4
Power Supply EVGA Supernova 550W G2 Gold
Mouse Logitech M190
Keyboard Microsoft Wireless Comfort 5050
Software W10 Pro 64-bit
I cannot answer that but I just want to make sure that NOTHING will ensure corruption will never happen. Even if the compression process is a total success, a file can become corrupt at just about any time from other causes. So again, multiple copies, preferably with at least one off-site.
 
Joined
Mar 15, 2023
Messages
184 (0.24/day)
Any differences in corruption protection between 7zip, rar and zip formats?
programs any differences 7zip or winrar?
 
Joined
Oct 4, 2023
Messages
88 (0.15/day)
Archiving by itself won't protect against corruption in fact it will introduce more risk to lose data from corruption especially with solid archives
Zip, 7zip, winrar will be very similiar in that regard, just that winrar has support for including a recovery record that has a chance to recover data to a degree even if archive has become corrupted, see here: https://www.liamfoot.com/analysing-the-effectiveness-of-winrar-s-rar5-recovery-records

The only way to properly backup data is to have multiply copies on multiple storage mediums
 
Joined
Mar 15, 2023
Messages
184 (0.24/day)
So the problem would be in the storage media and not in the corruption format or software used?

Yes, I will use several media to store but I want the correct recommendation which format I choose and which program I use and which compression settings I choose

I'm confused
 
Joined
Oct 4, 2023
Messages
88 (0.15/day)
Just use winrar if you like it and add recovery record that should make it a little more resilient against corruption, but not really needed if you do multiple copies anyway
 
Joined
Jul 30, 2019
Messages
3,721 (1.77/day)
System Name Still not a thread ripper but pretty good.
Processor Ryzen 9 7950x, Thermal Grizzly AM5 Offset Mounting Kit, Thermal Grizzly Extreme Paste
Motherboard ASRock B650 LiveMixer (BIOS/UEFI version P3.08, AGESA 1.2.0.2)
Cooling EK-Quantum Velocity, EK-Quantum Reflection PC-O11, D5 PWM, EK-CoolStream PE 360, XSPC TX360
Memory Micron DDR5-5600 ECC Unbuffered Memory (2 sticks, 64GB, MTC20C2085S1EC56BD1) + JONSBO NF-1
Video Card(s) XFX Radeon RX 5700 & EK-Quantum Vector Radeon RX 5700 +XT & Backplate
Storage Samsung 4TB 980 PRO, 2 x Optane 905p 1.5TB (striped), AMD Radeon RAMDisk
Display(s) 2 x 4K LG 27UL600-W (and HUANUO Dual Monitor Mount)
Case Lian Li PC-O11 Dynamic Black (original model)
Audio Device(s) Corsair Commander Pro for Fans, RGB, & Temp Sensors (x4)
Power Supply Corsair RM750x
Mouse Logitech M575
Keyboard Corsair Strafe RGB MK.2
Software Windows 10 Professional (64bit)
Benchmark Scores RIP Ryzen 9 5950x, ASRock X570 Taichi (v1.06), 128GB Micron DDR4-3200 ECC UDIMM (18ASF4G72AZ-3G2F1)
So the problem would be in the storage media and not in the corruption format or software used?

Yes, I will use several media to store but I want the correct recommendation which format I choose and which program I use and which compression settings I choose

I'm confused
Corruption can come from hardware, software, or the medium you store your data. All you can do is use good hardware, software, and a quality medium in conjunction with having multiple backups where you can verify the integrity in case you have to pull from them.
 
Joined
Mar 15, 2023
Messages
184 (0.24/day)
which hardware is good?

In winrar this recovery record option where is it located? I used this option but it is only this option to select to create a good single file

rar or zip or 7zip? whar choose?
 
Joined
Jul 30, 2019
Messages
3,721 (1.77/day)
System Name Still not a thread ripper but pretty good.
Processor Ryzen 9 7950x, Thermal Grizzly AM5 Offset Mounting Kit, Thermal Grizzly Extreme Paste
Motherboard ASRock B650 LiveMixer (BIOS/UEFI version P3.08, AGESA 1.2.0.2)
Cooling EK-Quantum Velocity, EK-Quantum Reflection PC-O11, D5 PWM, EK-CoolStream PE 360, XSPC TX360
Memory Micron DDR5-5600 ECC Unbuffered Memory (2 sticks, 64GB, MTC20C2085S1EC56BD1) + JONSBO NF-1
Video Card(s) XFX Radeon RX 5700 & EK-Quantum Vector Radeon RX 5700 +XT & Backplate
Storage Samsung 4TB 980 PRO, 2 x Optane 905p 1.5TB (striped), AMD Radeon RAMDisk
Display(s) 2 x 4K LG 27UL600-W (and HUANUO Dual Monitor Mount)
Case Lian Li PC-O11 Dynamic Black (original model)
Audio Device(s) Corsair Commander Pro for Fans, RGB, & Temp Sensors (x4)
Power Supply Corsair RM750x
Mouse Logitech M575
Keyboard Corsair Strafe RGB MK.2
Software Windows 10 Professional (64bit)
Benchmark Scores RIP Ryzen 9 5950x, ASRock X570 Taichi (v1.06), 128GB Micron DDR4-3200 ECC UDIMM (18ASF4G72AZ-3G2F1)
which hardware is good?

In winrar this recovery record option where is it located? I used this option but it is only this option to select to create a good single file

rar or zip or 7zip? whar choose?
I think you are overthinking things. Let's start back at your original post. "I would like to create a single solid archive" ( obviously you want that to be reliable - not corrupted )

Assuming your computer is functioning properly RAR, 7zip, and Zip probably all fit that bill. Personally I think RAR and 7zip are the better choices because one issue you have to deal with is that you probably don't want to compress files in your archive that are already compressed. RAR and 7zip are likely to have options to deal with that.

I would start by trying both and deciding which one you prefer to use and are most comfortable with using. Try them a make a choice.
Once you know how to create an archive to your satisfaction you want to address how you are going to test it. One way is to simply unzip it somewhere.

So make an archive somewhere that you have space and unzip the archive somewhere where you have 150GB of free space. Simple.
Once you have done that take a step back and think if that achieves your objectives to your satisfaction.

150GB is a lot of data to move around and lose (especially as a large single file) so finally you need to decide how you are going to backup your archive. This takes awhile on USB3 and even longer on 1Gb NIC.
 
Joined
Mar 15, 2023
Messages
184 (0.24/day)
If rar and 7zip are better than zip, which is more compatible in the long run?

After choosing the format, what is the next procedure? correct compression settings within winrar I don't know
 
Joined
Jul 30, 2019
Messages
3,721 (1.77/day)
System Name Still not a thread ripper but pretty good.
Processor Ryzen 9 7950x, Thermal Grizzly AM5 Offset Mounting Kit, Thermal Grizzly Extreme Paste
Motherboard ASRock B650 LiveMixer (BIOS/UEFI version P3.08, AGESA 1.2.0.2)
Cooling EK-Quantum Velocity, EK-Quantum Reflection PC-O11, D5 PWM, EK-CoolStream PE 360, XSPC TX360
Memory Micron DDR5-5600 ECC Unbuffered Memory (2 sticks, 64GB, MTC20C2085S1EC56BD1) + JONSBO NF-1
Video Card(s) XFX Radeon RX 5700 & EK-Quantum Vector Radeon RX 5700 +XT & Backplate
Storage Samsung 4TB 980 PRO, 2 x Optane 905p 1.5TB (striped), AMD Radeon RAMDisk
Display(s) 2 x 4K LG 27UL600-W (and HUANUO Dual Monitor Mount)
Case Lian Li PC-O11 Dynamic Black (original model)
Audio Device(s) Corsair Commander Pro for Fans, RGB, & Temp Sensors (x4)
Power Supply Corsair RM750x
Mouse Logitech M575
Keyboard Corsair Strafe RGB MK.2
Software Windows 10 Professional (64bit)
Benchmark Scores RIP Ryzen 9 5950x, ASRock X570 Taichi (v1.06), 128GB Micron DDR4-3200 ECC UDIMM (18ASF4G72AZ-3G2F1)
If rar and 7zip are better than zip, which is more compatible in the long run?

After choosing the format, what is the next procedure? correct compression settings within winrar I don't know
This is always a gamble as nothing lasts forever. 7zip is free and open source so that is the one I use the most and trust to have a long lifetime at least long enough to convert to something else in the future if needed. RAR might be better in some ways I don't have much experience with it but it's also been around a long time.

Is everything you want to archive contained in a single root folder? Then lookup instructions how to simply create an archive. You can always fine tune it later after you are comfortable how to get past this step. Don't be afraid of trial and error learning how to create the archive properly. Do it as many times as necessary till you feel you understand and have a hold of what you are doing.

For simple stuff 7zip has simple right-click menu in windows exploder
1698699107287.png
1698699232432.png
 
Last edited:
Joined
Mar 15, 2023
Messages
184 (0.24/day)
I never compressed in 7z, what settings should I change to have good compression without corrupting?

I was in doubt between winrar and 7zip and the rar or 7zip format
 
Joined
Dec 26, 2006
Messages
4,146 (0.62/day)
Location
Northern Ontario Canada
Processor Ryzen 5700x
Motherboard Gigabyte X570S Aero G R1.1 BiosF5g
Cooling Noctua NH-C12P SE14 w/ NF-A15 HS-PWM Fan 1500rpm
Memory Micron DDR4-3200 2x32GB D.S. D.R. (CT2K32G4DFD832A)
Video Card(s) AMD RX 6800 - Asus Tuf
Storage Kingston KC3000 1TB & 2TB & 4TB Corsair MP600 Pro LPX
Display(s) LG 27UL550-W (27" 4k)
Case Be Quiet Pure Base 600 (no window)
Audio Device(s) Realtek ALC1220-VB
Power Supply SuperFlower Leadex V Gold Pro 850W ATX Ver2.52
Mouse Mionix Naos Pro
Keyboard Corsair Strafe with browns
Software W10 22H2 Pro x64
I have 120 to 150gb of zip, rar, 7zip, exe and other files and folders and I would like to create a single solid archive without corrupting any files, what do you recommend?
I would recommend leaving everything unzipped and individual and getting more storage..................if its affodable or an option?

And if you do compress, maybe get a good checksum/hash on it/for it?
 
Last edited:
Status
Not open for further replies.
Top