• Welcome to TechPowerUp Forums, Guest! Please check out our forum guidelines for info related to our community.
  • The forums have been upgraded with support for dark mode. By default it will follow the setting on your system/browser. You may override it by scrolling to the end of the page and clicking the gears icon.

Create solid file without corrupt files

Status
Not open for further replies.
Joined
Mar 15, 2023
Messages
184 (0.23/day)
I have 120 to 150gb of zip, rar, 7zip, exe and other files and folders and I would like to create a single solid archive without corrupting any files, what do you recommend?
 
I like 7-Zip too but no compression program can absolutely ensure corruption will not occur during the compression or decompression process. Therefore, ALWAYS have multiple backup copies, preferably with at least one stored "off-site".

Also, if any of these are critical files you must not lose, make your file, then unzip it and make sure no corruption occurs BEFORE you delete your original source files.

Last, if you are doing this to save space, don't count on saving much, if any at all. Zip, rar, and 7zip files are already compressed. In fact, the end result can end up with the single file taking up more space than the total space used by the individual files. This is because compression programs add overhead information to the compressed file so it knows how to decompress and separate the individual files during the unzipping process.

And if your .exe and other files are from recent programs, developers these days are pretty good at getting rid of most of the "air" in files. This is because most programs these days are downloaded. Smaller means faster download times and less bandwidth for transfers and storage.
 
I have 120 to 150gb of zip, rar, 7zip, exe and other files and folders and I would like to create a single solid archive without corrupting any files, what do you recommend?
You can use 7zip in store-only mode so it won't try and recompress your already compressed files. Essentially it becomes a large single file storage container unless you also choose to split it. In any case if you encounter bit-rot (or corruption) in your huge file (assuming long term storage) the recovery of your 150GB file may be uncertain so you want to make sure to have sufficient backup copies. It's also a good idea to test your archive after you create it just to be sure it's okay before you put it away and periodically after you put it away because storage can fail over time.

Also 7zip has a test archive option to check for errors.
 
Last edited:
If you don't mind sharing this info, Why do you want to do that?
 
I don't want to split the file just create an archive but I don't know which format 7zip, rar or zip and I don't intend to compress anything just compress and at the end of the compression test within winrar if there was no corruption
 
I personally feel that the .zip format is more universal and compatible with more compression programs. So I would use that.

But like Shihab, I am curious as to your intent. To me, zipping all your files into one is like putting all your eggs into one basket. A risky move.
 
putting in a file allows me 1 corruption test for all files

Inside Winrar, what is the best configuration to perform good compression?
 
If your intent is to check for corruption of files, there's no need to archive all the files together. You can use something like this: https://code.kliu.org/hashcheck/

I've been using it for years. Just select all files and/or folders, right click and create a hashsum with the prefered type. Just run the created checksum to check for corruption.

Answering to your compression question: it really depends on the type of files you are trying to compress. Some of those files (like game files archives) tend to be compressed originally. You can't do all that much, unless you're looking for some "heavy duty" applications, like combinations of FreeArc, srep, Precomp, etc. Note that the decompression speed, will be very much slower. There's no point in compressing a video file using WinRAR with heavier compression algorithm, you're decreasing the decompression time considerably, while getting maybe 1% smaller file size. Just store such files in archive without any compression (store only).
 
Last edited:
Inside Winrar, what is the best configuration to perform good compression?
Archive format - RAR, Compression method - best, Dictionary size - 1GB, also check create solid archive+add recovery record. Use at least 5% for recovery.
 
I used 7-zip to archive all the files (including windows system files) from some old HDDs after ive upgraded to SSDs (from some older work laptops), i didnt want to keep them as a folder as its slower to move them after and i never had a problem accessing any of the files so far, no corrupted files but you never know.
 
I can sorta understand your reasoning of having a single file to check for corruption
Like R0H1T said winrar supports a feature called recovery record which can recover the archive from some corruption
Another format that could be of interest to you is microsoft WIM format, as that supports single-instance storage/deduplication meaning only one of the same hash/file is stored and all other copies are referenced and thus saving space when having multiple copies of files with exact same data
 
Archive format - RAR, Compression method - best, Dictionary size - 1GB, also check create solid archive+add recovery record. Use at least 5% for recovery.
Is this the best compression method to protect from corruption? Is zip more compatible than rar?
 
I cannot answer that but I just want to make sure that NOTHING will ensure corruption will never happen. Even if the compression process is a total success, a file can become corrupt at just about any time from other causes. So again, multiple copies, preferably with at least one off-site.
 
Any differences in corruption protection between 7zip, rar and zip formats?
programs any differences 7zip or winrar?
 
Archiving by itself won't protect against corruption in fact it will introduce more risk to lose data from corruption especially with solid archives
Zip, 7zip, winrar will be very similiar in that regard, just that winrar has support for including a recovery record that has a chance to recover data to a degree even if archive has become corrupted, see here: https://www.liamfoot.com/analysing-the-effectiveness-of-winrar-s-rar5-recovery-records

The only way to properly backup data is to have multiply copies on multiple storage mediums
 
So the problem would be in the storage media and not in the corruption format or software used?

Yes, I will use several media to store but I want the correct recommendation which format I choose and which program I use and which compression settings I choose

I'm confused
 
Just use winrar if you like it and add recovery record that should make it a little more resilient against corruption, but not really needed if you do multiple copies anyway
 
So the problem would be in the storage media and not in the corruption format or software used?

Yes, I will use several media to store but I want the correct recommendation which format I choose and which program I use and which compression settings I choose

I'm confused
Corruption can come from hardware, software, or the medium you store your data. All you can do is use good hardware, software, and a quality medium in conjunction with having multiple backups where you can verify the integrity in case you have to pull from them.
 
which hardware is good?

In winrar this recovery record option where is it located? I used this option but it is only this option to select to create a good single file

rar or zip or 7zip? whar choose?
 
which hardware is good?

In winrar this recovery record option where is it located? I used this option but it is only this option to select to create a good single file

rar or zip or 7zip? whar choose?
I think you are overthinking things. Let's start back at your original post. "I would like to create a single solid archive" ( obviously you want that to be reliable - not corrupted )

Assuming your computer is functioning properly RAR, 7zip, and Zip probably all fit that bill. Personally I think RAR and 7zip are the better choices because one issue you have to deal with is that you probably don't want to compress files in your archive that are already compressed. RAR and 7zip are likely to have options to deal with that.

I would start by trying both and deciding which one you prefer to use and are most comfortable with using. Try them a make a choice.
Once you know how to create an archive to your satisfaction you want to address how you are going to test it. One way is to simply unzip it somewhere.

So make an archive somewhere that you have space and unzip the archive somewhere where you have 150GB of free space. Simple.
Once you have done that take a step back and think if that achieves your objectives to your satisfaction.

150GB is a lot of data to move around and lose (especially as a large single file) so finally you need to decide how you are going to backup your archive. This takes awhile on USB3 and even longer on 1Gb NIC.
 
If rar and 7zip are better than zip, which is more compatible in the long run?

After choosing the format, what is the next procedure? correct compression settings within winrar I don't know
 
If rar and 7zip are better than zip, which is more compatible in the long run?

After choosing the format, what is the next procedure? correct compression settings within winrar I don't know
This is always a gamble as nothing lasts forever. 7zip is free and open source so that is the one I use the most and trust to have a long lifetime at least long enough to convert to something else in the future if needed. RAR might be better in some ways I don't have much experience with it but it's also been around a long time.

Is everything you want to archive contained in a single root folder? Then lookup instructions how to simply create an archive. You can always fine tune it later after you are comfortable how to get past this step. Don't be afraid of trial and error learning how to create the archive properly. Do it as many times as necessary till you feel you understand and have a hold of what you are doing.

For simple stuff 7zip has simple right-click menu in windows exploder
1698699107287.png
1698699232432.png
 
Last edited:
I never compressed in 7z, what settings should I change to have good compression without corrupting?

I was in doubt between winrar and 7zip and the rar or 7zip format
 
I have 120 to 150gb of zip, rar, 7zip, exe and other files and folders and I would like to create a single solid archive without corrupting any files, what do you recommend?
I would recommend leaving everything unzipped and individual and getting more storage..................if its affodable or an option?

And if you do compress, maybe get a good checksum/hash on it/for it?
 
Last edited:
Status
Not open for further replies.
Back
Top