ckolivas/lrzip
1
0
Fork 0
mirror of https://github.com/ckolivas/lrzip.git synced 2025-12-06 07:12:00 +01:00
Code Issues Actions Packages Projects Releases Wiki Activity
235 commits 5 branches 43 tags 2.8 MiB
Commit graph

86 commits

Author SHA1 Message Date
ckolivas c6199980f0 Disable file checking when not possible or meaningful. 2011-03-07 20:53:59 +11:00
Con Kolivas 10b1201f82 Fix more of the dodgy merge. 2011-03-07 17:28:50 +11:00
Con Kolivas 9fc551c159 Merge branch 'temp' 
Conflicts:
	main.c
 2011-03-07 17:25:10 +11:00
Con Kolivas 13a6fb5b43 Dump the temporary file generated to emulate stdout at the end of each chunk on decompression and then truncate the file instead of writing the whole file before dumping it. 2011-03-07 17:14:07 +11:00
Con Kolivas 8a4df9774f Forgot two instances of temporary outfiles that need to be unlinked. 2011-03-07 13:44:29 +11:00
Con Kolivas 68469c2b6f Don't dump output to stdout when testing. 2011-03-07 13:41:00 +11:00
Con Kolivas 06fd0a3528 Unlink files in safe places. 2011-03-07 13:40:43 +11:00
Con Kolivas f9046e6756 Check free space after reading magic, and not when decompressing to stdout. 2011-03-07 13:36:03 +11:00
Con Kolivas 8fa01248e7 Unlink temporary files immediately to avoid files lying around in cases of unexpected/uncaught failure. 2011-03-07 13:33:14 +11:00
Con Kolivas 38eca38743 Unify maxram allocation and limit threads when there isn't enough ram. 2011-03-07 13:23:14 +11:00
Con Kolivas e42916e51f Revert "Make sure to realloc filenames when making physical temp files to not have memory leaks." 
This reverts commit 9c3d492524.

Oops, dirty commit.
 2011-03-07 13:08:40 +11:00
Con Kolivas 8a4814081b Must read magic before testing free space. 
Resolve conflict.
 2011-03-07 13:06:30 +11:00
ckolivas d1dc3dd6b1 Don't bother zeroing variables that are already zeroed by memset. 2011-03-07 13:04:01 +11:00
Con Kolivas 9c3d492524 Make sure to realloc filenames when making physical temp files to not have memory leaks. 
Fix conflict in merge.
 2011-03-07 13:02:17 +11:00
ckolivas 81500282cc Move verbose summary till after we know if we have STDIN and STDOUT to more accurately reflect the window chosen. 2011-03-07 12:57:53 +11:00
Con Kolivas 96efe033fd Ignore what stdout is going to when testing from stdin. 2011-03-07 12:56:10 +11:00
Con Kolivas 624de254ce Revert "Fallocate space in advance on decompression." 
This reverts commit cf03cb0c04.

Fallocating for some reason fails to write the end of the file! Revert change pending further investigation.
 2011-02-28 22:13:36 +11:00
Con Kolivas 9e548448d6 Checked for the wrong standard. 2011-02-28 21:18:53 +11:00
Con Kolivas cf03cb0c04 Fallocate space in advance on decompression. 
This often can speed up decompression of large files and decreases fragmentation.
 2011-02-26 23:26:00 +11:00
Con Kolivas fd5a77ac21 Check on the fd_out on decompression, NOT on fd_in. 2011-02-26 23:19:50 +11:00
Con Kolivas 8bdd5688c8 Check for free space before compression/decompression and abort if -f option is not enabled. 2011-02-26 23:10:28 +11:00
ckolivas 9b60d6e703 Update manpage to new, cleaner help format. 2011-02-25 10:55:27 +11:00
ckolivas 3a818196cc Perform sanity testing on file information output which detects corrupted archives. 2011-02-25 09:31:35 +11:00
Con Kolivas 573aa534ac Display the offset of each block in verbose information as well. 2011-02-25 09:21:30 +11:00
Con Kolivas d90f670fbd The output from information is confusing on 32 bit when it cuts the available ram for internal use. 
Display the actual amount of ram detected, and then decrease the value for calculating what the calculated window will be.
Move the variables to where they're only used locally.
 2011-02-23 23:58:50 +11:00
Con Kolivas 48e7e31dad Make sure to not delete files that already exist and we've refused to overwrite! 2011-02-23 15:01:43 +11:00
Con Kolivas 9fef6ab803 Add verbose and max verbose modes for -i information. 
This will give a breakdown of each rzip chunk and compressed block by jumping to each head offset and reading the header information.
 2011-02-23 12:59:59 +11:00
Con Kolivas 8edc4bd052 Trivial 2011-02-23 01:29:17 +11:00
Con Kolivas 32ff6edf9a Only set the main process nice value to less when a back-end compression is enabled. 2011-02-23 01:26:51 +11:00
Con Kolivas e79127ace8 Trivial changes. 2011-02-23 01:22:54 +11:00
Con Kolivas 94673d3fe3 Change the LZO testing option to be a bool on/off instead of taking a confusing parameter. 
Make the lzo testing message simpler and only appear when max verbose mode is enabled.
 2011-02-23 01:15:18 +11:00
Con Kolivas 9c8b1ee795 Deprecate the -M option as it is no longer of any significant utility compared to the -U option. 2011-02-22 20:38:39 +11:00
Con Kolivas 011344753a With lzma and zpaq, the compression overhead per thread is significant. 
As we can work out what that compression overhead is, we can factor that into testing how much ram we can allocate.
There is no advantage to running multiple threads when there is no compression back end so drop to 1 only.
Limit ram for compression back end to 1/3 ram regardless for when OSs lie due to heavy overcommit.
 2011-02-22 15:19:31 +11:00
Con Kolivas 88e3df6af1 Print perror before unlinking files. 
Join common parts of fatal errors.
Update copyright notices.
Small improvement to visual output.
 2011-02-21 16:11:59 +11:00
Con Kolivas a7b4708bd2 Use a different failure mode for when perror is unlikely to be set. 
Add 2 unlikely wrappers.
 2011-02-21 14:51:20 +11:00
Con Kolivas 5c80a0957d Add usage() to failure to read stdin/out. 2011-02-21 13:29:45 +11:00
Con Kolivas b06287cce5 Make it not read stdin from a terminal or write stdout to a terminal unless forced with -f. 2011-02-21 13:26:51 +11:00
Con Kolivas 29dfb16c7a Clean up the messy help output. 2011-02-21 12:49:44 +11:00
Con Kolivas a85b17a463 Minor help change. 2011-02-21 12:06:49 +11:00
Con Kolivas 74df2b5973 Minor updates to man pages, lrzip.conf example file. 
Update main help screen to include environment settings.
Update to respect $TMP environment variable for TMP files.
Updated control structure to include tmpdir pointer.
Update lrzip.conf parser to respect -U -M options.
Update lrzip.conf example to include new parameters.
Reorder main Switch loop in main.c for readability.
Have MAXRAM and control.window be exclusive. MAXRAM wins.
Have UNLIMITED and control.window be exclusive. UNLIMITED wins.
Have UNLIMITED and MAXRAM be exclusive. UNLIMITED wins.
Corrects heuristic computation in rzip.c which would override
MAXRAM or UNLIMITED if control.window set
Show heuristically computed control.window when computed.
Remove display compression level from control.window verbose output.
Update print_verbose format for Testing for incompressible data in stream.c
to omit extra \n.

Changes by Peter Hyman <pete@peterhyman.com>
 2011-02-21 12:03:08 +11:00
Con Kolivas d4fb4d025b Update manpage. 2011-02-20 23:22:45 +11:00
Con Kolivas 57e25da244 Update copyright yeah in updated files. 2011-02-20 23:04:44 +11:00
Con Kolivas c9863e0e60 Change default behaviour to deleting broken or damaged files that occur by interrupting lrzip or that fail integrity testing. 
Implement the -k option to optionally keep broken or damaged files.
 2011-02-20 23:02:15 +11:00
Con Kolivas 9b264959f5 Implement the ability to test the integrity of the file written to disk on decompression. 2011-02-20 22:29:49 +11:00
Con Kolivas 8a27dc5057 Changes to make md5 be used for integrity testing. 
Add the md5 value to the end of each archive.
This can then be used for integrity testing instead of crc32.
Keep crc in new archives to maintain compatibility with version 0.5 files.
Use md5 integrity testing on decompression when available in preference, and disable calculation of crc32.
Display the choice of integrity testing in verbose output and when -i is used.
Display the md5 and crc values when max verbosity, file info, or display hash is enabled.
Store a new flag in the magic header to show that the md5 value is stored at the end of the file.
Update the magic header information document.
 2011-02-20 18:01:19 +11:00
Con Kolivas 44a279579e Add option to display hash information without enabling verbose mode. 2011-02-20 12:20:05 +11:00
Con Kolivas c2417877bc Being implementing md5 hash checking by importing the md5 code from coreutils. 
Implement md5 hash checking on compression by doing the md5 hash check as each sb low buffer has been allocated to avoid going over the file again where possible.
 2011-02-18 09:09:40 +11:00
Con Kolivas 9c2b86fec6 We are flushing the wrong file on decompression. Make sure we flush the file out. 2011-02-08 08:27:22 +11:00
Con Kolivas 2cabb335cb Update copyright notices courtesy of Jari Aalto. 2010-12-16 09:45:21 +11:00
Con Kolivas db95eba695 Take into account VM split on 32 bits again. 2010-12-03 19:30:27 +11:00