ckolivas/lrzip
1
0
Fork 0
mirror of https://github.com/ckolivas/lrzip.git synced 2026-04-06 23:04:04 +00:00
Code Issues Projects Releases Packages Wiki Activity
222 commits 5 branches 44 tags 3.3 MiB
Commit graph

222 commits

This branch
This branch
All branches
Author SHA1 Message Date
Con Kolivas
e42916e51f Revert "Make sure to realloc filenames when making physical temp files to not have memory leaks." 
This reverts commit 9c3d492524.

Oops, dirty commit.
 2011-03-07 13:08:40 +11:00
Con Kolivas
8a4814081b Must read magic before testing free space. 
Resolve conflict.
 2011-03-07 13:06:30 +11:00
ckolivas
d1dc3dd6b1 Don't bother zeroing variables that are already zeroed by memset. 2011-03-07 13:04:01 +11:00
Con Kolivas
a4ac1b8221 Display the progress percentage and ETA when it's known on STDIN compress. 2011-03-07 13:03:43 +11:00
Con Kolivas
9c3d492524 Make sure to realloc filenames when making physical temp files to not have memory leaks. 
Fix conflict in merge.
 2011-03-07 13:02:17 +11:00
ckolivas
23f82e924d Update gitignore. 2011-03-07 12:59:57 +11:00
ckolivas
81500282cc Move verbose summary till after we know if we have STDIN and STDOUT to more accurately reflect the window chosen. 2011-03-07 12:57:53 +11:00
Con Kolivas
96efe033fd Ignore what stdout is going to when testing from stdin. 2011-03-07 12:56:10 +11:00
Con Kolivas
556803752b Fix windows EOL to unix on lzma.txt. 2011-03-07 12:52:12 +11:00
Con Kolivas
624de254ce Revert "Fallocate space in advance on decompression." 
This reverts commit cf03cb0c04.

Fallocating for some reason fails to write the end of the file! Revert change pending further investigation.
 2011-02-28 22:13:36 +11:00
Con Kolivas
9e548448d6 Checked for the wrong standard. 2011-02-28 21:18:53 +11:00
ckolivas
63566a2992 Control.window was broken comparing to zero max_chunk. 2011-02-28 14:10:46 +11:00
ckolivas
ab656aa98a Wrong check in rzip.c will leave a small chunk with unlimited mode. 2011-02-28 14:05:33 +11:00
Con Kolivas
5eaa1cc42b Updated autotools/conf system courtesy of Michael Blumenkrantz <mike@zentific.com>. 2011-02-27 00:17:29 +11:00
Con Kolivas
cf03cb0c04 Fallocate space in advance on decompression. 
This often can speed up decompression of large files and decreases fragmentation.
 2011-02-26 23:26:00 +11:00
Con Kolivas
fd5a77ac21 Check on the fd_out on decompression, NOT on fd_in. 2011-02-26 23:19:50 +11:00
Con Kolivas
8bdd5688c8 Check for free space before compression/decompression and abort if -f option is not enabled. 2011-02-26 23:10:28 +11:00
Con Kolivas
3433438a8e Structs in stream.c can be static. 2011-02-26 20:11:43 +11:00
Con Kolivas
db4f9f5fea Only retry mmapping if it's due to a memory allocation error. 2011-02-26 20:00:26 +11:00
Con Kolivas
7acd389382 Trivial cast to uchar * 2011-02-26 19:45:00 +11:00
ckolivas
9b60d6e703 Update manpage to new, cleaner help format. 2011-02-25 10:55:27 +11:00
ckolivas
930b86fabe Update manpage reflecting verbose information. 2011-02-25 10:32:33 +11:00
ckolivas
e337cce320 Increment version to 0.570. 2011-02-25 10:16:58 +11:00
ckolivas
f9f880908c Remove the slightly fragile exponential growth buffer size. 
It was only speeding up compression a small amount, yet adversely affected compression and would segfault due to the size not being consistent on successive passes.
 2011-02-25 10:10:22 +11:00
ckolivas
3a818196cc Perform sanity testing on file information output which detects corrupted archives. 2011-02-25 09:31:35 +11:00
Con Kolivas
573aa534ac Display the offset of each block in verbose information as well. 2011-02-25 09:21:30 +11:00
Con Kolivas
eae38b8645 Move compiler flags to configure and add -O2 as a minimum default flag. 2011-02-24 12:35:42 +11:00
Con Kolivas
dcf62d11a0 Make sure not to make the bufsize larger than the limit. 
Drop the page rounding since it is of no demonstrable benefit but adds complexity.
 2011-02-24 12:20:06 +11:00
Con Kolivas
22ae326d01 Make it always clear that a failure to allocate a buffer has occurred on compression. 2011-02-24 11:52:30 +11:00
Con Kolivas
8bf60c3114 Don't round to page size if the entire buffer will fit, otherwise this generates one extra pass of a tiny chunk. 2011-02-24 11:38:31 +11:00
Con Kolivas
a0ab78ba8d Update lrzip.conf parser to respect -U, -H, -T, k, and -c options. 
Further updates to documentation.
Changes by Peter Hyman <pete@peterhyman.com>
 2011-02-24 03:07:57 +11:00
Con Kolivas
d90f670fbd The output from information is confusing on 32 bit when it cuts the available ram for internal use. 
Display the actual amount of ram detected, and then decrease the value for calculating what the calculated window will be.
Move the variables to where they're only used locally.
 2011-02-23 23:58:50 +11:00
Con Kolivas
402dbbed65 Make sure we don't start shrinking the buffer size. 2011-02-23 15:34:43 +11:00
Con Kolivas
48e7e31dad Make sure to not delete files that already exist and we've refused to overwrite! 2011-02-23 15:01:43 +11:00
Con Kolivas
9fef6ab803 Add verbose and max verbose modes for -i information. 
This will give a breakdown of each rzip chunk and compressed block by jumping to each head offset and reading the header information.
 2011-02-23 12:59:59 +11:00
Con Kolivas
8edc4bd052 Trivial 2011-02-23 01:29:17 +11:00
Con Kolivas
32ff6edf9a Only set the main process nice value to less when a back-end compression is enabled. 2011-02-23 01:26:51 +11:00
Con Kolivas
e79127ace8 Trivial changes. 2011-02-23 01:22:54 +11:00
Con Kolivas
94673d3fe3 Change the LZO testing option to be a bool on/off instead of taking a confusing parameter. 
Make the lzo testing message simpler and only appear when max verbose mode is enabled.
 2011-02-23 01:15:18 +11:00
Con Kolivas
fa34905d9d Update documentation. 2011-02-22 21:17:00 +11:00
Con Kolivas
b4bbb14ac4 Strip symbols by default and add -Wall and -W to CXXFLAGS. 2011-02-22 20:43:57 +11:00
Con Kolivas
a8065f2b86 Update version to 0.561. 2011-02-22 20:42:50 +11:00
Con Kolivas
aa9056b461 Minor output fix to prevent %% showing when one thread changes from 100% to be replaced with 10%. 2011-02-22 20:39:13 +11:00
Con Kolivas
9c8b1ee795 Deprecate the -M option as it is no longer of any significant utility compared to the -U option. 2011-02-22 20:38:39 +11:00
Con Kolivas
0f1d447541 Update benchmarks. 2011-02-22 20:26:55 +11:00
Con Kolivas
011344753a With lzma and zpaq, the compression overhead per thread is significant. 
As we can work out what that compression overhead is, we can factor that into testing how much ram we can allocate.
There is no advantage to running multiple threads when there is no compression back end so drop to 1 only.
Limit ram for compression back end to 1/3 ram regardless for when OSs lie due to heavy overcommit.
 2011-02-22 15:19:31 +11:00
Con Kolivas
bcb857d934 Don't add extra threads for single-threaded decompression case. 2011-02-22 00:58:55 +11:00
Con Kolivas
bb33f7571c Multi-threading speed ups. 
Add one more thread on compression and decompression to account for the staggered nature of thread recruitment.
Make the initial buffer slightly smaller and make it progressively larger, thus recruiting threads sooner and more evenly.
This also speeds up decompression for the same reason.
Check the amount of memory being used by each thread on decompression to ensure we don't try to recruit too much ram.
 2011-02-22 00:49:50 +11:00
Con Kolivas
88e3df6af1 Print perror before unlinking files. 
Join common parts of fatal errors.
Update copyright notices.
Small improvement to visual output.
 2011-02-21 16:11:59 +11:00
Con Kolivas
a7b4708bd2 Use a different failure mode for when perror is unlikely to be set. 
Add 2 unlikely wrappers.
 2011-02-21 14:51:20 +11:00