Commit graph

861 commits

Author SHA1 Message Date
Con Kolivas 8244513719 Further tighten up ram restrictions with stdin/stdout to prevent running out of memory with all the buffers involved. 2013-09-02 00:07:30 +10:00
Con Kolivas 21925e4a9c Massive files fail with -U due to trying to allocate the whole lot in ram while doing checksums. Do it piecemeal to avoid the problem. Patch and debugging courtesy of Adam Tkáč. 2013-09-01 15:46:48 +10:00
Con Kolivas 5c811a9311 We have to run through the clear buffer function even for empty buffers or corrupt archives with empty match streams. 2013-09-01 15:02:52 +10:00
Con Kolivas 568dffafbc MD5 code uses little endian so remove arbitrary SWAP macro and explicitly use htole32. 2013-09-01 12:50:14 +10:00
Con Kolivas eff1efdbc5 Rewrite the magic if we receive lzma properties and have not yet written them yet during stdout operation. 2013-09-01 12:25:06 +10:00
Con Kolivas b076dbb59d Set the control lzma properties only once. 2013-09-01 12:17:51 +10:00
Con Kolivas 4db4641dae Add a control lock mutex for protecting certain control variables. 2013-09-01 12:11:51 +10:00
Con Kolivas 37ef39e70a Fix stdin fake mremap creating null bytes on osx, patch courtesy of John Boyle. 2013-09-01 08:43:28 +10:00
Con Kolivas 2c1dda7b73 Cache frequently used indirectly referenced variables in the sliding mmap code. 2013-03-19 00:17:52 +11:00
Con Kolivas 87fe625829 Micro-optimise sliding_get_sb_range. 2013-03-18 23:58:10 +11:00
Con Kolivas 2df8968e75 A fix for a bug where large files containing the same non-zero bytes which requires a sliding window, courtesy of Serge Belyshev. 2013-03-18 23:50:32 +11:00
Con Kolivas ccf225f710 Put vchar should take a 64 bit integer and is used from more than one call site so uninline it. 2012-12-31 16:02:54 +11:00
Con Kolivas 6f0410d28f Microoptimise in hash_search. 2012-12-31 15:02:49 +11:00
Con Kolivas e1fd5d6d11 Inline rzip functions used from only one caller. 2012-12-31 13:24:33 +11:00
Con Kolivas 0b8c0818a0 Check for successful calloc of hash table only after performing it. 2012-12-31 13:16:03 +11:00
Con Kolivas 5591639863 stdin_eof is just a bool 2012-12-31 13:09:47 +11:00
Con Kolivas 02b3250639 hash_bits can only be up to 64 so use a char type. 2012-12-31 13:04:06 +11:00
Con Kolivas 73e921b862 Check endianness of build with autotools to enable md5 support on more platforms. 2012-12-30 13:10:47 +11:00
Con Kolivas 585113d42d Bump version to 0.614 2012-07-13 10:42:40 +10:00
Con Kolivas 3238ce712c Update changelogs. 2012-07-13 10:42:20 +10:00
Con Kolivas 1aa0c0fdd0 Fix crash with -S by not freeing control->suffix. 2012-07-13 10:40:41 +10:00
Con Kolivas 275523661d Revert "Fix invalid free error when -o and -S are used together."
This reverts commit 0d6944bd3f.

Breaks lrztar.
2012-07-13 10:38:29 +10:00
Con Kolivas 2685f3dd32 Add more benchmarks. 2012-07-07 23:59:26 +10:00
Con Kolivas ea731b5748 Update documentation. 2012-07-07 22:58:43 +10:00
Con Kolivas 108d153f5e Bump version number to 0.613 2012-07-07 22:52:43 +10:00
Con Kolivas 745c2e2352 Fix other non-win32 compilation for libzpaq. 2012-07-07 22:17:00 +10:00
Con Kolivas ee08f310da Fix libzpaq compilation on other non-win32 OSs. 2012-07-07 22:13:15 +10:00
Con Kolivas 00236b16cb Fix Types.h missing which breaks typedefs on macosx. 2012-07-07 22:06:13 +10:00
Con Kolivas 7e88495988 Cope with missing ffsll() on various platforms. 2012-07-07 21:54:05 +10:00
Con Kolivas db1788f987 Fix get_ram compilation on osx. 2012-07-07 21:44:00 +10:00
Con Kolivas 184a8f0025 Rename lrzip.h to lrzip_core.h to cope with case insensitive filesystems not working with Lrzip.h vs lrzip.h 2012-07-07 21:39:40 +10:00
Con Kolivas c2ed75b868 Revert "Include Lrzip.h in sources."
This reverts commit 36c777e6d3.

Wrong fix for case insensitive issue filesystem lrzip.h vs Lrzip.h
2012-07-07 21:34:49 +10:00
Con Kolivas 36c777e6d3 Include Lrzip.h in sources. 2012-07-07 21:24:54 +10:00
Con Kolivas 901e507bd8 Include test for pthread.h and include header in lrzip_private.h. 2012-07-07 21:16:11 +10:00
Con Kolivas 73316ae276 Use system extensions in configure.ac to allow to build on non-gnu-linux platforms. 2012-07-07 21:04:49 +10:00
Con Kolivas 0d6944bd3f Fix invalid free error when -o and -S are used together. 2012-07-07 21:02:35 +10:00
Con Kolivas 081265f1c9 Use no back end compression for blocks smaller than 64 bytes to avoid issues to do with minimum buffer size and minimum match sizes of the rzip preprocessing. 2012-07-07 20:43:44 +10:00
Con Kolivas 9430b6ff4a Fix md5 calculaton on blocks larger then 2^32. Bug reproduced and debugged by Serge Belyshev. Patch by Paul Eggert. 2012-05-19 14:50:15 +10:00
Con Kolivas a9ba55fe61 Bump version number to 0.612 2012-03-17 23:16:03 +11:00
Con Kolivas 3466256f4c Updated benchmarks. 2012-03-17 23:13:06 +11:00
Con Kolivas ebd8eb917f One less tab in zpaq progress counter. 2012-03-17 22:42:04 +11:00
Con Kolivas f84d2f3373 More beautifying of the zpaq progress counter. 2012-03-17 22:33:49 +11:00
Con Kolivas 6ee7143746 Updated documentation. 2012-03-17 22:33:01 +11:00
Con Kolivas 681947234e Minor formatting improvement to delete misaligned %. 2012-03-17 16:19:38 +11:00
Con Kolivas 9e33cfc24a Implement progress counter on zpaq compress/decompress per thread within the Reader function. 2012-03-17 15:30:43 +11:00
Con Kolivas 93049636e4 Add some lrzip style defines and optimisations to the lrzip functions in libzpaq.h 2012-03-17 14:25:06 +11:00
Con Kolivas 77f6965f25 Re-instantiate the lzo compresses test for zpaq compression. 2012-03-16 23:20:54 +11:00
Con Kolivas 8b680e72ac Remove redundant code. 2012-03-16 23:14:49 +11:00
Con Kolivas fbcf0fcfd4 Delete now-unused zpipe code. 2012-03-16 23:04:20 +11:00
Con Kolivas 26433850b9 Implement virtual write support for bufWrite to speed up zpaq support and simplify the virtual read function for bufRead. 2012-03-16 23:00:29 +11:00