The Art
of Lossless
Data Compression
vol. 26b
Here are the results of tests performed in December 2003 to compare
lossless compression of "binary" files by all known good enough programs
developed for such purpose, including UHArc, PPMd, Bzip2, RAR, ACE and 7-zip.
See Archive Comparison Test by J.Gilchrist for more details:
http://compression.ca
If anybody wants to start or continue such tests,
or can suggest some other sets of files, or other compression programs,
(not sources or algorithm descriptions, executable programs only)
or knows we have missed something important,
(some new fantastic technology, an algorithm or even a program capable
of lossless compression of up to 1000:1 etc.)
please let us know immediately: artest@inbox.ru Thank you!
[[1]] COMPRESSION QUALITY
=========================
(see also
[[2]] Speed
[[3]] Details
[[4]] Comments)
Last eleventh line shows results for the sum of all 5960 files in ten sets.
Origin PAQ6 DURILCA Slim Entropy UHArc Compressia PPMonstr RK 7-zip
277.57% 100% 107.52 105.05 107.87 110.34 112.89 109.40 115.43 116.84
282.61% 103.69 100% 100.40 106.85 107.59 107.00 111.37 111.71 111.49
194.75% 101.05 100% 101.16 104.00 103.67 104.57 106.16 107.35 107.39
380.63% 110.61 100% 107.93 109.76 109.25 115.18 124.38 128.93 127.91
186.22% 105.45 104.23 100% 104.45 106.01 109.66 116.04 115.74 118.99
438.28% 100% 113.36 123.00 111.51 110.40 118.53 112.67 113.22 120.51
212.37% 105.06 100.24 100% 107.18 108.81 105.47 111.09 112.05 110.98
298.93% 100% 111.78 106.59 111.49 109.19 114.79 111.81 112.74 114.12
245.18% 101.92 100.12 100% 103.41 104.86 105.01 107.39 107.80 108.37
410.77% 100% 107.62 107.78 110.52 113.58 106.39 113.48 116.40 119.11
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
256.80% 100% 100.89 101.06 104.18 104.80 105.96 108.11 109.66 110.62
ASH RAR PPMN_km SBC BEE ACE PPMd BZip2 7-zip pkzip
115.87 118.62 118.25 122.44 118.69 121.44 120.87 130.52 132.74 135.05
116.00 117.05 115.28 118.64 118.33 117.93 120.99 132.63 138.91 141.01
108.89 110.27 107.75 110.57 110.73 110.50 112.42 118.17 116.13 117.48
129.44 124.38 137.97 126.28 131.83 139.77 137.65 152.14 167.53 171.11
121.08 112.10 120.09 103.56 121.48 111.05 123.75 124.82 131.22 132.48
123.79 130.32 130.82 136.62 128.57 133.85 131.33 146.77 145.14 148.58
113.65 116.81 113.26 115.29 115.21 117.84 118.16 125.53 126.47 128.21
121.45 119.40 123.36 122.51 125.12 121.17 127.44 136.02 135.87 139.67
110.71 111.75 109.27 113.06 112.71 112.63 115.24 122.36 122.22 123.63
123.02 131.32 127.71 131.05 127.40 132.20 132.14 150.14 150.27 155.74
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~..~~~~~~~~~~~~~~~~~~~~~~
113.08 113.87 113.88 114.42 115.36 115.52 117.90 126.31 128.00 130.18
Results of many other programs are in full version only, BINARIES.DAT file.
[[2]] Speed
===========
4th set, all from ftp://ftp.simtel.net/pub/simtelnet/win95/graphics/sface10.zip
was used for this test, and a 970MHz PC with 256Mb RAM and Windows98.
Programs, Compression/ Overall Average Users' Compressed
options Extraction, Score Score Size
seconds seconds, % seconds, % bytes , %
no compression 0 0 7613 391 7613 415 27408516 424
7za a -t7z 74 4 2684 138 2617 142 9381020 145
7za a -t7z -mx 111 4 2225 114 2125 116 7594105 117
7za a -tzip 23 1 3387 174 3366 183 12104526 187
7za a -tzip -mx 54 1 3407 175 3358 183 12062635 186
ash04a /o6 /m230 576 575 3691 189 3172 173 9140632 141
ash04a /o9 /m230 673 619 4032 207 3425 187 9860022 152
ash04a /o16 /m230 685 645 4260 219 3643 198 10543230 163
ash04a /o6 /m230 /s16 657 651 3830 197 3238 176 9075968 140
ash04a /o9 /m230 /s16 803 730 4237 217 3514 191 9730972 150
ash04a /o16 /m230 /s16 810 775 4472 230 3742 204 10387749 160
bee a -m1 187 184 3246 167 3078 168 10350726 160
bee a -m2 338 340 3331 171 3027 165 9552914 148
bee a -m3 454 464 3555 182 3146 171 9494000 147
bee a -m3 -s 667 684 3921 201 3320 181 9249655 143
durilca e -o8 -t3 214 213 2538 130 2345 128 7597450 117
durilca e -o9 -t3 216 216 2522 129 2327 127 7523916 116
durilca e -o10 -t3 218 219 2507 128 2310 126 7448698 115
durilca e -o12 -t3 221 222 2490 128 2291 125 7368195 114
durilca e -o16 -t3 226 227 2479 127 2276 124 7295306 113
durilca e -o32 -t3 239 241 2494 128 2278 124 7244957 112
durilca e -o64 -t3 374 326 2711 139 2374 129 7236704 112
durilca e -o128 -t3 489 486 2987 153 2547 139 7242413 112
epm9 c008 536 539 3483 179 3000 163 8669314 134
epm9 c012 554 557 3539 182 3040 166 8739027 135
epm9 c016 560 563 3554 182 3050 166 8750216 135
grzipii e 36 25 2831 145 2798 152 9968577 154
paq6v2a 692 689 3881 199 3258 177 8999841 139
paq6v2a -6 1241 1496 4605 236 3488 190 6725123 104
rar a -m1 35 3 3150 162 3118 170 11203280 173
rar a -m2 38 2 3134 161 3100 169 11139927 172
rar a -m3 37 3 2538 130 2504 136 8991000 139
rar a -m4 42 3 2535 130 2497 136 8962479 138
rar a -m5 47 4 2539 130 2497 136 8957658 138
rar a -m5 -s 73 4 2373 122 2307 126 8266028 128
rar a -mc16t -s 49 5 2357 121 2313 126 8292616 128
rar a -mc16t+ -s 59 39 2478 127 2425 132 8568202 132
rar a -mc16:128t -s 49 5 2354 121 2310 126 8281923 128
rar a -mc16:128t+ -s 68 47 2400 123 2338 127 8223372 127
rar32 a -mc16t -s 51 3 2355 121 2309 126 8283248 128
rkc -mf -M230M -o8 150 17 2899 149 2764 150 9833956 152
rkc -mf -M230M -fe 150 17 2899 149 2764 150 9833956 152
slim a -d32 -w21 1928 1990 6079 312 4343 237 7774896 120
slim a -d16 -w21 1928 1985 6073 312 4338 236 7775197 120
slim a -d8 -w21 1908 1979 6047 311 4330 236 7776164 120
slim a -d4 -w21 1902 1955 6019 309 4306 235 7779001 120
uhbc e 100 75 2932 150 2841 155 9920824 153
//previous
ace a -d4096 -m5 61 3 2608 134 2548 139 9158631 141
ace32 a 52 3 2921 150 2869 156 10315479 159
ace32 a -d4096 56 3 2599 133 2543 138 9141767 141
ace32 a -d4096 -s- 58 3 2927 150 2868 156 10313247 159
ace32 a -d4096 -m1 47 3 2604 133 2556 139 9190071 142
ace32 a -d4096 -m5 62 3 2609 134 2548 139 9158751 141
arh a 257 262 3694 189 3438 187 11425040 177
arh a -2 -mm 197 183 3213 165 3018 164 10196406 157
arh a -1 -mm 28 6 2986 153 2958 161 10625915 164
arh a -2 -1 304 202 3675 189 3374 184 11408516 176
ba -k -50 46 24 3016 155 2969 162 10601804 164
ba -k 37 22 2973 152 2936 160 10487070 162
ba -k -m 40 23 3174 163 3134 171 11197676 173
ba -k -10 38 22 2936 151 2899 158 10353984 160
boa -m1 236 226 3623 186 3389 185 11379129 176
boa -m7 547 485 3938 202 3396 185 10458903 162
boa -m15 690 615 4185 215 3502 191 10368786 160
boa -m15 -s 696 617 4191 215 3501 191 10359887 160
bzip2 -k 33 10 3130 161 3097 169 11112953 172
bzip2 -k -s 29 9 3177 163 3148 171 11299261 175
bzip2 -k -1 29 8 3262 167 3232 176 11604881 179
bzip2 -k -5 31 10 3131 161 3100 169 11126137 172
bzip2 -k -9 33 10 3130 161 3097 169 11112953 172
Entropy b o12 260 274 2744 141 2486 135 7953204 123
Entropy b o16 259 277 2739 140 2482 135 7928059 122
Entropy b o32 269 286 2752 141 2485 135 7907407 122
Entropy b o64 300 307 2803 144 2505 136 7903715 122
compcl c -b15 50 42 2744 141 2693 147 9544827 147
compcl c -b15 -s 50 42 2742 141 2692 147 9540017 147
dc e 107 13 2796 143 2690 146 9630736 149
dc e -fb 129 13 3090 158 2962 161 10610515 164
dc e -b16300 131 14 2336 120 2206 120 7888232 122
dc e -b16300 -mb5 129 14 2335 120 2206 120 7888421 122
eri a 55 30 2781 143 2727 148 9706022 150
eri a -m3 85 38 2777 142 2693 147 9555684 148
eri a -m6 85 37 2785 143 2700 147 9582523 148
gcac a 44 16 2897 149 2853 155 10212208 158
gcac s 45 18 2935 150 2890 157 10337588 160
imp98 a -mm 33 1 2748 141 2715 148 9770169 151
imp98 a -mm -m3 52 1 2757 141 2704 147 9730287 150
imp98 a -mm -2 22 7 2968 152 2945 160 10577128 163
imp98 a -mm -s4 33 3 2753 141 2719 148 9775588 151
imp98 a -2 -s4 28 4 2910 149 2882 157 10359249 160
pkzip -es 2 1 3951 203 3949 215 14212209 220
pkzip -a 6 1 3436 176 3430 187 12347196 191
pkzip -exx 7 1 3430 176 3423 186 12320267 190
ppmdi e -o6 -m232 48 51 2941 151 2893 158 10230866 158
ppmdi e -o9 -m232 51 54 2878 148 2827 154 9980158 154
ppmdi e -o12 -m232 53 56 2868 147 2815 153 9930336 153
ppmdi e -o16 -m232 54 58 2865 147 2811 153 9911769 153
ppmn_km e -o6 -M:50 217 218 3150 162 2935 160 9772905 151
ppmn_km e -o7 -M:50 237 239 3187 163 2952 161 9760047 151
ppmn_km e -o8 -M:50 244 246 3183 163 2941 160 9692957 150
ppmn_km e -o9 -M:50 244 246 3184 163 2942 160 9697928 150
ppmn_km e -o9 208 210 3275 168 3068 167 10282808 159
ppmonstr e -o6 -m250 266 289 3123 160 2859 156 9244450 143
ppmonstr e -o9 -m250 272 295 3080 158 2810 153 9046654 140
ppmonstr e -o12 -m250 275 288 3063 157 2789 152 8996048 139
ppmonstr e -o16 -m250 278 300 3072 158 2796 152 8974666 139
ppmonstr e -o32 -m250 287 309 3085 158 2800 152 8958755 138
ppmonstr e -o128 -m250 643 702 3833 197 3196 174 8954077 138
qlfc a 31 18 3019 155 2988 163 10689214 165
rk -mf1 33 26 3101 159 3067 167 10946156 169
rk -mf2 90 70 3025 155 2935 160 10310256 159
rk -mf3 127 73 2814 144 2688 146 9410064 145
rk -mx1 498 499 3671 188 3178 173 9627044 149
rk -mx2 652 655 3924 201 3277 179 9415540 145
rk -mx3 844 845 4074 209 3238 176 8584928 133
sbc c -m3 -b63 73 21 2191 112 2118 115 7548878 116
sbc c -b63 51 17 2421 124 2370 129 8470431 131
sbc c -ad -b63 59 25 2192 112 2134 116 7587006 117
sbc c -os -b63 51 18 2510 129 2459 134 8785324 136
sbc_d c -os -b63 52 18 2512 129 2459 134 8785324 136
szip -v0 36 21 3133 161 3097 169 11073758 171
szip -o4 14 19 3162 162 3148 171 11262438 174
szip -o6 36 21 3133 161 3097 169 11073758 171
szip -o8 48 22 3127 160 3078 168 11000643 170
szip -o8 -b41 53 23 3041 156 2988 163 10671420 165
zzip a 37 22 3054 157 3017 164 10781084 167
zzip a -a 37 20 2946 151 2908 158 10398266 161
zzip a -mx 38 22 2996 154 2957 161 10567860 163
zzip a -mx -mm 39 21 2813 144 2774 151 9907114 153
zzip a -mx -30m 43 22 2976 153 2933 160 10478036 162
abc13 -c 38 18 2995 154 2960 161 10577286 163
abc24 -c 58 44 2978 153 2925 159 10351462 160
uharc a -m1 -md32768 103 14 1944 100 1851 101 6577659 101
uharc a -m2 -md32768 127 13 1953 100 1838 100 6522057 101
uharc a -m3 -md32768 142 13 1959 100 1831 100 6490817 100
uharc a -mz -md32768 22 25 2627 135 2607 142 9287969 143
uharc a -mx -md32768 180 155 2129 109 1966 107 6454087 100
ybs -m1m 35 16 3088 158 3056 166 10931948 169
ybs -m4m 41 16 3010 154 2972 162 10626638 164
ybs -m16mu 51 17 2654 136 2608 142 9308860 144
ybs -m15mu 49 18 2692 138 2647 144 9448445 146
ybs -m15mu -r 50 17 2686 138 2641 144 9428317 146
ybs_d -m15mu 53 22 2700 138 2652 144 9448445 146
Overall score is calculated by adding compression time, extraction time, and
time it would take to transfer the compressed file over a 28,800bps network:
(compressed_size)/3600
Average Users' score is calculated by adding (compress_time/10)+ extract_time +
time it would take to transfer the compressed file over a 28,800bps network.
Compression time is divided by 10 here, because more than 90% of people would
never compress anything during their life (with compression programs), but they
use compressed data almost _every_ time they use computers and/or Internet.
That's why compression time is not so actual for them.
[[3]] Details
=============
are no longer put to this main text
(thousands of lines reporting 200,000+ results on 5960 files in 10 sets),
but can be found in FULL version with BINARIES.DAT and *.BAT
at http://compression.ru/artest/artest26.zip
or http://artest1.tripod.com/artest26.zip
[[4]] Comments
==============
Links to download programs
and Homepages
are now in links.htm file
What's new:
~~~~~~~~~~~
12 new programs were tested:
ASH 04a
7-zip 3.13
RAR 3.30b5
UHBC 1.0
EPM 9
Slim 0.021a
BEE 0.7.7
Durilca 0.3a
PAQ 6v2
RKC 1.02
GRZipII 0.2.3
BWIC
As beta versions of RKC, EPM and BWIC fail to compress and/or decompress many
text files, they were not tested on all binary files.
Latest beta versions of DC, Entropy, UHArc were available
from authors by e-mail request:
Entropy: artest@inbox.ru
DC: EdgarBinder@t-online.de
UHArc: Uwe.Herklotz@gmx.de
Results of many other programs are in full version only, BINARIES.DAT file.
FULL version contains all *.BAT and *.DAT files
you'll need to build 10 directories with 5960 files (artest26.zip\COOK_SET\*.*)
and to repeat all tests (BINS.BAT, BINARIES.DAT).
WARNINGS:
~~~~~~~~~
Beta versions of RKC, EPM and BWIC fail to compress and/or decompress many
files. Authors are notified.
ASH 04a can fail to decompress some large files if it lacks memory.
BA 1.00beta5 can't losslessly decompress many files: CUN5IF~1.bin, CUN6IF~1 etc
It types nothing like "CRC fails".
DC 0.99.158b fails to decompress HLPCOPY..bin, but only if you compress
with "-mb5" switch and [
