The Art
of Lossless
Data Compression
vol. 25b
Here are the results of tests performed in August 2002 to compare
lossless compression of "binary" files by all known good enough programs
developed for such purpose, including UHArc, PPMd, Bzip2, RAR, ACE and 7-zip.
See Archive Comparison Test by J.Gilchrist for more details:
http://compression.ca
If anybody wants to start or continue such tests,
or can suggest some other sets of files, or other compression programs,
(not sources or algorithm descriptions, executable programs only)
or knows we have missed something important,
(some new fantastic technology, an algorithm or even a program capable
of lossless compression of up to 1000:1 etc.)
please let us know immediately: artest@inbox.ru Thank you!
[[1]] COMPRESSION QUALITY
=========================
(see also
[[2]] Speed
[[3]] Details
[[4]] Comments)
Last eleventh line shows results for the sum of all 5960 files in ten sets.
Origin Entropy UHArc EPM Slim Durilca Compressia PPMonstr RK 7-zip
257.68% 100% 102.43 101.03 100.95 107.10 104.81 101.56 107.16 108.47
271.35% 102.59 103.30 101.60 103.38 100% 102.74 106.94 107.27 107.05
188.78% 100.81 100.49 100.28 100.93 100% 101.36 102.90 104.06 104.09
348.41% 100.47 100% 106.34 110.00 102.42 105.43 113.86 118.02 117.09
179.82% 100.86 102.37 110.23 106.10 114.09 105.89 112.05 111.76 114.90
396.98% 101.00 100% 105.01 103.86 110.56 107.36 102.05 102.55 109.16
208.33% 105.14 106.74 104.54 105.17 100% 103.47 108.98 109.92 108.87
273.77% 102.10 100% 101.16 101.13 103.07 105.13 102.40 103.25 104.52
237.44% 100.14 101.55 100.12 100.65 100% 101.69 103.99 104.39 104.94
386.10% 103.89 106.76 102.77 108.32 103.32 100% 106.66 109.41 111.96
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
246.50% 100% 100.60 100.98 101.53 101.59 101.71 103.77 105.26 106.18
Paq1SSE RAR PPMN_km SBC ACE BEE PPMd BZip2 7-zip pkzip
105.15 110.08 109.78 113.67 112.74 110.46 112.21 121.17 123.23 125.37
111.95 112.27 110.69 113.92 113.24 113.98 116.17 127.34 133.38 135.39
104.97 106.85 104.44 107.17 107.10 107.63 108.97 114.54 112.56 113.87
121.27 113.84 126.29 115.59 127.94 120.88 126.00 139.26 153.35 156.63
113.38 108.24 115.96 100% 107.23 117.73 119.50 120.53 126.71 127.93
111.71 117.99 118.49 123.74 121.24 117.15 118.95 132.94 131.47 134.58
112.64 114.57 111.11 113.10 115.60 113.34 115.91 123.14 124.06 125.77
105.38 109.36 112.97 112.19 110.97 115.20 116.71 124.57 124.43 127.91
107.76 108.17 105.82 109.49 109.07 109.47 111.60 118.49 118.36 119.72
115.81 123.27 120.04 123.18 124.26 120.54 124.20 141.12 141.25 146.39
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~..~~~~~~~~~~~~~~~~~~~~~~
107.74 109.25 109.31 109.83 110.89 111.12 113.18 121.24 122.87 124.95
Results of some other programs are in full version only, BINARIES.DAT file.
[[2]] Speed
===========
4th set, all from ftp://ftp.simtel.net/pub/simtelnet/win95/graphics/sface10.zip
was used for this test, and a 970MHz PC with 256Mb RAM and Windows98.
Programs, Compression/ Overall Average Users' Compressed
options Extraction, Score Score Size
seconds seconds, % seconds, % bytes , %
no compression 0 0 7613 391 7613 415 27408516 424
ace a -d4096 -m5 61 3 2608 134 2548 139 9158631 141
ace32 a 52 3 2921 150 2869 156 10315479 159
ace32 a -d4096 56 3 2599 133 2543 138 9141767 141
ace32 a -d4096 -s- 58 3 2927 150 2868 156 10313247 159
ace32 a -d4096 -m1 47 3 2604 133 2556 139 9190071 142
ace32 a -d4096 -m5 62 3 2609 134 2548 139 9158751 141
arh a 257 262 3694 189 3438 187 11425040 177
arh a -2 -mm 197 183 3213 165 3018 164 10196406 157
arh a -1 -mm 28 6 2986 153 2958 161 10625915 164
arh a -2 -1 304 202 3675 189 3374 184 11408516 176
ba -k -50 46 24 3016 155 2969 162 10601804 164
ba -k 37 22 2973 152 2936 160 10487070 162
ba -k -m 40 23 3174 163 3134 171 11197676 173
ba -k -10 38 22 2936 151 2899 158 10353984 160
boa -m1 236 226 3623 186 3389 185 11379129 176
boa -m7 547 485 3938 202 3396 185 10458903 162
boa -m15 690 615 4185 215 3502 191 10368786 160
boa -m15 -s 696 617 4191 215 3501 191 10359887 160
bzip2 -k 33 10 3130 161 3097 169 11112953 172
bzip2 -k -s 29 9 3177 163 3148 171 11299261 175
bzip2 -k -1 29 8 3262 167 3232 176 11604881 179
bzip2 -k -5 31 10 3131 161 3100 169 11126137 172
bzip2 -k -9 33 10 3130 161 3097 169 11112953 172
Entropy b o12 260 274 2744 141 2486 135 7953204 123
Entropy b o16 259 277 2739 140 2482 135 7928059 122
Entropy b o32 269 286 2752 141 2485 135 7907407 122
Entropy b o64 300 307 2803 144 2505 136 7903715 122
compcl c -b15 50 42 2744 141 2693 147 9544827 147
compcl c -b15 -s 50 42 2742 141 2692 147 9540017 147
dc e 107 13 2796 143 2690 146 9630736 149
dc e -fb 129 13 3090 158 2962 161 10610515 164
dc e -b16300 131 14 2336 120 2206 120 7888232 122
dc e -b16300 -mb5 129 14 2335 120 2206 120 7888421 122
eri a 55 30 2781 143 2727 148 9706022 150
eri a -m3 85 38 2777 142 2693 147 9555684 148
eri a -m6 85 37 2785 143 2700 147 9582523 148
gcac a 44 16 2897 149 2853 155 10212208 158
gcac s 45 18 2935 150 2890 157 10337588 160
imp98 a -mm 33 1 2748 141 2715 148 9770169 151
imp98 a -mm -m3 52 1 2757 141 2704 147 9730287 150
imp98 a -mm -2 22 7 2968 152 2945 160 10577128 163
imp98 a -mm -s4 33 3 2753 141 2719 148 9775588 151
imp98 a -2 -s4 28 4 2910 149 2882 157 10359249 160
pkzip -es 2 1 3951 203 3949 215 14212209 220
pkzip -a 6 1 3436 176 3430 187 12347196 191
pkzip -exx 7 1 3430 176 3423 186 12320267 190
ppmdi e -o6 -m232 48 51 2941 151 2893 158 10230866 158
ppmdi e -o9 -m232 51 54 2878 148 2827 154 9980158 154
ppmdi e -o12 -m232 53 56 2868 147 2815 153 9930336 153
ppmdi e -o16 -m232 54 58 2865 147 2811 153 9911769 153
ppmn_km e -o6 -M:50 217 218 3150 162 2935 160 9772905 151
ppmn_km e -o7 -M:50 237 239 3187 163 2952 161 9760047 151
ppmn_km e -o8 -M:50 244 246 3183 163 2941 160 9692957 150
ppmn_km e -o9 -M:50 244 246 3184 163 2942 160 9697928 150
ppmn_km e -o9 208 210 3275 168 3068 167 10282808 159
ppmonstr e -o6 -m250 266 289 3123 160 2859 156 9244450 143
ppmonstr e -o9 -m250 272 295 3080 158 2810 153 9046654 140
ppmonstr e -o12 -m250 275 288 3063 157 2789 152 8996048 139
ppmonstr e -o16 -m250 278 300 3072 158 2796 152 8974666 139
ppmonstr e -o32 -m250 287 309 3085 158 2800 152 8958755 138
ppmonstr e -o128 -m250 643 702 3833 197 3196 174 8954077 138
qlfc a 31 18 3019 155 2988 163 10689214 165
rk -mf1 33 26 3101 159 3067 167 10946156 169
rk -mf2 90 70 3025 155 2935 160 10310256 159
rk -mf3 127 73 2814 144 2688 146 9410064 145
rk -mx1 498 499 3671 188 3178 173 9627044 149
rk -mx2 652 655 3924 201 3277 179 9415540 145
rk -mx3 844 845 4074 209 3238 176 8584928 133
sbc c -m3 -b63 73 21 2191 112 2118 115 7548878 116
sbc c -b63 51 17 2421 124 2370 129 8470431 131
sbc c -ad -b63 59 25 2192 112 2134 116 7587006 117
sbc c -os -b63 51 18 2510 129 2459 134 8785324 136
sbc_d c -os -b63 52 18 2512 129 2459 134 8785324 136
szip -v0 36 21 3133 161 3097 169 11073758 171
szip -o4 14 19 3162 162 3148 171 11262438 174
szip -o6 36 21 3133 161 3097 169 11073758 171
szip -o8 48 22 3127 160 3078 168 11000643 170
szip -o8 -b41 53 23 3041 156 2988 163 10671420 165
zzip a 37 22 3054 157 3017 164 10781084 167
zzip a -a 37 20 2946 151 2908 158 10398266 161
zzip a -mx 38 22 2996 154 2957 161 10567860 163
zzip a -mx -mm 39 21 2813 144 2774 151 9907114 153
zzip a -mx -30m 43 22 2976 153 2933 160 10478036 162
7za a -t7z 69 4 2782 143 2720 148 9751942 151
7za a -t7z -mx 123 3 2312 118 2201 120 7870251 121
7za a -tzip 23 1 3387 174 3366 183 12104526 187
7za a -tzip -mx 54 4 3409 175 3360 183 12062635 186
abc13 -c 38 18 2995 154 2960 161 10577286 163
abc24 -c 58 44 2978 153 2925 159 10351462 160
bee a -m1 211 189 3302 169 3112 169 10445876 161
bee a -m2 346 318 3330 171 3018 164 9593788 148
bee a -m3 494 467 3603 185 3157 172 9507388 147
bee a -m3 -d6 412 385 3434 176 3063 167 9492517 147
bee a -m3 -s 732 695 4001 205 3341 182 9263158 143
durilca e -o10 -t3 237 1577 4108 211 3894 212 8258633 127
durilca e -o12 -t3 239 259 2771 142 2555 139 8178480 126
durilca e -o32 -t3 257 132 2627 135 2395 130 8055890 124
durilca e -o64 -t3 406 199 2840 146 2475 135 8046521 124
durilca e -o128 -t3 549 299 3084 158 2590 141 8050937 124
epm7 c012 525 509 3503 180 3030 165 8887748 137
epm7 c016 525 517 3516 180 3043 166 8903383 137
paq1 541 538 3875 199 3388 185 10065544 155
paq1sse 719 716 4138 212 3490 190 9730358 150
ppmy70 /o6 /m220 3101 2953 9048 465 6257 341 10777779 166
ppmy70 /o7 /m220 2791 2832 8812 453 6300 344 11479403 177
ppmy70 /o8 /m220 2795 2789 8902 457 6386 348 11943653 185
rar a -m1 34 2 3148 161 3117 170 11203280 173
rar a -m3 37 4 2539 130 2505 136 8990790 139
rar a -m5 46 4 2539 130 2497 136 8956695 138
rar a -m5 -s 72 5 2372 122 2307 126 8260230 127
rar a -mc16t -s 48 5 2357 121 2313 126 8292388 128
rar a -mc16t+ -s 58 39 2478 127 2425 132 8569139 132
rar a -mc16:128t -s 48 5 2353 121 2309 126 8275443 128
rar a -mc16:128t+ -s 67 47 2398 123 2337 127 8222366 127
rar32 a -mc16t -s 50 3 2356 121 2310 126 8285441 128
slim a -d32 -w21 1632 1410 5447 280 3978 217 8655262 134
slim a -d16 -w21 1628 1405 5438 279 3972 216 8655340 134
slim a -d8 -w21 1620 1397 5422 278 3963 216 8655729 134
slim a -d4 -w21 1605 1381 5391 277 3947 215 8656916 134
uharc a -m1 -md32768 103 14 1944 100 1851 101 6577659 101
uharc a -m2 -md32768 127 13 1953 100 1838 100 6522057 101
uharc a -m3 -md32768 142 13 1959 100 1831 100 6490817 100
uharc a -mz -md32768 22 25 2627 135 2607 142 9287969 143
uharc a -mx -md32768 180 155 2129 109 1966 107 6454087 100
ybs -m1m 35 16 3088 158 3056 166 10931948 169
ybs -m4m 41 16 3010 154 2972 162 10626638 164
ybs -m16mu 51 17 2654 136 2608 142 9308860 144
ybs -m15mu 49 18 2692 138 2647 144 9448445 146
ybs -m15mu -r 50 17 2686 138 2641 144 9428317 146
ybs_d -m15mu 53 22 2700 138 2652 144 9448445 146
Overall score is calculated by adding compression time, extraction time, and
time it would take to transfer the compressed file over a 28,800bps network:
(compressed_size)/3600
Average Users' score is calculated by adding (compress_time/10)+ extract_time +
time it would take to transfer the compressed file over a 28,800bps network.
Compression time is divided by 10 here, because more than 90% of people would
never compress anything during their life (with compression programs), but they
use compressed data almost _every_ time they use computers and/or Internet.
That's why compression time is not so actual for them.
[[3]] Details
=============
are no longer put to this main text
(thousands of lines reporting 200,000+ results on 5960 files in 10 sets),
but can be found in FULL version with BINARIES.DAT and *.BAT
at http://compression.ru/artest/artest25.zip
or http://artest1.tripod.com/artest25.zip
[[4]] Comments
==============
Links to download programs:
~~~~~~~~~~~~~~~~~~~~~~~~~~~
PPMD var.I,
PPmonstr v.I :W http://compression.ru/ds/ppmdi1.rar
Durilca 0.1a :W http://compression.ru/ds/durilca.rar
PAQ1SSE :W http://compression.ru/so/paq1sse.zip
EPM 7 :W http://compression.ru/so/epm_7.zip
YBS 0.03f :e http://compression.ru/ybs/ybs003fd.zip
YBS 0.03f :W http://compression.ru/ybs/ybs003fw.zip
BEE 0.7.6 :W http://compression.ru/fa/files2/bee076d.rar
PPMN_km b4 :W http://compression.ru/ms/ppmn_km.rar
PPMY 3c+sse :W http://compression.ru/sh/ppmy_3c_sse.rar
ERI 5.1fre :e http://compression.ru/artest/eri51fre.zip
7-Zip 2.30b32 :W http://www.7-zip.org/dl/7z230b32.exe
WinRAR 3.20 :W http://www.rarlab.com/rar/wrar320.exe
RAR32 3.20 :e http://www.rarlab.com/rar/rarx320.exe
Bzip2 1.0.2 :W ftp://sources.redhat.com/pub/bzip2/v102/bzip2-102-x86-win32.exe
ABC 1.3 :W http://www.data-compression.info/ABC/abc_13.zip
ABC 2.4 :W http://www.data-compression.info/ABC/abc_24.zip
ACB 2.00c :e ftp://ftp.simtel.net/pub/simtelnet/msdos/compress/acb_200c.zip
ACE 2.04 :W http://winace.host.sk/ace204.exe
ArHanGeL 1.40 :a http://geocities.com/SiliconValley/Lab/6606/arh140.zip
BA 1.01b5 :e http://hem.spray.se/mikael.lundqvist/ba101br5.zip
BOA 0.58b :e ftp://ftp.elf.stuba.sk/pub/pc/pack/boa058.zip
Compressia 1.0b :W http://www.compressia.com/compressia.exe
DC 0.98b :W ftp://ftp.elf.stuba.sk/pub/pc/pack/dc124.zip
GCac 0.9k :W http://www.emit.jp/gca/gca_v09k.exe
Imp 1.1 :e http://www.technelysium.com.au/imp110d.zip
Imp-win 1.12 :W http://www.technelysium.com.au/imp112.exe
PAQ1 :W http://cs.fit.edu/~mmahoney/compression/paq1.exe
PkzipC 4.00 :W ftp://ftp.pkware.com/pkzc400s.exe
PkZip 2.50 :a ftp://ftp.simtel.net/pub/simtelnet/msdos/arcers/pk250dos.exe
QLFC 6.6W :W http://ghido.shelter.ro/Archive/DownloadQLFC.php
RK-dos 1.04.1 :e http://rksoft.virtualave.net/downloads/rk104a1d.exe
RK 1.04.1 :W http://rksoft.virtualave.net/downloads/rk104a1w.exe
SBC_d 0.969br1 :e http://personal.inet.fi/musiikki/sjm/sbc0969b_dos.zip
SBC 0.969br1 :W http://personal.inet.fi/musiikki/sjm/sbc0969b_win32.zip
Slim b13 :W http://www.slim-fb.by.ru/files/slim0013.zip
SZip 1.12a :W http://www.compressconsult.com/szip/szip_112a_win32.zip
UHArc 0.4b :eW ftp://ftp.elf.stuba.sk/pub/pc/pack/uharc04.zip
ZZip 0.36c :W http://debin.org/zzip/files/zzip-win32.zip
:a - any DOS - DOS programs, will run under pure DOS or in a DOS box
:e - extender - DOS programs using DOS extenders like DOS/4GW or CWSDPMI
:W - windows - Windows95/98/NT/etc programs
If direct link doesn't work-most probably newer version of the program appeared
at the same site: visit web page, or read the whole directory from ftp server
(i.e. try the same URL, but without filename).
Homepages:
~~~~~~~~~~
PPMD,PPMonstr,
Durilca : http://compression.ru/ds
EPM : http://compression.ru/so
YBS : http://compression.ru/ybs
BEE : http://compression.ru/fa
PPMN : http://compression.ru/ms
PPMy : http://compression.ru/sh
Eri32 : http://compression.ru/artest
mirror : http://artest1.tripod.com
7-Zip : http://www.7-zip.org
RAR,WinRAR : http://www.rarlab.com
ACE,WinACE : http://www.winace.com
PkZip : http://www.pkware.com
BZip2 : http://sources.redhat.com/bzip2
SZip : http://www.compressconsult.com/szip
ABC : http://www.data-compression.info
Arhangel : http://geocities.com/SiliconValley/Lab/6606
BA : http://hem.spray.se/mikael.lundqvist
Compressia : http://www.compressia.com
GCAC : http://emit.jp/gca/gca.html
Imp,WinImp : http://www.technelysium.com.au/winimp.html
PAQ1 : http://cs.fit.edu/~mmahoney/compression/
RK : http://rksoft.virtualave.net
SBC : http://sbcarchiver.netfirms.com
QLFC : http://ghido.shelter.ro
Slim : http://www.slim-fb.by.ru
ZZip : http://debin.org/zzip/
ShipInBottle: http://shipinbottle.narod.ru
What's new:
~~~~~~~~~~~
14 new programs were tested:
7-zip 2.30b32
RAR 3.20
ABC 1.3
ABC 2.4
UHArc 0.5np2
EPM 7
Slim b13
BEE 0.7.6
Durilca 0.1a
PPMy 3c+sse
PAQ 1
PAQ 1SSE
YBS 0.03f
Compressia 1.0b
Latest beta versions of DC, Entropy, UHArc were available
from authors by e-mail request:
Entropy: artest@inbox.ru
DC: EdgarBinder@t-online.de
UHArc: Uwe.Herklotz@gmx.de
Results of many other programs are in full version only, BINARIES.DAT file.
FULL version contains all *.BAT and *.DAT files
you'll need to build 10 directories with 5960 files (artest24.zip\COOK_SET\*.*)
and to repeat all tests (BINS.BAT, BINARIES.DAT).
WARNINGS:
~~~~~~~~~
BA 1.00beta5 can't losslessly decompress many files: CUN5IF~1.bin, CUN6IF~1 etc
It types nothing like "CRC fails".
DC 0.99.158b fails to decompress HLPCOPY..bin, but only if you compress
with "-mb5" switch and [
