The Art of Lossless Data Compression vol. 25b

Here are the results of tests performed in August 2002 to compare lossless compression of "binary" files by all known good enough programs developed for such purpose, including UHArc, PPMd, Bzip2, RAR, ACE and 7-zip. See Archive Comparison Test by J.Gilchrist for more details: http://compression.ca If anybody wants to start or continue such tests, or can suggest some other sets of files, or other compression programs, (not sources or algorithm descriptions, executable programs only) or knows we have missed something important, (some new fantastic technology, an algorithm or even a program capable of lossless compression of up to 1000:1 etc.) please let us know immediately: artest@inbox.ru Thank you! [[1]] COMPRESSION QUALITY ========================= (see also [[2]] Speed [[3]] Details [[4]] Comments) Last eleventh line shows results for the sum of all 5960 files in ten sets. Origin Entropy UHArc EPM Slim Durilca Compressia PPMonstr RK 7-zip 257.68% 100% 102.43 101.03 100.95 107.10 104.81 101.56 107.16 108.47 271.35% 102.59 103.30 101.60 103.38 100% 102.74 106.94 107.27 107.05 188.78% 100.81 100.49 100.28 100.93 100% 101.36 102.90 104.06 104.09 348.41% 100.47 100% 106.34 110.00 102.42 105.43 113.86 118.02 117.09 179.82% 100.86 102.37 110.23 106.10 114.09 105.89 112.05 111.76 114.90 396.98% 101.00 100% 105.01 103.86 110.56 107.36 102.05 102.55 109.16 208.33% 105.14 106.74 104.54 105.17 100% 103.47 108.98 109.92 108.87 273.77% 102.10 100% 101.16 101.13 103.07 105.13 102.40 103.25 104.52 237.44% 100.14 101.55 100.12 100.65 100% 101.69 103.99 104.39 104.94 386.10% 103.89 106.76 102.77 108.32 103.32 100% 106.66 109.41 111.96 ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 246.50% 100% 100.60 100.98 101.53 101.59 101.71 103.77 105.26 106.18 Paq1SSE RAR PPMN_km SBC ACE BEE PPMd BZip2 7-zip pkzip 105.15 110.08 109.78 113.67 112.74 110.46 112.21 121.17 123.23 125.37 111.95 112.27 110.69 113.92 113.24 113.98 116.17 127.34 133.38 135.39 104.97 106.85 104.44 107.17 107.10 107.63 108.97 114.54 112.56 113.87 121.27 113.84 126.29 115.59 127.94 120.88 126.00 139.26 153.35 156.63 113.38 108.24 115.96 100% 107.23 117.73 119.50 120.53 126.71 127.93 111.71 117.99 118.49 123.74 121.24 117.15 118.95 132.94 131.47 134.58 112.64 114.57 111.11 113.10 115.60 113.34 115.91 123.14 124.06 125.77 105.38 109.36 112.97 112.19 110.97 115.20 116.71 124.57 124.43 127.91 107.76 108.17 105.82 109.49 109.07 109.47 111.60 118.49 118.36 119.72 115.81 123.27 120.04 123.18 124.26 120.54 124.20 141.12 141.25 146.39 ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~..~~~~~~~~~~~~~~~~~~~~~~ 107.74 109.25 109.31 109.83 110.89 111.12 113.18 121.24 122.87 124.95 Results of some other programs are in full version only, BINARIES.DAT file. [[2]] Speed =========== 4th set, all from ftp://ftp.simtel.net/pub/simtelnet/win95/graphics/sface10.zip was used for this test, and a 970MHz PC with 256Mb RAM and Windows98. Programs, Compression/ Overall Average Users' Compressed options Extraction, Score Score Size seconds seconds, % seconds, % bytes , % no compression 0 0 7613 391 7613 415 27408516 424 ace a -d4096 -m5 61 3 2608 134 2548 139 9158631 141 ace32 a 52 3 2921 150 2869 156 10315479 159 ace32 a -d4096 56 3 2599 133 2543 138 9141767 141 ace32 a -d4096 -s- 58 3 2927 150 2868 156 10313247 159 ace32 a -d4096 -m1 47 3 2604 133 2556 139 9190071 142 ace32 a -d4096 -m5 62 3 2609 134 2548 139 9158751 141 arh a 257 262 3694 189 3438 187 11425040 177 arh a -2 -mm 197 183 3213 165 3018 164 10196406 157 arh a -1 -mm 28 6 2986 153 2958 161 10625915 164 arh a -2 -1 304 202 3675 189 3374 184 11408516 176 ba -k -50 46 24 3016 155 2969 162 10601804 164 ba -k 37 22 2973 152 2936 160 10487070 162 ba -k -m 40 23 3174 163 3134 171 11197676 173 ba -k -10 38 22 2936 151 2899 158 10353984 160 boa -m1 236 226 3623 186 3389 185 11379129 176 boa -m7 547 485 3938 202 3396 185 10458903 162 boa -m15 690 615 4185 215 3502 191 10368786 160 boa -m15 -s 696 617 4191 215 3501 191 10359887 160 bzip2 -k 33 10 3130 161 3097 169 11112953 172 bzip2 -k -s 29 9 3177 163 3148 171 11299261 175 bzip2 -k -1 29 8 3262 167 3232 176 11604881 179 bzip2 -k -5 31 10 3131 161 3100 169 11126137 172 bzip2 -k -9 33 10 3130 161 3097 169 11112953 172 Entropy b o12 260 274 2744 141 2486 135 7953204 123 Entropy b o16 259 277 2739 140 2482 135 7928059 122 Entropy b o32 269 286 2752 141 2485 135 7907407 122 Entropy b o64 300 307 2803 144 2505 136 7903715 122 compcl c -b15 50 42 2744 141 2693 147 9544827 147 compcl c -b15 -s 50 42 2742 141 2692 147 9540017 147 dc e 107 13 2796 143 2690 146 9630736 149 dc e -fb 129 13 3090 158 2962 161 10610515 164 dc e -b16300 131 14 2336 120 2206 120 7888232 122 dc e -b16300 -mb5 129 14 2335 120 2206 120 7888421 122 eri a 55 30 2781 143 2727 148 9706022 150 eri a -m3 85 38 2777 142 2693 147 9555684 148 eri a -m6 85 37 2785 143 2700 147 9582523 148 gcac a 44 16 2897 149 2853 155 10212208 158 gcac s 45 18 2935 150 2890 157 10337588 160 imp98 a -mm 33 1 2748 141 2715 148 9770169 151 imp98 a -mm -m3 52 1 2757 141 2704 147 9730287 150 imp98 a -mm -2 22 7 2968 152 2945 160 10577128 163 imp98 a -mm -s4 33 3 2753 141 2719 148 9775588 151 imp98 a -2 -s4 28 4 2910 149 2882 157 10359249 160 pkzip -es 2 1 3951 203 3949 215 14212209 220 pkzip -a 6 1 3436 176 3430 187 12347196 191 pkzip -exx 7 1 3430 176 3423 186 12320267 190 ppmdi e -o6 -m232 48 51 2941 151 2893 158 10230866 158 ppmdi e -o9 -m232 51 54 2878 148 2827 154 9980158 154 ppmdi e -o12 -m232 53 56 2868 147 2815 153 9930336 153 ppmdi e -o16 -m232 54 58 2865 147 2811 153 9911769 153 ppmn_km e -o6 -M:50 217 218 3150 162 2935 160 9772905 151 ppmn_km e -o7 -M:50 237 239 3187 163 2952 161 9760047 151 ppmn_km e -o8 -M:50 244 246 3183 163 2941 160 9692957 150 ppmn_km e -o9 -M:50 244 246 3184 163 2942 160 9697928 150 ppmn_km e -o9 208 210 3275 168 3068 167 10282808 159 ppmonstr e -o6 -m250 266 289 3123 160 2859 156 9244450 143 ppmonstr e -o9 -m250 272 295 3080 158 2810 153 9046654 140 ppmonstr e -o12 -m250 275 288 3063 157 2789 152 8996048 139 ppmonstr e -o16 -m250 278 300 3072 158 2796 152 8974666 139 ppmonstr e -o32 -m250 287 309 3085 158 2800 152 8958755 138 ppmonstr e -o128 -m250 643 702 3833 197 3196 174 8954077 138 qlfc a 31 18 3019 155 2988 163 10689214 165 rk -mf1 33 26 3101 159 3067 167 10946156 169 rk -mf2 90 70 3025 155 2935 160 10310256 159 rk -mf3 127 73 2814 144 2688 146 9410064 145 rk -mx1 498 499 3671 188 3178 173 9627044 149 rk -mx2 652 655 3924 201 3277 179 9415540 145 rk -mx3 844 845 4074 209 3238 176 8584928 133 sbc c -m3 -b63 73 21 2191 112 2118 115 7548878 116 sbc c -b63 51 17 2421 124 2370 129 8470431 131 sbc c -ad -b63 59 25 2192 112 2134 116 7587006 117 sbc c -os -b63 51 18 2510 129 2459 134 8785324 136 sbc_d c -os -b63 52 18 2512 129 2459 134 8785324 136 szip -v0 36 21 3133 161 3097 169 11073758 171 szip -o4 14 19 3162 162 3148 171 11262438 174 szip -o6 36 21 3133 161 3097 169 11073758 171 szip -o8 48 22 3127 160 3078 168 11000643 170 szip -o8 -b41 53 23 3041 156 2988 163 10671420 165 zzip a 37 22 3054 157 3017 164 10781084 167 zzip a -a 37 20 2946 151 2908 158 10398266 161 zzip a -mx 38 22 2996 154 2957 161 10567860 163 zzip a -mx -mm 39 21 2813 144 2774 151 9907114 153 zzip a -mx -30m 43 22 2976 153 2933 160 10478036 162 7za a -t7z 69 4 2782 143 2720 148 9751942 151 7za a -t7z -mx 123 3 2312 118 2201 120 7870251 121 7za a -tzip 23 1 3387 174 3366 183 12104526 187 7za a -tzip -mx 54 4 3409 175 3360 183 12062635 186 abc13 -c 38 18 2995 154 2960 161 10577286 163 abc24 -c 58 44 2978 153 2925 159 10351462 160 bee a -m1 211 189 3302 169 3112 169 10445876 161 bee a -m2 346 318 3330 171 3018 164 9593788 148 bee a -m3 494 467 3603 185 3157 172 9507388 147 bee a -m3 -d6 412 385 3434 176 3063 167 9492517 147 bee a -m3 -s 732 695 4001 205 3341 182 9263158 143 durilca e -o10 -t3 237 1577 4108 211 3894 212 8258633 127 durilca e -o12 -t3 239 259 2771 142 2555 139 8178480 126 durilca e -o32 -t3 257 132 2627 135 2395 130 8055890 124 durilca e -o64 -t3 406 199 2840 146 2475 135 8046521 124 durilca e -o128 -t3 549 299 3084 158 2590 141 8050937 124 epm7 c012 525 509 3503 180 3030 165 8887748 137 epm7 c016 525 517 3516 180 3043 166 8903383 137 paq1 541 538 3875 199 3388 185 10065544 155 paq1sse 719 716 4138 212 3490 190 9730358 150 ppmy70 /o6 /m220 3101 2953 9048 465 6257 341 10777779 166 ppmy70 /o7 /m220 2791 2832 8812 453 6300 344 11479403 177 ppmy70 /o8 /m220 2795 2789 8902 457 6386 348 11943653 185 rar a -m1 34 2 3148 161 3117 170 11203280 173 rar a -m3 37 4 2539 130 2505 136 8990790 139 rar a -m5 46 4 2539 130 2497 136 8956695 138 rar a -m5 -s 72 5 2372 122 2307 126 8260230 127 rar a -mc16t -s 48 5 2357 121 2313 126 8292388 128 rar a -mc16t+ -s 58 39 2478 127 2425 132 8569139 132 rar a -mc16:128t -s 48 5 2353 121 2309 126 8275443 128 rar a -mc16:128t+ -s 67 47 2398 123 2337 127 8222366 127 rar32 a -mc16t -s 50 3 2356 121 2310 126 8285441 128 slim a -d32 -w21 1632 1410 5447 280 3978 217 8655262 134 slim a -d16 -w21 1628 1405 5438 279 3972 216 8655340 134 slim a -d8 -w21 1620 1397 5422 278 3963 216 8655729 134 slim a -d4 -w21 1605 1381 5391 277 3947 215 8656916 134 uharc a -m1 -md32768 103 14 1944 100 1851 101 6577659 101 uharc a -m2 -md32768 127 13 1953 100 1838 100 6522057 101 uharc a -m3 -md32768 142 13 1959 100 1831 100 6490817 100 uharc a -mz -md32768 22 25 2627 135 2607 142 9287969 143 uharc a -mx -md32768 180 155 2129 109 1966 107 6454087 100 ybs -m1m 35 16 3088 158 3056 166 10931948 169 ybs -m4m 41 16 3010 154 2972 162 10626638 164 ybs -m16mu 51 17 2654 136 2608 142 9308860 144 ybs -m15mu 49 18 2692 138 2647 144 9448445 146 ybs -m15mu -r 50 17 2686 138 2641 144 9428317 146 ybs_d -m15mu 53 22 2700 138 2652 144 9448445 146 Overall score is calculated by adding compression time, extraction time, and time it would take to transfer the compressed file over a 28,800bps network: (compressed_size)/3600 Average Users' score is calculated by adding (compress_time/10)+ extract_time + time it would take to transfer the compressed file over a 28,800bps network. Compression time is divided by 10 here, because more than 90% of people would never compress anything during their life (with compression programs), but they use compressed data almost _every_ time they use computers and/or Internet. That's why compression time is not so actual for them. [[3]] Details ============= are no longer put to this main text (thousands of lines reporting 200,000+ results on 5960 files in 10 sets), but can be found in FULL version with BINARIES.DAT and *.BAT at http://compression.ru/artest/artest25.zip or http://artest1.tripod.com/artest25.zip [[4]] Comments ============== Links to download programs: ~~~~~~~~~~~~~~~~~~~~~~~~~~~ PPMD var.I, PPmonstr v.I :W http://compression.ru/ds/ppmdi1.rar Durilca 0.1a :W http://compression.ru/ds/durilca.rar PAQ1SSE :W http://compression.ru/so/paq1sse.zip EPM 7 :W http://compression.ru/so/epm_7.zip YBS 0.03f :e http://compression.ru/ybs/ybs003fd.zip YBS 0.03f :W http://compression.ru/ybs/ybs003fw.zip BEE 0.7.6 :W http://compression.ru/fa/files2/bee076d.rar PPMN_km b4 :W http://compression.ru/ms/ppmn_km.rar PPMY 3c+sse :W http://compression.ru/sh/ppmy_3c_sse.rar ERI 5.1fre :e http://compression.ru/artest/eri51fre.zip 7-Zip 2.30b32 :W http://www.7-zip.org/dl/7z230b32.exe WinRAR 3.20 :W http://www.rarlab.com/rar/wrar320.exe RAR32 3.20 :e http://www.rarlab.com/rar/rarx320.exe Bzip2 1.0.2 :W ftp://sources.redhat.com/pub/bzip2/v102/bzip2-102-x86-win32.exe ABC 1.3 :W http://www.data-compression.info/ABC/abc_13.zip ABC 2.4 :W http://www.data-compression.info/ABC/abc_24.zip ACB 2.00c :e ftp://ftp.simtel.net/pub/simtelnet/msdos/compress/acb_200c.zip ACE 2.04 :W http://winace.host.sk/ace204.exe ArHanGeL 1.40 :a http://geocities.com/SiliconValley/Lab/6606/arh140.zip BA 1.01b5 :e http://hem.spray.se/mikael.lundqvist/ba101br5.zip BOA 0.58b :e ftp://ftp.elf.stuba.sk/pub/pc/pack/boa058.zip Compressia 1.0b :W http://www.compressia.com/compressia.exe DC 0.98b :W ftp://ftp.elf.stuba.sk/pub/pc/pack/dc124.zip GCac 0.9k :W http://www.emit.jp/gca/gca_v09k.exe Imp 1.1 :e http://www.technelysium.com.au/imp110d.zip Imp-win 1.12 :W http://www.technelysium.com.au/imp112.exe PAQ1 :W http://cs.fit.edu/~mmahoney/compression/paq1.exe PkzipC 4.00 :W ftp://ftp.pkware.com/pkzc400s.exe PkZip 2.50 :a ftp://ftp.simtel.net/pub/simtelnet/msdos/arcers/pk250dos.exe QLFC 6.6W :W http://ghido.shelter.ro/Archive/DownloadQLFC.php RK-dos 1.04.1 :e http://rksoft.virtualave.net/downloads/rk104a1d.exe RK 1.04.1 :W http://rksoft.virtualave.net/downloads/rk104a1w.exe SBC_d 0.969br1 :e http://personal.inet.fi/musiikki/sjm/sbc0969b_dos.zip SBC 0.969br1 :W http://personal.inet.fi/musiikki/sjm/sbc0969b_win32.zip Slim b13 :W http://www.slim-fb.by.ru/files/slim0013.zip SZip 1.12a :W http://www.compressconsult.com/szip/szip_112a_win32.zip UHArc 0.4b :eW ftp://ftp.elf.stuba.sk/pub/pc/pack/uharc04.zip ZZip 0.36c :W http://debin.org/zzip/files/zzip-win32.zip :a - any DOS - DOS programs, will run under pure DOS or in a DOS box :e - extender - DOS programs using DOS extenders like DOS/4GW or CWSDPMI :W - windows - Windows95/98/NT/etc programs If direct link doesn't work-most probably newer version of the program appeared at the same site: visit web page, or read the whole directory from ftp server (i.e. try the same URL, but without filename). Homepages: ~~~~~~~~~~ PPMD,PPMonstr, Durilca : http://compression.ru/ds EPM : http://compression.ru/so YBS : http://compression.ru/ybs BEE : http://compression.ru/fa PPMN : http://compression.ru/ms PPMy : http://compression.ru/sh Eri32 : http://compression.ru/artest mirror : http://artest1.tripod.com 7-Zip : http://www.7-zip.org RAR,WinRAR : http://www.rarlab.com ACE,WinACE : http://www.winace.com PkZip : http://www.pkware.com BZip2 : http://sources.redhat.com/bzip2 SZip : http://www.compressconsult.com/szip ABC : http://www.data-compression.info Arhangel : http://geocities.com/SiliconValley/Lab/6606 BA : http://hem.spray.se/mikael.lundqvist Compressia : http://www.compressia.com GCAC : http://emit.jp/gca/gca.html Imp,WinImp : http://www.technelysium.com.au/winimp.html PAQ1 : http://cs.fit.edu/~mmahoney/compression/ RK : http://rksoft.virtualave.net SBC : http://sbcarchiver.netfirms.com QLFC : http://ghido.shelter.ro Slim : http://www.slim-fb.by.ru ZZip : http://debin.org/zzip/ ShipInBottle: http://shipinbottle.narod.ru What's new: ~~~~~~~~~~~ 14 new programs were tested: 7-zip 2.30b32 RAR 3.20 ABC 1.3 ABC 2.4 UHArc 0.5np2 EPM 7 Slim b13 BEE 0.7.6 Durilca 0.1a PPMy 3c+sse PAQ 1 PAQ 1SSE YBS 0.03f Compressia 1.0b Latest beta versions of DC, Entropy, UHArc were available from authors by e-mail request: Entropy: artest@inbox.ru DC: EdgarBinder@t-online.de UHArc: Uwe.Herklotz@gmx.de Results of many other programs are in full version only, BINARIES.DAT file. FULL version contains all *.BAT and *.DAT files you'll need to build 10 directories with 5960 files (artest24.zip\COOK_SET\*.*) and to repeat all tests (BINS.BAT, BINARIES.DAT). WARNINGS: ~~~~~~~~~ BA 1.00beta5 can't losslessly decompress many files: CUN5IF~1.bin, CUN6IF~1 etc It types nothing like "CRC fails". DC 0.99.158b fails to decompress HLPCOPY..bin, but only if you compress with "-mb5" switch and [] filename like "any.dc5". Says nothing like "CRC fails". Problems in all other compressors were not found. ESP, Rkive and many other programs are not tested any more, their results and links can be found in previous volumes of ARTest. The LATEST RELEASE, and all previous volumes can be found at http://compression.ru/artest/ Send your suggestions, comments to artest@inbox.ru With best kind regards, A.Ratushnyak Back to main ARTest page