Here are the results of tests performed in December 2003 to compare lossless compression of True Color (24-bit) images by all known programs developed for such purpose, including BMF, JPEG-LS and PNG software, 7-Zip, Pkzip, and archivers with special algorithms for 24-bit images. See Archive Comparison Test by Jeff Gilchrist for more info: http://compression.ca If anybody wants to start or continue such tests, or can suggest some other sets of images, or other compression programs, (not sources or algorithm descriptions, executable programs only) or knows we have missed something important, (some new fantastic technology, an algorithm or even a program capable of lossless compression of up to 1000:1 and lossy compression of up to 10000:1, we hear about it from time to time since PC-XTs) please let us know immediately: artest@inbox.ru Thank you! [[1]] COMPRESSION QUALITY ========================= (see also [[2]] Speed [[3]] Details [[4]] Comments) The last 13th line shows results for the sum of all 12 sets (627 images, 2 Gb) Original BMF RKIM UHIC NK ERI ArHanGeL UHARC ACE LSP 312.42% 113.54 115.37 112.90 124.36 100% 125.45 120.91 129.46 131.09 289.12% 100% 124.50 103.67 132.34 114.40 114.61 112.13 121.23 136.11 245.22% 100% 101.39 107.08 109.56 119.38 112.92 118.80 114.34 111.40 238.64% 100% 112.66 103.30 118.11 115.14 110.53 116.50 114.13 122.74 472.81% 102.89 100% 111.46 114.09 136.49 113.07 124.03 120.74 235.68 234.76% 100% 101.90 104.00 106.86 111.69 109.64 115.99 112.66 112.06 300.89% 100% 104.16 103.36 108.19 111.54 111.11 113.97 117.33 123.56 342.65% 100% 102.61 104.87 110.30 116.76 111.61 120.43 118.36 116.50 227.58% 100% 104.53 103.07 108.85 110.58 108.92 114.43 111.00 110.36 547.51% 100% 104.26 103.35 122.41 119.24 107.77 126.17 156.04 132.31 298.76% 108.25 109.28 108.51 118.03 100% 121.55 115.69 124.64 126.27 336.86% 109.13 108.43 108.95 118.18 100% 118.07 109.60 127.27 127.96 ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 294.02% 100% 102.58 103.42 109.04 110.21 110.54 114.83 116.54 117.36 SBC DC RK LOCO UHBC LSP BTPC PNGCrush RAR pkzipc 135.18 136.17 137.24 169.98 138.93 173.17 156.67 170.75 138.18 190.14 132.44 127.16 127.77 156.42 154.99 160.20 157.26 151.37 130.67 208.56 120.62 123.53 125.13 119.20 146.92 122.55 128.46 129.46 122.23 195.64 125.49 124.69 124.77 127.46 144.03 131.33 133.62 134.30 124.18 184.72 123.48 137.85 134.12 176.37 155.65 161.59 153.29 145.17 195.40 187.70 117.66 118.60 120.00 115.91 122.90 119.55 121.67 119.56 127.05 173.10 118.23 122.63 122.20 120.16 121.50 123.42 126.97 129.43 137.47 169.65 119.24 126.75 127.19 127.12 138.18 129.49 132.28 134.58 130.92 201.55 116.47 120.30 120.62 118.46 132.14 120.67 122.54 122.16 117.20 181.12 118.41 131.16 132.39 151.18 142.69 150.78 152.21 141.97 130.83 193.33 128.38 130.83 130.82 151.91 131.34 155.97 143.55 156.67 133.93 179.17 120.00 127.74 127.52 143.54 113.94 148.09 139.05 141.79 152.46 188.14 ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 117.79 122.11 122.59 124.70 126.30 127.79 128.21 129.61 131.04 180.73 Results of some other programs are in full version only, GRAPHICS.DAT file. [[2]] Speed =========== A set of 24 Kodak images from ftp://ftp.cipr.rpi.edu/stills/kodak/color/ was used for this test, and a 970MHz PC with 256Mb RAM and Windows98. Programs, Compression/ Overall Average Users' Compressed options Extraction, Score Score Size seconds seconds, % seconds, % bytes , % no compression 0 0 7865 304 7865 308 28312848 312 7za a -tzip 28 2 4584 177 4559 178 16394253 180 7za a -mx -tzip 50 2 4601 177 4556 178 16376722 180 7za a -t7z 81 5 4087 158 4014 157 14403208 158 7za a -mx -t7z 2872 8 6819 263 4234 165 14182113 156 bee a 261 289 4175 161 3940 154 13047572 143 bee a -m3 -d6 262 290 4177 161 3940 154 13047572 143 bmfc -e0 109 111 4808 185 4709 184 16513772 182 grzip2.bat e -m1 42 36 3714 143 3676 143 13090309 144 grzip2.bat e -m2 32 24 3708 143 3678 144 13143880 145 grzip2.bat e -m3 37 39 3698 143 3665 143 13038335 143 grzip2.bat e -m4 28 28 3700 143 3675 143 13120288 144 grzip2.bat e -p 37 35 3708 143 3674 143 13086404 144 uhb30.bat e -m1 75 60 3637 140 3569 139 12607534 139 uhb30.bat e -m2 107 91 3699 143 3602 141 12602998 139 uhb30.bat e -m3 134 117 3749 145 3628 142 12590534 138 epm9 c009 602 602 4627 178 4085 159 12323036 135 epm9 c012 603 605 4632 179 4089 160 12327195 136 epm9 c015 604 605 4634 179 4090 160 12327183 136 epm9 c018 604 605 4635 179 4090 160 12327646 136 rar a -m1 39 3 4717 182 4682 183 16831106 185 rar a -m1 -mcc+ 25 4 3506 135 3484 136 12516038 138 rar a -m1 -mcc+ -s 27 5 3506 135 3481 136 12504418 137 rar a -m2 -mcc+ -s 27 5 3506 135 3481 136 12504420 137 rar a -m3 -mcc+ -s 27 5 3506 135 3481 136 12504424 137 rar a -m4 -mcc+ -s 29 6 3508 135 3482 136 12503013 137 rar a -m5 -mcc+ -s 29 6 3510 135 3483 136 12505518 137 rar32 a -m5 -mcc+ -s 36 7 3517 136 3484 136 12505518 137 slim a -w21 2265 2349 8133 314 6094 238 12667948 139 slim a -w21 -d16 2259 2351 8129 314 6095 238 12667937 139 //previous NK 139 28 3398 131 3272 128 11270106 124 locoe -c1 13 13 4305 167 4292 168 15404818 170 locoe -c2 15 14 4320 167 4305 169 15446962 170 lsp.bat e 13 13 3326 129 3313 130 11880422 131 lsp.bat e -f 11 11 3411 132 3401 133 12203421 135 ace32 a -d4096 43 10 3305 128 3263 128 11709297 129 ace32 a -d4096 -m1 42 10 3306 128 3264 128 11715709 129 ace32 a -d4096 -m5 50 10 3318 128 3269 128 11730213 129 arh a -mm -1 -2 69 38 3265 126 3197 125 11368943 125 bmf -f 22 8 3087 119 3066 120 11007688 121 bmf -f -q9 104 7 3161 122 3058 120 10979484 121 bmf -f -s 90 78 3026 117 2937 115 10289304 114 bmf -f -s -q9 240 78 3176 123 2938 115 10289304 114 compcl c -b15 -s 63 69 3868 150 3806 149 13451942 148 dc e -b16300 -mb5 58 18 3503 135 3446 135 12339333 136 display -bpng -i --same 42 5 4445 172 4404 172 15833142 175 eri a -3h13 32 37 2585 100 2554 100 9062479 100 eri a -3f13 32 37 2601 101 2570 101 9117643 101 eri a -3e13 32 37 2625 102 2594 102 9203321 102 eri a -3e13 -h90 23 29 2642 102 2619 103 9323447 103 gcac a 47 21 3553 137 3507 137 12547410 138 gcac s 48 21 3606 139 3558 139 12729808 140 imp98 a -mm -2 22 9 3923 152 3901 153 14008321 155 imp98 a -2 -s4 22 9 3926 152 3904 153 14019704 155 pkzip -es 4 1 5750 222 5746 225 20681803 228 pkzip -a 7 1 4837 187 4830 189 17381963 192 pkzip -exx 9 1 4839 187 4830 189 17383851 192 pkzipc -add 7 2 4853 188 4846 190 17436386 192 pkzipc -add -max 8 2 4845 187 4837 189 17405433 192 pkzipc -add -defl 15 2 4816 186 4801 188 17274828 191 pkzipc -add -max -defl 20 2 4809 186 4789 187 17231333 190 pngc-mmx -q 128 - 4427 171 4300 168 15474254 171 pngc-mmx -q -loco 127 - 3733 144 3607 141 12982336 143 pngc-mmx -q -brute 2351 - 6609 256 4282 168 15328841 169 qlfc a 28 21 3764 146 3736 146 13373069 148 rk -mf1 37 26 3924 152 3888 152 13901688 153 rk -mx1 476 478 4429 171 3958 155 12510696 138 rk -mx2 669 674 4769 184 4107 161 12336268 136 rk -mx3 866 868 5116 198 4259 167 12176044 134 rkim c 58 64 3145 122 3087 121 10883083 120 rkim cx 144 76 3123 121 2981 117 10454964 115 sbc c -m2 -b63 63 33 3500 135 3438 135 12254334 135 sbc c -m3 -b63 75 36 3514 136 3440 135 12251188 135 sbc c -m3 -b63 -ad 75 37 3507 136 3433 134 12224642 135 sbc c -m3 -b63 -os 79 36 3510 136 3432 134 12223134 135 zzip a 35 27 3816 148 3781 148 13515967 149 zzip a -mm -mx -26m 41 28 3817 148 3777 148 13495871 149 zzip a -mm -26m 41 28 3817 148 3777 148 13495871 149 BTPC 36 20 4001 154 3968 155 14197743 156 UHIC e 51 53 2986 115 2939 115 10371444 114 UHIC m 106 110 3059 118 2963 116 10231963 112 abc13 -c 24 21 3828 148 3806 149 13615771 150 abc24 -c 46 56 3795 146 3753 146 13289311 146 uharc a -m1 -md32768 172 25 3572 138 3416 133 12146207 134 uharc a -mz -md32768 34 37 3958 153 3927 153 13991800 154 uharc a -mx -md32768 307 285 3662 141 3385 132 11049009 121 Losslessly compressed with ERI32 to 8,891,702 bytes, this set can be found at http://artest.virtualave.net/ki/ and http://geocities.com/rao-inc/kodak/ Overall score is calculated by adding compression time, extraction time, and time it would take to transfer the compressed file over a 28,800bps network: (compressed_size)/3600 Average Users' score is calculated by adding (compress_time/10)+ extract_time + time it would take to transfer the compressed file over a 28,800bps network. Compression time is divided by 10 here, because more than 90% of people would never compress anything during their life (with compression programs), but they use compressed data almost _every_ time they use computers and/or Internet. That's why compression time is not so actual for them. [[3]] Details ============= are no longer put to this main text (984 lines reporting 25600 results on 627 files in 12 sets), but can be found in FULL version with GRAPHICS.DAT and all *.BAT at http://compression.ru/artest/artest26.zip or http://artest1.tripod.com/artest26.zip 1,2,3,4,9th image sets were taken from ftp://ftp.cipr.rpi.edu/stills/ and /sequences/ , converted from Sun Raster format to Windows Bitmap, (this conversion changes image headers only, 32 bytes are replaced by 54 bytes, but image data is not modified) This site www.cipr.rpi.edu is described in comp.compression FAQ, in 29 lines of "Subject: [55] Where can I find Lenna and other images?" Eight images in the 5th set are from the famous Waterloo Color Set, ( losslessly compressed to 2,801,690 bytes, it can be found at http://geocities.com/eri32 ) 6,7,8,12th image sets are from ftp://download.intel.com/pressroom/images/ They were converted from TIFF format to Windows Bitmap. 10th and 11th sets were downloaded from ftp://ftp.kodak.com/www/images/ Some images were slightly renamed. See GRAPHICS.DAT inside artest26.zip for more details. Some new images (from download.intel.com) were not added yet. [[4]] Comments ============== Links to download programs and Homepages are now in links.htm file What's new: ~~~~~~~~~~~ 8 new programs were tested: 7-zip 3.13 RAR 3.30b5 UHBC 1.0 EPM 9 Slim 0.021a BEE 0.7.7 GRZipII 0.2.3 BMFc - compressor for paletted and drawed images (codec for BMF 2.0) v.16.05.03 Latest beta version of DC and UHArc were available from authors by e-mail: DC: EdgarBinder@t-online.de UHArc: Uwe.Herklotz@gmx.de Results of IMP, 7-zip, ZZip, ABC, EPM, Slim and PPMN are in the full version only, see GRAPHICS.DAT. WARNINGS: ~~~~~~~~~ NK can't losslessly decompress some 8-bit images. BMF doesn't save all fields of bmp-headers. ESP, Rkive and many other programs are not tested any more, their results and links can be found in previous volumes of ARTest. The LATEST RELEASE, and all previous volumes can be found at http://compression.ru/artest/ Send your suggestions, comments to artest@inbox.ru With best kind regards, A.Ratushnyak Back to main ARTest page
The Art of Lossless Data Compression vol. 26g