Here are the results of tests performed in April-May 2001 to compare lossless compression of True Color (24-bit) images by all known programs developed for such purpose, including BMF, JPEG-LS and PNG software, 7-Zip, Pkzip, and archivers with special algorithms for 24-bit images. See Archive Comparison Test by Jeff Gilchrist for more info: http://act.by.net If anybody wants to start or continue such tests, or can suggest some other sets of images, or other compression programs, (not sources or algorithm descriptions, executable programs only) or knows we have missed something important, (some new fantastic technology, an algorithm or even a program capable of lossless compression of up to 1000:1 and lossy compression of up to 10000:1, we hear about it from time to time since PC-XTs) please let us know immediately: artest@inbox.ru Thank you!
The Art of Lossless Data Compression vol. 21g [[1]] COMPRESSION QUALITY
(see also [[2]] Speed [[3]] Details [[4]] Comments) The last 13th line shows results for the sum of all 12 sets (538 images, 1.6Gb) original BMF RKIM UHIC ArHanGel NK ERI32 UHARC ACE32 LSP 300.47% 109.19 110.95 109.78 120.65 119.74 100% 118.61 124.51 126.08 289.11% 100% 124.50 104.88 114.61 132.43 118.80 112.29 121.22 136.11 245.22% 100% 101.38 107.93 112.92 109.62 122.97 118.96 114.33 111.39 238.64% 100% 112.66 104.20 110.53 118.18 117.31 116.73 114.13 122.73 472.81% 102.88 100% 112.24 113.06 117.29 134.72 125.91 120.73 235.68 238.40% 100% 102.20 105.10 109.91 107.08 113.89 117.53 112.83 112.67 284.74% 100% 103.04 104.35 110.93 107.79 110.07 113.96 115.95 124.18 337.03% 100% 102.94 105.64 111.14 110.31 116.20 119.99 119.41 116.77 227.58% 100% 104.53 104.00 108.91 109.02 112.99 114.60 111.00 110.35 547.50% 100% 104.25 104.84 107.76 122.73 120.71 127.76 156.04 132.31 379.87% 100% 130.51 104.36 113.80 145.03 124.87 133.06 138.21 158.03 330.47% 109.19 108.47 110.31 118.15 118.64 100% 110.44 126.63 127.67 ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 295.73% 100% 104.34 104.48 110.44 111.41 111.93 116.46 118.03 120.41 DC SBC RK LOCO ZZip PngCrush RAR Display 7Zip PkZIP 130.96 131.93 131.99 163.48 143.23 162.68 145.82 168.03 173.80 182.87 127.16 128.32 127.76 156.41 132.25 151.37 140.60 164.86 205.21 208.56 123.53 124.68 125.13 119.20 130.83 129.36 124.25 139.53 193.86 195.64 124.69 125.42 124.76 127.45 130.68 133.56 132.94 144.00 182.24 184.71 137.84 132.70 134.12 176.37 139.34 144.49 144.52 157.12 186.38 187.70 119.39 121.69 120.96 116.52 127.01 120.21 126.14 129.91 173.17 175.08 122.14 121.71 121.60 120.84 126.77 128.63 136.31 136.56 166.25 168.95 125.68 126.36 126.23 125.50 131.75 132.36 138.56 142.03 191.87 195.38 120.30 120.58 120.62 118.45 126.10 122.06 123.23 133.10 179.79 181.12 131.15 131.16 132.38 151.17 137.53 141.64 170.38 148.74 186.28 193.32 145.19 146.36 145.35 195.34 152.55 174.54 174.25 191.18 217.05 224.13 127.56 124.31 127.34 143.24 129.00 140.99 140.25 150.91 180.93 187.70 ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 123.21 123.74 123.76 128.33 129.08 130.75 135.54 140.42 179.00 182.50[[2]] Speed
A set of 23 images totalling 27,133,146 bytes from ftp://www.cipr.rpi.edu/pub/image/still/KodakImages/color/ was used for this test and a 400 MHz PC with 192 Mb RAM and Windows98. Programs,options Overall Average Compress Extract Compressed score, Users' time, time, size, score, seconds seconds bytes seconds % seconds % 7z a -tzip 4443 164% 4369 167% 83 9 15666242 7z a -mx -tzip 4487 165% 4370 167% 131 9 15649266 7z a -tufa1 4059 149% 3892 149% 186 19 13872996 7z a -mx -tufa1 4058 149% 3891 149% 185 19 13872996 ace a -d4096 3234 119% 3144 120% 99 26 11189907 ace32 a 3233 119% 3144 120% 99 26 11191619 ace32 a -d4096 3235 119% 3145 120% 100 26 11190095 ace32 a -d4096 -m1 3235 119% 3146 120% 98 26 11196635 ace32 a -d4096 -m5 3257 120% 3152 120% 117 26 11210655 ace32 a -d4096 -s- 3273 120% 3149 120% 138 26 11191243 ace32 a -d4096 -m1 -s- 3274 121% 3151 120% 137 26 11198127 ace32 a -d4096 -m5 -s- 3302 121% 3157 121% 162 26 11210935 eri a -3c03 2742 101% 2627 100% 129 112 9007908 eri a -3e03 2732 101% 2617 100% 129 111 8972364 eri a -3e03 -h94 2716 100% 2616 100% 112 105 8998827 rar a 4588 169% 4466 171% 136 9 15996627 rar a -mm 3703 136% 3663 140% 45 20 13095126 rar a -mm -m1 3703 136% 3663 140% 44 20 13098345 rar a -mm -m5 3704 136% 3662 140% 47 20 13092151 rar a -mm -mde 3703 136% 3662 140% 45 20 13095126 rar a -mm -m1 -mde 3703 136% 3663 140% 44 20 13098345 rar a -mm -m5 -mde 3704 136% 3662 140% 47 20 13092151 rar a -mm -s -mde 3700 136% 3657 140% 47 20 13077240 rar32 a -mm -s -mde 3713 137% 3664 140% 54 26 13077240 sbc c -m1 -b59 3773 139% 3660 140% 126 64 12900342 sbc c -m2 -b59 3529 130% 3378 129% 168 77 11821377 sbc c -m3 -b59 3567 131% 3397 130% 189 90 11838516 sbc c -m3 -b59 -a 3603 133% 3423 131% 200 90 11926533 sbc c -m3 -b59 -on 3568 131% 3404 130% 183 91 11860847 sbc c -m3 -os 3569 131% 3379 129% 211 96 11745177 sbc c -m3 -b59 -os 3547 131% 3263 125% 316 106 11250407 UHarc a -m1 3621 133% 3336 128% 317 71 11641810 UHarc a -m2 3664 135% 3335 127% 366 70 11620323 UHarc a -m3 4024 148% 3346 128% 752 68 11531306 UHarc a -mx 4408 162% 3707 142% 778 652 10719512 UHarc a -mx -md8192 4412 162% 3711 142% 779 655 10719503 no compression 7537 277% 7537 288% 0 0 27133146 7zip a 4440 152% 4369 157% 79 10 15666242 7zip a -mx 4490 153% 4369 157% 134 10 15649266 alch ---n 4709 161% 4419 159% 323 56 15594096 alch ---n 0 4980 170% 4889 176% 100 47 17399494 alch ---n 1 4534 155% 4365 157% 188 48 15475837 alch ---n 2 4637 158% 4470 161% 185 48 15857298 alch ---n 3 4662 159% 4459 161% 224 67 15736143 alch ---n 4 4708 161% 4418 159% 322 55 15594095 arhangel a 5672 194% 4994 180% 753 737 15057230 arhangel a -mm -1 3430 117% 3200 115% 255 157 10867001 arhangel a -mm -2 3430 117% 3200 115% 255 157 10867001 arhangel a -mm -1 -2 3429 117% 3200 115% 254 157 10867001 bmf -f 3026 103% 2953 106% 80 23 10522960 bmf -f -q9 3374 115% 2980 107% 437 22 10494756 bmf -f -s 3349 114% 3047 110% 335 283 9832328 bmf -f -s -q9 3871 132% 3100 112% 856 284 9832328 locoe -c1 4145 142% 4121 149% 26 28 14730521 locoe -c2 4163 142% 4135 149% 31 30 14770163 cbtpc 4555 156% 4517 163% 42 25 16160698 lsp 3243 111% 3199 115% 48 41 11357044 lsp -f 3318 113% 3280 118% 42 36 11667530 lsp -g 4244 145% 4207 152% 40 34 15011506 lsp -fg 4294 147% 4262 154% 35 28 15232420 dc e 3519 120% 3338 120% 200 49 11772337 dc e -b16300 3520 120% 3339 120% 201 49 11772337 dc e -b16300 -mb5 3518 120% 3338 120% 199 49 11772337 display -bpng --same 4482 153% 4245 153% 263 16 15131718 imp a -2 -s4 3806 130% 3740 135% 73 21 13365646 imp98 a 4586 157% 4528 163% 64 6 16261267 imp98 a -m3 4591 157% 4504 162% 96 7 16156757 imp98 a -mm 4327 148% 4241 153% 95 7 15212564 imp98 a -mm -m3 4357 149% 4222 152% 150 8 15118784 imp98 a -mm -2 3797 130% 3733 134% 72 19 13345236 imp98 a -mm -s4 4314 147% 4225 152% 97 7 15154706 imp98 a -2 -s4 3804 130% 3739 135% 72 20 13365818 pkzip -es 5528 189% 5511 199% 18 7 19812852 pkzip -a 4658 159% 4629 167% 32 7 16630959 pkzip -exx 4674 160% 4630 167% 48 7 16630245 pkzipc -add 4683 160% 4646 167% 40 9 16682715 pkzipc -add -max 4685 160% 4639 167% 50 9 16652375 pkzipc -add -defl 4652 159% 4604 166% 53 9 16524036 pkzipc -add -max -defl 4667 159% 4594 166% 81 9 16481369 pngcrush -q 4822 165% 4175 150% 718 - 14772830 pngcrush -q -loco 4130 141% 3515 127% 683 - 12409745 pngcrush -q -brute 6515 223% 4313 155% 12447 - 14644577 rk -mf1 3894 133% 3785 136% 121 85 13278736 rk -mf2 4213 144% 3939 142% 304 244 13196628 rk -mf3 4457 152% 3946 142% 566 233 13166528 rk -mx1 5681 194% 4722 170% 1065 1300 11938300 rk -mx2 6218 213% 5015 181% 1336 1613 11770288 rk -mx3 6679 228% 5233 189% 1606 1842 11629912 rkim c 3276 112% 3118 112% 175 211 10405925 rkim cx 3516 120% 3067 110% 499 243 9989608 uhic e 3264 111% 3047 110% 240 243 10013246 uhic m 3609 123% 3229 116% 422 441 9887092 zzip a 3736 128% 3646 131% 100 57 12889383 zzip a -mm 3770 129% 3662 132% 119 59 12933183 zzip a -mm -mx 3770 129% 3662 132% 119 59 12932662 Overall score is calculated by adding compression time, extraction time, and time it would take to transfer the compressed file over a 28,800bps network: (compressed_size)/3600 , because 28800 bits_per_second is 3600 bytes_per_second Average Users' score is calculated by adding (compress_time/10)+ extract_time + time it would take to transfer the compressed file over a 28,800bps network. Compression time is divided by 10 here, because more than 90% of people would never compress anything during their life (with compression programs), but they use compressed data almost _every_ time they use computers and/or Internet. That's why compression time is not so actual for them. Losslessly compressed with ERI32 to 8,793,161 bytes, this set can be found at http://artest.virtualave.net/kodak/ and http://artest1.tripod.com/kodak/[[3]] Details
are no longer put to this main text (856 lines reporting 17081 results on 538 files in 12 sets), but can be found in FULL version with GRAPHICS.DAT and all *.BAT at http://geocities.com/SiliconValley/Bay/1995/artest21.zip or http://artest1.tripod.com/artest21.zip 1,2,3,4,9 image sets were taken from ftp://www.cipr.rpi.edu/pub/image/ and /image2/ , converted from Sun Raster format to Windows Bitmap, (this conversion changes image headers only, 32 bytes are replaced by 54 bytes, but image data is not modified) This site www.cipr.rpi.edu is described in comp.compression FAQ, in 29 lines of "Subject: [55] Where can I find Lenna and other images?" Eight images in the 5th set are from the famous Waterloo Color Set, ( losslessly compressed to 2,857,560 bytes, it can be found at http://geocities.com/eri32 ) 6,7,8th image sets are from ftp://download.intel.com/pressroom/images/ They were converted from TIFF format to Windows Bitmap. 10th and 11th sets were downloaded from ftp://ftp.kodak.com/www/images/ Some images were slightly renamed. See GRAPHICS.DAT inside artest21.zip for more details. Some new images (from download.intel.com) were not added yet.[[4]] Comments
Links to download programs:
7-Zip 2.24 :W http://www.7-zip.com/dl/7zip224.exe 463K ACE32 2.02 :W ftp://ftp.forlangs.net/pub/windows/winace/ace202.exe 587K ArHanGeL 1.40 :a http://geocities.com/SiliconValley/Lab/6606/arh140.zip 50K BMF 1.1 :e ftp://ftp.simtel.net/pub/simtelnet/win95/graphics/bmf_1_10.zip 132K DC 0.98b :W ftp://ftp.cdrom.com/.2/sac/pack/dc124.zip 55K ERI32 4.14fre :e http://geocities.com/eri32/eri414fr.zip 93K Imp 1.1 :e http://www.winimp.com/imp110d.zip 266K Imp-win 1.12 :W http://www.winimp.com/imp112.exe 122K Pkzip 2.50 :a ftp://ftp.simtel.net/pub/simtelnet/msdos/arcers/pk250dos.exe 202K PkzipC 4.00 :W ftp://ftp.pkware.com/pkzc400s.exe 3470K RK 1.04.1 :W http://rksoft.virtualave.net/downloads/rk104a1w.exe 380K RKim 1.06 :W http://rksoft.virtualave.net/downloads/rkim106.zip 57K RAR32 2.80 :e ftp://ftp.netlab.sk/public/rarsoft/rar/rarx280.exe 269K WinRAR 2.80 :W ftp://ftp.netlab.sk/public/rarsoft/rar/wrar280.exe 621K SBC 0.840b :e http://geocities.com/sbcarchiver/sbc0840b.zip 207K UHIC 1.0 :e ftp://ftp.elf.stuba.sk/pub/pc/pack/uhic10.zip 52K ZZip 0.36b :W http://www.via.ecp.fr/~damien/downloads/zzip-win32.zip 34K NK 1.0 :W ftp://tu.tusur.ru/pub/ImageTools/NK1.ZIP 87K JPEG-LS 1.00 :W http://www.hpl.hp.com/loco/jlsrefV100.zip 325K SPIHT Nov'96 :W http://www.cipr.rpi.edu/research/SPIHT/EW_Code/lsp.exe 72K BTPC 4.1 :W http://www.engr.mun.ca/~john/btpc4.1.zip 715K PngCrush 1.5.3:e http://download.sourceforge.net/pmt/pngcrush-1.5.3-DOS.zip 157K Display 1.90b5:e http://www.freenet.edmonton.ab.ca/~crnelson/disp.exe 811K SEA 1.3 :e ftp://ftp.elf.stuba.sk/pub/pc/graph/sea13.zip 705K Alchemy 1.10 :a ftp://ftp.elf.stuba.sk/pub/pc/graph/alch110.zip 1462K :a - any DOS - DOS programs, will run under pure DOS or in a DOS box :e - extender - DOS programs using DOS extenders like DOS/4GW or CWSDPMI :W - windows - Windows95/98/NT/etc programs If direct link doesn't work-most probably newer version of the program appeared at the same site: visit web page, or read the whole directory from ftp server (i.e. try the same URL, but without filename).Homepages:
Arhangel : http://geocities.com/SiliconValley/Lab/6606 Eri32 : http://geocities.com/eri32 mirror : http://artest1.tripod.com RK, RKim : http://rksoft.virtualave.net Imp,WinImp : http://www.technelysium.com.au mirror : http://www.winimp.com ACE,WinACE : http://www.winace.com Ufa,777,7-Zip: http://www.7-zip.com PkZip : http://www.pkware.com RAR,WinRAR : http://www.rarsoft.com JPEG-LS : http://www.hpl.hp.com/loco PngCrush : http://pmt.sourceforge.net/pngcrush SPIHT : http://www.ipl.rpi.edu/research/SPIHT BTPC : http://www.engr.mun.ca/~john/btpc.html Display : http://fn2.freenet.edmonton.ab.ca/~crnelson/display.html Alchemy : http://www.handmadesw.com/Products/Image_Alchemy.htm SEA : http://www.photodex.com/products/dos SBC : http://geocities.com/sbcarchiver ZZip : http://www.zzip.f2s.comWhat's new:
46 new images were added, 7 new programs tested: 7-zip 2.24, ACE 2.02, ERI32 4.14fre, SBC 0.840b, WinRAR 2.80, RAR32 for DOS and OS/2 2.80b3, UHARC 0.3np. Results of BTPC, IMP and Ufa1 are in the full version only, see DETAILS.DAT. Latest beta versions of DC, UFA, UHARC are available from authors by e-mail: DC: EdgarBinder@t-online.de UFA: support@7-zip.com UHARC: Uwe.Herklotz@gmx.deWARNINGS:
ZZip 0.36b can't losslessly decompress some images: kodak01 ... kodak17.bmp, footbal* and susie* from 2nd set, moore2.bmp from 6th. ESP, Rkive and some other programs are not tested any more, their results and links can be found in previous versions: ESP - artest3...artest12 Rkive - 3...12 UFA - 3...12 777 - 13...14 BOA - 7...14 UHARC - 5...10 SEA - 12...19 CompuShow 2000! - 3...11 The LATEST RELEASE, and all previous versions of these tests can be found at http://geocities.com/SiliconValley/Bay/1995/ and http://artest1.tripod.com/ Send your suggestions, comments to artest@hotmail.ru With best kind regards, A.Ratushnyak Back to main ARTest page
