MSU Graphics & Media Lab Report #2 on stereo films quality assessment
Graphics & Media Lab CMC of Lomonosov Moscow State University has about 10 years' experience in comprehensive analyzing of compressed video. In March 2013 Graphics & Media Lab (in cooperation with IITP RAS) has released its first report on stereo films quality assessment. This first report presented our evaluation results and overall quality comparison of 5 stereo films.
After a very successful release of Avatar the interest to stereo 3D films endures now a bad slump. Some people even think that the 3D is dying and has no future. This decline of 3D demand has a serious background: many movie goers experience headache and eyestrain while watching a stereo film. The Lab decided to analyze the stereo films, captured with stereoscopic camera systems and to investigate the potential reasons of the irritating annoyance. The main examined problems, discovered during the film analysis:
- excessive horizontal disparity
- vertical disparity
- color mismatch (see Image #1)
- sharpness mismatch
Image #1: 'Example of color mismatch'
(Image source: http://www.compression.ru/video/vqmt3d/press-releases/report2/images/Drive_Angry_Color_problem_vis.gif)
We've got a lot of positive comments from professional stereographers on our first report and were encouraged to continue the work on stereo film evaluation. We are planning to publish in the 2nd half of 2013 another three reports and invite the stereographers for cooperation.
Now we have a pleasure to share with the industry professionals our second report on stereo film quality analysis, also including five 3D movies filmed in stereo:
- Dolphin Tale
- Drive Angry
- The Three Musketeers
- Hugo
- Sanctum
In the overall comparison of the examined films we compare 3D movies from the 1st and 2nd reports, altogether 10 films.
Depth Budget
Take a look at the depth budget (see the Image #2): 3D films created in 1994 have a big depth budget; the movies from 2011-2012 years have a big negative parallax. 'Hugo' has a lot of objects before the screen, on the contrary, in 'The Three Musketeers' all objects are behind the screen.
Image #2: 'Depth Budget vs. Release Date'
(Image source: http://www.compression.ru/video/vqmt3d/press-releases/report2/images/depth_budget_vs_release_date.png)
Vertical Disparity
It's noticeable that all the recent films ('Hugo', 'The Three Musketeers', 'Pirates of the Caribbean') have a good vertical disparity. It means, that the situation is getting more and more better with the lapse of time (see the Images #3 and #4).
Image #3: 'Vertical Disparity vs. Release Date'
(Image source: http://www.compression.ru/video/vqmt3d/press-releases/report2/images/vertical_parallax_vs_release_date.png)
It's obvious, that the stereo quality depends also on the film budget, namely on the 2D to S3D conversion budget. We have estimated the relation between the film budget and existing artifacts (see the images #4, #6 and #8). But unfortunately these evaluations can't give an accurate information, because we don't know the conversion budgets (source of the film budgets is http://www.imdb.com/)
Image #4: 'Vertical Disparity vs. Film Budget'
(Image source: http://www.compression.ru/video/vqmt3d/press-releases/report2/images/vertical_parallax_vs_movie_budget.png)
Color Mismatch
According to the Images #5 and #6 the films 'Hugo', 'Three Musketeers' and 'Pirates of the Caribbean' have the best color measures.
Image #5: 'Color Mismatch vs. Release Date'
(Image source: http://www.compression.ru/video/vqmt3d/press-releases/report2/images/color_mismatch_vs_release_date.png)
Image #6: 'Color Mismatch vs. Film Budget'
(Image source: http://www.compression.ru/video/vqmt3d/press-releases/report2/images/color_mismatch_vs_movie_budget.png)
Sharpness Mismatch
Image #7 shows a good trend of improvement in the last years: the films 'Hugo', 'Three Musketeers' and 'Pirates of the Caribbean' have a minimal sharpness mismatch measures in comparison with the other evaluated movies.
Image #7: 'Sharpness Mismatch vs. Release Date'
(Image source: http://www.compression.ru/video/vqmt3d/press-releases/report2/images/sharpness_mismatch_vs_release_date.png)
Image #8: 'Sharpness Mismatch vs. Film Budget'
(Image source: http://www.compression.ru/video/vqmt3d/press-releases/report2/images/sharpness_mismatch_vs_movie_budget.png)
In the screenshots ##1-4 below please find the samples of valuable comments from professional stereographers and some more charts and visualisations of distortions:
|
|
|
|
|
|
Acknowledgements
We would like to thank for valuable comments, opinions and feedbacks, which helped us in preparing this report (in alphabetical order):- Ross Copeland, Online Editor / Stereographer & Colourist, Post Production Consultant
- Clyde DeSouza, Author, Stereographer and Creative Technology Evangelist
- Alfredo Gonzalez, Stereoscopic Consultant / Stereographer
- Srboljub Hetlerovic, Stereographer, VFX Supervisor
- Jon Karafin, Senior Scientist and Director of Production Technology at RealD
- Julian Napierr, Director, Editor, Stereographer
- Celine Tricart, Independent Filmmaker and Stereographer
A key motive of this report is to improve the stereo quality and therefore to reduce eye- and headache. The Graphics & Media Lab hopes, that a high 3D video quality would contribute to a continually increasing number of people, leaving the modern theaters without annoyance and with good impressions from the image quality and storytelling. The report is available to all who may be concerned and interested in improving the quality of stereoscopic content. The next reports on 3D quality will be published in the near future on the web-site http://compression.ru/video/vqmt3d/.
For press
- Additional info for bloggers and press for Report #1
- Additional info for bloggers and press for Report #2
- Additional info for bloggers and press for Report #3
- Additional info for bloggers and press for Report #5
- Additional info for bloggers and press for Report #6
- Additional info for bloggers and press for Report #7
- Additional info for bloggers and press for Report #8
- Additional info for bloggers and press for Report #9
Reports overview
|
Report 1 (S3D shooting quality analysis of 5 movies) Release date: March 7, 2013 Download (Additional info for bloggers and press) Pages: 246; Figures: 295 |
Film list:
|
||
|
Report 2 (S3D shooting quality analysis of 5 movies) Release date: May 31, 2013 Download (Additional info for bloggers and press) Pages: 342; Figures: 442 |
Film list:
|
||
|
Report 3 (2D-3D conversion quality analysis of 5 movies) Release date: August 28, 2013 Download (Additional info for bloggers and press) Pages: 305; Figures: 336 |
Film list:
|
||
|
Report 4 (S3D shooting quality analysis of 5 movies) Release date: October 1, 2013 Pages: 301; Figures: 402 |
Film list:
|
||
|
Report 5 (2D-3D conversion quality analysis of 5 movies) Release date: April 11, 2014 Download (Additional info for bloggers and press) Pages: 384; Figures: 404 |
Film list:
|
||
|
Report 6 (Stereo Window analysis of 10 movies) Release date: September 10, 2014 Download (Additional info for bloggers and press) Pages: 415; Figures: 455 |
Film list:
|
||
|
Report 7 (Stereo Window analysis of 10 movies) Release date: October 22, 2014 Download (Additional info for bloggers and press) Pages: 333; Figures: 348 |
Film list:
|
||
|
Report 8 (Rotate Analysis, Temporal Shift, Channels Swap, Zoom Mismatch in 25 movies) Release date: June 16, 2015 Download (Additional info for bloggers and press) Pages: 366; Figures: 361 |
Film list:
|
||
|
Report 9 (Temporal Shift, Stuck-to-Background Objects, 2D to S3D conversion in Captured Films) Release date: January 18, 2017 Download (Additional info for bloggers and press) Pages: 467; Figures: 529 |
Over 100 films are in film list, including:
|
||
|
105 films are in film list, including:
|
|||
|
Report 11 (Overall analysis of 10 selected Chinese movies) Approximate release date: 2021 |
The film list includes 10 Chinese movies |
Contacts
| For questions and proposition please contact us |  |
Video resources:
Server size: 8069 files, 1215Mb (Server statistics)
Project updated by
Server Team and
MSU Video Group
Project sponsored by YUVsoft Corp.
Project supported by MSU Graphics & Media Lab