VQMT3D Project: Report 9 on 3D-video Quality Analysis
MSU Graphics & Media Lab (Video Group)
Projects, ideas: Dr. Dmitriy Vatolin
Implementation: Alexander Bokov, Stanislav Dolganov, Vitaliy Lyudvichenko, Vladimir Yanushkovsky, Vyacheslav Napadovsky, Denis Sumin, Marat Arsaev, Alexander Voronov
In cooperation with IITP RAS
About the Report
The ninth report presents results from an analysis of 105 S3D movies that examined temporal shifts between views and introduces a new metric for detecting stuck-to-background objects in converted S3D scenes. The report also introduces a classifier that determines which technique was used during production of a scene (capture, conversion or CGI).
Download report
Examined problems:
- Temporal shift
- Stuck-to-background objects
- Detection of 2D-3D conversion and natively captured shots
Over 100 films analysed, including: |
|
|
|
The report comprises three main parts:
- Firstly, we present our approach to analyzing stereoscopic video for temporal shift. We provide the results of our analysis for 105 S3D films and present overall charts for these films.
- Then we present our new metric for detecting foreground objects stuck to the background of a scene. The report also presents visualizations of these scenes.
- Finally, we introduce our algorithm which classifies shots in S3D films into three categories: natively captured, 2D-3D converted and CGI. The section contains a lot of examples with converted shots in natively captured films and natively captured shots in converted S3D films.
Example of a "stuck-to-background" object
Professional stereographers have contributed to the analysis by providing valuable comments and general feedback.
Contributed Stereographers
(in alphabetical order; for main part of the report)
- Alaric Hamacher, Stereographer, Director, Professor at Kwangwoon University
- Srboljub Hetlerovic, Stereographer, VFX supervisor
- Takashi Kawai, Professor in the Department of Intermedia Art and Science at Waseda University
- John Merritt, Senior Consulting Scientist at The Merritt Group
- Daniele Pugni, 3D-Motion Graphic Designer for Sky 3D Channel — Sky Italia SRL
- Pan Vafeiadis, Senior Lecturer in Visual Effects, Nuke Trainer, and Senior Stereoscopic Compositor
Overall evaluation results
In this section we present selected overall comparison charts.
Please, read more about the charts and particular films in the report.
Number of scenes detected with major "stuck-to-background artifacts"
Temporal-shift distribution in analyzed 105 films
Publications
When you want to make a reference to this project, please refer one of the following publications:
-
Mikhail Erofeev, Dmitriy Vatolin, Alexander Voronov, Alexey Fedorov,
“Toward an Objective Stereo-Video Quality Metric: Depth Perception of Textured Areas,” [pdf]
International Conference on 3D Imaging (IC3D),
pp. 1–6, 2012. doi:10.1109/IC3D.2012.6615120 -
D. Akimov, A. Shestov, A. Voronov, D. Vatolin,
“Automatic Left-Right Channel Swap Detection,” [pdf]
International Conference on 3D Imaging (IC3D),
pp. 1–6, 2012. doi:10.1109/IC3D.2012.6615126 -
A. Voronov, A. Borisov, D. Vatolin,
“System for Automatic Detection of Distorted Scenes in Stereo Video,” [pdf]
Proceedings of the Sixth International Workshop on Video Processing and Quality Metrics (VPQM),
2012. -
A. Voronov, D. Vatolin, D. Sumin, V. Napadovsky, A. Borisov,
“Towards Automatic Stereo-video Quality Assessment and Detection of Color and Sharpness Mismatch,” [pdf]
International Conference on 3D Imaging (IC3D),
pp. 1–6, 2012. doi:10.1109/IC3D.2012.6615121 -
A. Voronov, D. Vatolin, D. Sumin, V. Napadovsky, and A. Borisov,
“Methodology for stereoscopic motion-picture quality assessment,” [pdf]
Proc. SPIE 8648, Stereoscopic Displays and Applications XXIV,
vol. 8648, pp. 864810-1–864810-14, March 2013. doi:10.1117/12.2008485 -
A. Bokov, D. Vatolin, A. Zachesov, A. Belous, and M. Erofeev,
“Automatic detection of artifacts in converted S3D video,” [pdf]
Proc. SPIE 9011, Stereoscopic Displays and Applications XXV,
vol. 9011, pp. 901112-1–901112-14, March 2014. doi:10.1117/12.2054330
Reports overview
Report 1 (S3D shooting quality analysis of 5 movies) Release date: March 7, 2013 Download (Additional info for bloggers and press) Pages: 246; Figures: 295 |
Film list:
|
||
Report 2 (S3D shooting quality analysis of 5 movies) Release date: May 31, 2013 Download (Additional info for bloggers and press) Pages: 342; Figures: 442 |
Film list:
|
||
Report 3 (2D-3D conversion quality analysis of 5 movies) Release date: August 28, 2013 Download (Additional info for bloggers and press) Pages: 305; Figures: 336 |
Film list:
|
||
Report 4 (S3D shooting quality analysis of 5 movies) Release date: October 1, 2013 Pages: 301; Figures: 402 |
Film list:
|
||
Report 5 (2D-3D conversion quality analysis of 5 movies) Release date: April 11, 2014 Download (Additional info for bloggers and press) Pages: 384; Figures: 404 |
Film list:
|
||
Report 6 (Stereo Window analysis of 10 movies) Release date: September 10, 2014 Download (Additional info for bloggers and press) Pages: 415; Figures: 455 |
Film list:
|
||
Report 7 (Stereo Window analysis of 10 movies) Release date: October 22, 2014 Download (Additional info for bloggers and press) Pages: 333; Figures: 348 |
Film list:
|
||
Report 8 (Rotate Analysis, Temporal Shift, Channels Swap, Zoom Mismatch in 25 movies) Release date: June 16, 2015 Download (Additional info for bloggers and press) Pages: 366; Figures: 361 |
Film list:
|
||
Report 9 (Temporal Shift, Stuck-to-Background Objects, 2D to S3D conversion in Captured Films) Release date: January 18, 2017 Download (Additional info for bloggers and press) Pages: 467; Figures: 529 |
Over 100 films are in film list, including:
|
||
105 films are in film list, including:
|
|||
Report 11 (Overall analysis of 10 selected Chinese movies) Approximate release date: 2021 |
The film list includes 10 Chinese movies |
Download
Full report (467 pages) is absolutely free but download is available only for industry professionals (due to publication of real mistakes in the post-production process).
To download the report, please fill-in the request form.
You will get the download link for all reports (Reports #1–9) via e-mail.
All materials in this evaluation are used for research purposes and in accordance with Fair Use conditions. This evaluation is not published widely, but it is available for free under a subscription for stereoscopy and cinema technology professionals.
Contacts
For questions and proposition please contact us |
Server size: 8069 files, 1215Mb (Server statistics)
Project updated by
Server Team and
MSU Video Group
Project sponsored by YUVsoft Corp.
Project supported by MSU Graphics & Media Lab