VQMT3D Project: Report 6 on 3D-video Quality Analysis

MSU Graphics & Media Lab (Video Group)

Take a look at this article on the new site! Follow the link
https://videoprocessing.ai/stereo_quality/report6.html

Projects, ideas: Dr. Dmitriy Vatolin

Implementation: Alexander Bokov, Alexey Fedorov, Alexey Shalpegin, Alexander Novikov, Alexander Belous, Vladimir Yanushkovsky, Vyacheslav Napadovsky, Denis Sumin, Marat Arsaev, Alexander Voronov

In cooperation with IITP RAS

About the Report

The sixth report is dedicated to the analysis of stereo-window violation issue and use of floating windows in various S3D movies. The report presents detailed (415 pages) evaluation results of 10 S3D films, which were natively captured or post-converted.

Download report

Analysed films

Examined problems:
  • The Amazing Spiderman (2012)
  • The Three Musketeers (2011)
  • Pirates of the Caribbean: On Stranger Tides (2011)
  • Dolphin Tale (2011)
  • Drive Angry (2011)
  • The Avengers (2012)
  • John Carter (2012)
  • G-Force (2009)
  • Abraham Lincoln: Vampire Hunter (2012)
  • Clash of the Titans (2010)
  • Stereo-window violation

The report comprises three main parts:

  1. We thoroughly describe the stereo-window violation effect and how it can be fixed using a floating-window technique. Next we provide a brief explanation of how to understand charts and visualizations in this report.
  2. We offer a detailed analysis of 10 films. This analysis comprises per-frame charts showing floating- window and closest-object disparities for both the left and right borders of the screen. Visualizations of frames with the most noticeable stereo-window violations are provided under the corresponding charts.
  3. The report concludes with an overall film comparison. Here, we show charts depicting the noticeability of stereo-window violations and the intensity of floating-window use for each film.
In appendix we present our analysis of slant floating-window use in selected S3D films and a relatively uncommon technique that we call the letterbox-violation effect.


Example of a stereo-window violation

Example of a stereo-window violation fixed by means of the floating window technique

Professional stereographers contributed to the analysis with valuable comments and feedbacks.

Contributed Stereographers

(in alphabetical order; for main part of the report)

  • Marcus Alexander, Stereoscopic Designer, 3D Producer
  • Olivier Cahen, Stereoscopic Consultant, Author
  • Ross Copeland, Online Editor / Stereographer & Colourist, Post-Production Consultant
  • Lluis Dubreuil, Stereographer, Stereoscopic Consultant
  • Markus Lanxinger, Stereographer, Stereoscopic Supervisor
  • Enrico Perei, On-Set/Post Production Stereographer, VFX Supervisor
  • Fabien Remblier, S3D and 4K Director, Stereographer, Producer
  • Wesley Sewell, Stereographic Supervisor
  • Thomas Villepoux, Director, Stereographer

Overall evaluation results

In this section we present selected overall comparison charts.

Please, read more about the charts and particular films in the report.

Stereo Window Violation vs. Release Date

Stereo Window Violation vs. Floating Window Usage Intensity

Stereo Window Violation vs. Closest Object Disparity

Publications

When you want to make a reference to this project, please refer one of the following publications:

  1. Mikhail Erofeev, Dmitriy Vatolin, Alexander Voronov, Alexey Fedorov,
    “Toward an Objective Stereo-Video Quality Metric: Depth Perception of Textured Areas,” [pdf]
    International Conference on 3D Imaging (IC3D),
    pp. 1–6, 2012. doi:10.1109/IC3D.2012.6615120
  2. D. Akimov, A. Shestov, A. Voronov, D. Vatolin,
    “Automatic Left-Right Channel Swap Detection,” [pdf]
    International Conference on 3D Imaging (IC3D),
    pp. 1–6, 2012. doi:10.1109/IC3D.2012.6615126
  3. A. Voronov, A. Borisov, D. Vatolin,
    “System for Automatic Detection of Distorted Scenes in Stereo Video,” [pdf]
    Proceedings of the Sixth International Workshop on Video Processing and Quality Metrics (VPQM),
    2012.
  4. A. Voronov, D. Vatolin, D. Sumin, V. Napadovsky, A. Borisov,
    “Towards Automatic Stereo-video Quality Assessment and Detection of Color and Sharpness Mismatch,” [pdf]
    International Conference on 3D Imaging (IC3D),
    pp. 1–6, 2012. doi:10.1109/IC3D.2012.6615121
  5. A. Voronov, D. Vatolin, D. Sumin, V. Napadovsky, and A. Borisov,
    “Methodology for stereoscopic motion-picture quality assessment,” [pdf]
    Proc. SPIE 8648, Stereoscopic Displays and Applications XXIV,
    vol. 8648, pp. 864810-1–864810-14, March 2013. doi:10.1117/12.2008485
  6. A. Bokov, D. Vatolin, A. Zachesov, A. Belous, and M. Erofeev,
    “Automatic detection of artifacts in converted S3D video,” [pdf]
    Proc. SPIE 9011, Stereoscopic Displays and Applications XXV,
    vol. 9011, pp. 901112-1–901112-14, March 2014. doi:10.1117/12.2054330

Reports overview

Stereo-analysis project description

Report 1 (S3D shooting quality analysis of 5 movies)

Release date: March 7, 2013

Download (Additional info for bloggers and press)

Pages: 246;   Figures: 295

Film list:

  • Pirates of the Caribbean: On Stranger Tides
  • Resident Evil: Afterlife
  • Step Up 3D
  • Galapagos: The Enchanted Voyage
  • Into the Deep

Report 2 (S3D shooting quality analysis of 5 movies)

Release date: May 31, 2013

Download (Additional info for bloggers and press)

Pages: 342;   Figures: 442

Film list:

  • Dolphin Tale
  • Drive Angry
  • Hugo
  • The Three Musketeers
  • Sanctum

Report 3 (2D-3D conversion quality analysis of 5 movies)

Release date: August 28, 2013

Download (Additional info for bloggers and press)

Pages: 305;   Figures: 336

Film list:

  • Alice in Wonderland
  • Clash of the Titans
  • Conan the Barbarian
  • Green Lantern
  • Abraham Lincoln: Vampire Hunter

Report 4 (S3D shooting quality analysis of 5 movies)

Release date: October 1, 2013

Download

Pages: 301;   Figures: 402

Film list:

  • A Very Harold & Kumar 3D Christmas
  • Pina
  • Step Up Revolution
  • Resident Evil 5: Retribution
  • The Amazing Spider-Man

Report 5 (2D-3D conversion quality analysis of 5 movies)

Release date: April 11, 2014

Download (Additional info for bloggers and press)

Pages: 384;   Figures: 404

Film list:

  • The Avengers
  • The Chronicles of Narnia: The Voyage of the Dawn Treader
  • Gulliver’s Travels
  • Immortals
  • Wrath of the Titans

Report 6 (Stereo Window analysis of 10 movies)

Release date: September 10, 2014

Download (Additional info for bloggers and press)

Pages: 415;   Figures: 455

Film list:

  • The Amazing Spiderman
  • The Three Musketeers
  • Pirates of the Caribbean: On Stranger Tides
  • Dolphin Tale
  • Drive Angry
  • The Avengers
  • John Carter
  • G-Force
  • Abraham Lincoln: Vampire Hunter
  • Clash of the Titans

Report 7 (Stereo Window analysis of 10 movies)

Release date: October 22, 2014

Download (Additional info for bloggers and press)

Pages: 333;   Figures: 348

Film list:

  • Pina
  • Step Up Revolution
  • Resident Evil: Retribution
  • Hugo
  • Immortals
  • A Very Harold & Kumar 3D Christmas
  • Green Lantern
  • Conan the Barbarian
  • Wrath of the Titans
  • Alice in Wonderland

Report 8 (Rotate Analysis, Temporal Shift, Channels Swap, Zoom Mismatch in 25 movies)

Release date: June 16, 2015

Download (Additional info for bloggers and press)

Pages: 366;   Figures: 361

Film list:

  • A Very Harold & Kumar 3D Christmas
  • Abraham Lincoln: Vampire Hunter
  • The Avengers
  • Alice in Wonderland
  • Conan the Barbarian
  • The Chronicles of Narnia: The Voyage of the Dawn Treader
  • Clash of the Titans
  • Drive Angry
  • Dolphin Tale
  • Galapagos: The Enchanted Voyage
  • Green Lantern
  • Gulliver's Travels
  • Hugo
  • Immortals
  • Into the Deep
  • Pirates of the Caribbean: On Stranger Tides
  • Pina
  • Resident Evil: Afterlife
  • Resident Evil: Retribution
  • Sanctum
  • Step Up 3D
  • Step Up Revolution
  • The Amazing Spider-Man
  • The Three Musketeers
  • Wrath of the Titans

Report 9 (Temporal Shift, Stuck-to-Background Objects, 2D to S3D conversion in Captured Films)

Release date: January 18, 2017

Download (Additional info for bloggers and press)

Pages: 467;   Figures: 529

Over 100 films are in film list, including:

  • Creature from the Black Lagoon (1954)
  • World War Z (2013)
  • Dredd (2012)
  • Thor (2011)
  • The Hobbit: An Unexpected Journey (2012)
  • Life of Pi (2012)
  • Oz the Great and Powerful (2013)
  • The Legend of Hercules (2014)
  • Men in Black 3 (2012)
  • Dial M for Murder (1954)
  • Pirates of the Caribbean: On Stranger Tides (2011)
  • The Last Airbender (2010)
  • TRON: Legacy (2010)
  • Jack the Giant Slayer (2013)
  • The Great Gatsby (2013)
  • Pacific Rim (2013)
  • The Avengers (2012)

Report 10 (Overall analysis of 105 movies)

Release date: November 1, 2020

Download

Pages: 211;   Figures: 270

105 films are in film list, including:

  • Gravity (2013)
  • The Great Gatsby (2013)
  • Oz the Great and Powerful (2013)
  • Stalingrad (2013)
  • Iron Man 3 (2013)
  • Man of Steel (2013)
  • Pacific Rim (2013)
  • Jack the Giant Slayer (2013)
  • The Hobbit: An Unexpected Journey (2012)
  • The Legend of Hercules (2014)
  • Alice in Wonderland (2010)
  • Pirates of the Caribbean: On Stranger Tides (2011)
  • The Avengers (2012)
  • The Amazing Spiderman (2012)
  • World War Z (2013)
  • Thor (2011)
  • The Last Airbender (2010)
  • Life of Pi (2012)
  • TRON: Legacy (2010)
  • Hugo (2011)

Report 11 (Overall analysis of 10 selected Chinese movies)

Approximate release date: 2021

The film list includes 10 Chinese movies

Download

Full report (415 pages) is absolutely free but download is available only for industry professionals (due to publication of real mistakes in the post-production process).

To download the report, please fill-in the request form.
You will get the download link for all reports (Reports #1–6) via e-mail.

All materials in this evaluation are used for research purposes and in accordance with Fair Use conditions. This evaluation is not published widely, but it is available for free under a subscription for stereoscopy and cinema technology professionals.

Contacts

For questions and proposition please contact us  
Video resources:

3D and stereo video
Projects on 3D and stereo video processing and analysis
MSU Video Quality Measurement tools
Programs with different objective and subjective video quality metrics implementation 		Codecs comparisons
Objective and subjective quality evaluation
tests for video and image codecs
Ext. link: x264 parameters efficiency comparison
Public MSU video filters
Here are available VirtualDub and AviSynth filters. For a given type of digital video filtration we typically develop a family of different algorithms and implementations. Generally there are also versions optimized for PC and hardware implementations (ASIC/FPGA/DSP). These optimized versions can be licensed to companies. Please contact us for details via video(at)graphics.cs.msu_ru. 		Filters for companies
We are working with Intel, Samsung, RealNetworks and other companies on adapting our filters other video processing algorithms for specific video streams, applications and hardware like TV-sets, graphics cards, etc. Some of such projects are non-exclusive. Also we have internal researches. Please let us know via video(at)graphics.cs.msu_ru if you are interested in acquiring a license for such filters or making a custom R&D project on video processing, compression, computer vision.
Video codecs projects
Different research and development
projects on video codecs 		Other
Other information
Last updated: 12-May-2022
Server size: 8069 files, 1215Mb (Server statistics)

Project updated by
Server Team and MSU Video Group

Project sponsored by YUVsoft Corp.

Project supported by MSU Graphics & Media Lab