Hot news:

If you find a spelling error, please select an incorrect text and press Ctrl+Enter. Thank you!

Compression project >> Video Area Home

VQMT3D Project: Report 3 on 3D-video Quality Analysis

MSU Graphics & Media Lab (Video Group)

Projects, ideas: Dr. Dmitriy Vatolin

Implementation: Alexander Voronov, Denis Sumin, Marat Arsaev, Vyacheslav Napadovsky, Alexander Bokov, Alexander Belous, Alexey Shalpegin, Vladimir Yanushkovsky

In cooperation with IITP RAS


About the Report


The report presents detailed (305 pages) evaluation results of 5 S3D films, which were converted to S3D format in post-production.

Download report

Analysed films

Examined problems:

  • Alice in Wonderland (2010)
  • Clash of the Titans (2010)
  • Conan the Barbarian (2011)
  • Green Lantern (2011)
  • Abraham Lincoln: Vampire Hunter (2012)
  • Edge-sharpness mismatch
  • Cardboard effect
  • Excessive horizontal disparity
  • Vertical disparity
  • Color mismatch
  • Sharpness mismatch

The report comprises four main parts:

  1. Thorough description of visual-discomfort potential causes that are mostly specific to 2D-3D conversion (see page from report)
  2. Detailed analysis of five films. Each film description consists of two parts:
    • Per-frame analysis with charts showing metric values for each frame; (see page from report)
    • Visualizations demonstrating artifacts in frames that earned a poor rating according to our metrics (including new visualizations of problems, specific to 2D-3D conversion! See page from report)
  3. Overall film comparison. Here go charts depicting the average metric values and distribution of these values in each film. (see page from report).
    Some charts showing overall comparison results are presented in the Overall evaluation results section on this page.
  4. Comparison of 2D and S3D versions of analyzed films (see page from report).

Visualization of a frame from The Avengers. It is clearly visible that the utilized background-reconstruction algorithm lacks quality:

Professional stereographers contributed to the analysis with valuable comments and feedbacks.


Contributed Stereographers


(in alphabetical order)


Overall evaluation results


In this section we present selected overall comparison charts. We use two main types of charts:

Please, read more about the charts and particular films in the report.

Depth Budget

Comparison of average depth budget

Depth budget distribution analysis

Vertical Disparity

Comparison of average vertical disparity

Color Mismatch

Comparison of average color mismatch

Color mismatch values distribution


Publications


When you want to make a reference to this project, please refer one of the following publications:

  1. Mikhail Erofeev, Dmitriy Vatolin, Alexander Voronov, Alexey Fedorov,
    “Toward an Objective Stereo-Video Quality Metric: Depth Perception of Textured Areas,” [pdf]
    International Conference on 3D Imaging (IC3D),
    pp. 1–6, 2012. doi:10.1109/IC3D.2012.6615120
  2. D. Akimov, A. Shestov, A. Voronov, D. Vatolin,
    “Automatic Left-Right Channel Swap Detection,” [pdf]
    International Conference on 3D Imaging (IC3D),
    pp. 1–6, 2012. doi:10.1109/IC3D.2012.6615126
  3. A. Voronov, A. Borisov, D. Vatolin,
    “System for Automatic Detection of Distorted Scenes in Stereo Video,” [pdf]
    Proceedings of the Sixth International Workshop on Video Processing and Quality Metrics (VPQM),
    2012.
  4. A. Voronov, D. Vatolin, D. Sumin, V. Napadovsky, A. Borisov,
    “Towards Automatic Stereo-video Quality Assessment and Detection of Color and Sharpness Mismatch,” [pdf]
    International Conference on 3D Imaging (IC3D),
    pp. 1–6, 2012. doi:10.1109/IC3D.2012.6615121
  5. A. Voronov, D. Vatolin, D. Sumin, V. Napadovsky, and A. Borisov,
    “Methodology for stereoscopic motion-picture quality assessment,” [pdf]
    Proc. SPIE 8648, Stereoscopic Displays and Applications XXIV,
    vol. 8648, pp. 864810-1–864810-14, March 2013. doi:10.1117/12.2008485
  6. A. Bokov, D. Vatolin, A. Zachesov, A. Belous, and M. Erofeev,
    “Automatic detection of artifacts in converted S3D video,” [pdf]
    Proc. SPIE 9011, Stereoscopic Displays and Applications XXV,
    vol. 9011, pp. 901112-1–901112-14, March 2014. doi:10.1117/12.2054330

Reports overview


Stereo-analysis project description

Report 1 (S3D shooting quality analysis of 5 movies)

Release date: March 7, 2013

Download (Additional info for bloggers and press)

Pages: 246;   Figures: 295

Film list:

  • Pirates of the Caribbean: On Stranger Tides
  • Resident Evil: Afterlife
  • Step Up 3D
  • Galapagos: The Enchanted Voyage
  • Into the Deep

Film list:

  • Dolphin Tale
  • Drive Angry
  • Hugo
  • The Three Musketeers
  • Sanctum

Film list:

  • Alice in Wonderland
  • Clash of the Titans
  • Conan the Barbarian
  • Green Lantern
  • Abraham Lincoln: Vampire Hunter

Report 4 (S3D shooting quality analysis of 5 movies)

Release date: October 1, 2013

Download

Pages: 301;   Figures: 402

Film list:

  • A Very Harold & Kumar 3D Christmas
  • Pina
  • Step Up Revolution
  • Resident Evil 5: Retribution
  • The Amazing Spider-Man

Film list:

  • The Avengers
  • The Chronicles of Narnia: The Voyage of the Dawn Treader
  • Gulliver’s Travels
  • Immortals
  • Wrath of the Titans

Report 6 (Stereo Window analysis of 10 movies)

Release date: September 10, 2014

Download (Additional info for bloggers and press)

Pages: 415;   Figures: 455

Film list:

  • The Amazing Spiderman
  • The Three Musketeers
  • Pirates of the Caribbean: On Stranger Tides
  • Dolphin Tale
  • Drive Angry
  • The Avengers
  • John Carter
  • G-Force
  • Abraham Lincoln: Vampire Hunter
  • Clash of the Titans

Report 7 (Stereo Window analysis of 10 movies)

Release date: October 22, 2014

Download (Additional info for bloggers and press)

Pages: 333;   Figures: 348

Film list:

  • Pina
  • Step Up Revolution
  • Resident Evil: Retribution
  • Hugo
  • Immortals
  • A Very Harold & Kumar 3D Christmas
  • Green Lantern
  • Conan the Barbarian
  • Wrath of the Titans
  • Alice in Wonderland

Film list:

  • A Very Harold & Kumar 3D Christmas
  • Abraham Lincoln: Vampire Hunter
  • The Avengers
  • Alice in Wonderland
  • Conan the Barbarian
  • The Chronicles of Narnia: The Voyage of the Dawn Treader
  • Clash of the Titans
  • Drive Angry
  • Dolphin Tale
  • Galapagos: The Enchanted Voyage
  • Green Lantern
  • Gulliver's Travels
  • Hugo
  • Immortals
  • Into the Deep
  • Pirates of the Caribbean: On Stranger Tides
  • Pina
  • Resident Evil: Afterlife
  • Resident Evil: Retribution
  • Sanctum
  • Step Up 3D
  • Step Up Revolution
  • The Amazing Spider-Man
  • The Three Musketeers
  • Wrath of the Titans

Report 9 (Temporal Shift, Stuck-to-Background Objects, 2D to S3D conversion in Captured Films)

Approximate release date: 1st quarter of 2016

The film list includes 105 movies

Report 10 (Overall analysis of 105 movies)

Approximate release date: 2nd-3rd quarter of 2016

The film list includes 105 movies


Download


Full report (305 pages) is absolutely free but download is available only for industry professionals (due to publication of real mistakes in the post-production process).

To download the report, please fill-in the request form.
You will get the download link for all reports (Reports #1–5) via e-mail.

All materials in this evaluation are used for research purposes and in accordance with Fair Use conditions. This evaluation is not published widely, but it is available for free under a subscription for stereoscopy and cinema technology professionals.


Contacts


For questions and proposition please contact us  
Video resources:

Bookmark this page:   Add to Del.icio.us Add to Del.icio.us     Digg It Digg It     reddit reddit


 
Last updated: 14-April-2014

Search (Russian):
Server size: 8069 files, 1215Mb (Server statistics)

Project updated by
Server Team and MSU Video Group


Project sponsored by YUVsoft Corp.

Project supported by MSU Graphics & Media Lab

Rambler's Top100 @Mail.ru