Hot news:

If you find a spelling error, please select an incorrect text and press Ctrl+Enter. Thank you!

Compression project >> Video Area Home

MSU Graphics & Media Lab Report #5 on stereo films quality assessment

April 11.—The stereo 3D (S3D) film industry is now experiencing a drop in interest. Some people even think that the industry is dying and has no future. And a key factor in its decline is the poor quality of the 3D content which causes eyestrain and sometimes even severe headaches and nausea. The Graphics & Media Lab CMC of Lomonosov Moscow State University (further: the Lab) in cooperation with IITP RAS decided to investigate this problem.

The Lab already has over 10 years of experience in comprehensive analysis of quality of compressed video. In the area of 3D video quality it has already released 4 reports since March 2013 presenting the evaluation of 20 S3D films altogether.

Download the report

The 1, 2, 4 reports were focused on films captured with stereoscopic camera systems, and the main problems discovered during the film analysis were:


Image #1: Example of the vertical disparity
(Image source: http://www.compression.ru/video/vqmt3d/press-releases/report5/images/vertical_disparity.gif)

Third report was dedicated to quality analysis of 2D-3D conversion which introduces a lot of new problems that are absent in captured S3D video. The analysis included the following common converted S3D video issues:


Image #2: Example of the edge-sharpness mismatch
(Image source: http://www.compression.ru/video/vqmt3d/press-releases/report5/images/esm.gif)

The Lab received a lot of positive comments from professional stereographers on these reports and was encouraged to continue the work on stereo film evaluation. The next two reports will be dedicated to the analysis of a stereo-window violation effect, which may be especially annoying in the more visible parts of the image. This issue appears in both captured and converted S3D films.

And now we would like to introduce the fifth report, in which the analysis of converted S3D films quality was continued. The report includes the following films:

The main new feature introduced in this report is the analysis for inconsistencies between stereo disparity and motion, which enables the automated detection of shots where inaccurate depth map was used for 2D-3D conversion (Image #3).


Image #3: Example of the inaccurate depth map use
(Image source: http://www.compression.ru/video/vqmt3d/press-releases/report5/images/inaccurate_depth.gif)

The overall comparison of films in the report includes all 25 films analyzed in this or previous reports.

Depth Budget

The report also provides the depth budget chart for both converted S3D films and captured ones (Image #4). It's clear from this chart that converted S3D films tend to have lesser depth budgets than those of captured films.


Image #4: Depth Budget vs. Release Date
(Image source: http://www.compression.ru/video/vqmt3d/press-releases/report5/images/depth_budget.png)

Vertical Disparity

It's also noticeable that converted S3D films generally have better vertical alignment than captured S3D films (Image #5). In fact, Wrath of the Titans has the best vertical alignment among the processed films.


Image #5: Vertical Disparity vs. Release Date
(Image source: http://www.compression.ru/video/vqmt3d/press-releases/report5/images/vertical_disparity.png)

Color mismatch

The same refers to color mismatch: the converted S3D films generally have much better color alignment between the left and right stereoscopic images (Image #6). However, color mismatch still appears in converted S3D films and it turned out that color mismatch in Gulliver's Travels is stronger than in Clash of the Titans.


Image #6: Color Mismatch vs. Film Budget
(Image source: http://www.compression.ru/video/vqmt3d/press-releases/report5/images/color_mismatch.png)

Comparison of 2D & S3D versions

The report also contains a comparison of 2D & S3D versions of all five films. This research has several goals:

Acknowledgements

We would like to thank the following people for providing valuable comments, opinions and feedback, which helped to improve this report:

A key motive of this report is to improve the stereo quality and therefore to reduce eyestrain and headache. The Lab hopes, that a high 3D video quality would contribute to a continually increasing number of people, leaving the modern theaters without annoyance and with good impressions from the image quality and storytelling. If you are concerned about this problem too, please feel free to share the VQMT3D project homepage link. The next reports on 3D quality will be published in the near future on the web-site http://compression.ru/video/vqmt3d/.

For press

Reports overview

Stereo-analysis project description

Report 1 (S3D shooting quality analysis of 5 movies)

Release date: March 7, 2013

Download (Additional info for bloggers and press)

Pages: 246;   Figures: 295

Film list:

  • Pirates of the Caribbean: On Stranger Tides
  • Resident Evil: Afterlife
  • Step Up 3D
  • Galapagos: The Enchanted Voyage
  • Into the Deep

Film list:

  • Dolphin Tale
  • Drive Angry
  • Hugo
  • The Three Musketeers
  • Sanctum

Film list:

  • Alice in Wonderland
  • Clash of the Titans
  • Conan the Barbarian
  • Green Lantern
  • Abraham Lincoln: Vampire Hunter

Report 4 (S3D shooting quality analysis of 5 movies)

Release date: October 1, 2013

Download

Pages: 301;   Figures: 402

Film list:

  • A Very Harold & Kumar 3D Christmas
  • Pina
  • Step Up Revolution
  • Resident Evil 5: Retribution
  • The Amazing Spider-Man

Film list:

  • The Avengers
  • The Chronicles of Narnia: The Voyage of the Dawn Treader
  • Gulliver’s Travels
  • Immortals
  • Wrath of the Titans

Report 6 (Stereo Window analysis of 10 movies)

Release date: September 10, 2014

Download (Additional info for bloggers and press)

Pages: 415;   Figures: 455

Film list:

  • The Amazing Spiderman
  • The Three Musketeers
  • Pirates of the Caribbean: On Stranger Tides
  • Dolphin Tale
  • Drive Angry
  • The Avengers
  • John Carter
  • G-Force
  • Abraham Lincoln: Vampire Hunter
  • Clash of the Titans

Report 7 (Stereo Window analysis of 10 movies)

Release date: October 22, 2014

Download (Additional info for bloggers and press)

Pages: 333;   Figures: 348

Film list:

  • Pina
  • Step Up Revolution
  • Resident Evil: Retribution
  • Hugo
  • Immortals
  • A Very Harold & Kumar 3D Christmas
  • Green Lantern
  • Conan the Barbarian
  • Wrath of the Titans
  • Alice in Wonderland

Film list:

  • A Very Harold & Kumar 3D Christmas
  • Abraham Lincoln: Vampire Hunter
  • The Avengers
  • Alice in Wonderland
  • Conan the Barbarian
  • The Chronicles of Narnia: The Voyage of the Dawn Treader
  • Clash of the Titans
  • Drive Angry
  • Dolphin Tale
  • Galapagos: The Enchanted Voyage
  • Green Lantern
  • Gulliver's Travels
  • Hugo
  • Immortals
  • Into the Deep
  • Pirates of the Caribbean: On Stranger Tides
  • Pina
  • Resident Evil: Afterlife
  • Resident Evil: Retribution
  • Sanctum
  • Step Up 3D
  • Step Up Revolution
  • The Amazing Spider-Man
  • The Three Musketeers
  • Wrath of the Titans

Report 9 (Temporal Shift, Stuck-to-Background Objects, 2D to S3D conversion in Captured Films)

Release date: January 18, 2017

Download (Additional info for bloggers and press)

Pages: 467;   Figures: 529

Over 100 films are in film list, including:

  • Creature from the Black Lagoon (1954)
  • World War Z (2013)
  • Dredd (2012)
  • Thor (2011)
  • The Hobbit: An Unexpected Journey (2012)
  • Life of Pi (2012)
  • Oz the Great and Powerful (2013)
  • The Legend of Hercules (2014)
  • Men in Black 3 (2012)
  • Dial M for Murder (1954)
  • Pirates of the Caribbean: On Stranger Tides (2011)
  • The Last Airbender (2010)
  • TRON: Legacy (2010)
  • Jack the Giant Slayer (2013)
  • The Great Gatsby (2013)
  • Pacific Rim (2013)
  • The Avengers (2012)

Report 10 (Overall analysis of 105 movies)

Approximate release date: 2nd-3rd quarter of 2017

The film list includes 105 movies


Contacts


For questions and proposition please contact us  

Video resources:

Bookmark this page:   Add to Del.icio.us Add to Del.icio.us     Digg It Digg It     reddit reddit


 
Last updated: 08-September-2014

Search (Russian):
Server size: 8069 files, 1215Mb (Server statistics)

Project updated by
Server Team and MSU Video Group


Project sponsored by YUVsoft Corp.

Project supported by MSU Graphics & Media Lab

Rambler's Top100 @Mail.ru