Hot news:

If you find a spelling error, please select an incorrect text and press Ctrl+Enter. Thank you!

Compression project >> Video Area Home
RUSSIAN

MSU Video Quality Measurement Tool

MSU Graphics & Media Lab (Video Group)

Projects, ideas: Dr. Dmitriy Vatolin
Implementation: Alexey Moskvin, Oleg Petrov, Sergey Putilin, Sergey Grishin, Arsaev Marat, Georgy Osipov


Basic Information About VQMT



What's new in MSU VQMT 10?


Download FREE non-commercial version with limitations or buy PRO.

Special offer for recent customers:
50% off! Know more...


Brief Description


Demo Video: Basic Use Case Overview

MSU Video Quality Measurement Tool (VQMT) is a program for objective video quality assessment. It provides functionality for both full-reference (two videos are examined) and single-reference (one video is analyzed) comparisons. Basic scheme of the tool is illustrated on below.

VQMT input and output VQMT input and output

Video quality is a characteristic of a video passed through a video transmission/processing system, a formal or informal measure of perceived video degradation (typically, compared to the original video). Video processing systems may introduce some amounts of distortion or artifacts in the video signal, so video quality evaluation is an important problem. MSU VQMT is a program for video quality measurements. This application allows you to create objective comparison of video codecs and perform video processing filters analysis.

Visualization examples Visualization examples for several metrics

Program allows to answer the next questions:

  1. One codec has more blurring than another. On what frames? Average mark? *
  2. One codec has more blocking than another. On what frames? Average mark? *
  3. One codec has lower quality than another. On what frames? Average mark in PSNR, VQM, SSIM? *
* Corresponding "bad frames" are saved automatically as BMP files.

Current stable version: 8.1 [Changelog]


Main Features

Feature FREE version PRO version
Flexible Functionality

The tool provides functionality for calculating:

  • metric values for each frame
  • average value for sequence
  • metric values for specific color component

GPU and other computing devices

The tool supports performing some metrics on CUDA compatible devices (nVIDIA video cards) and all other OpenCL compatible devices (wide set of video cards, CPUs, multicore systems)

Objective Metrics Support
  • PSNR (4 variations)
  • Delta
  • MSAD
  • MSE
  • SSIM (2 variations, GPU, OpenCL support)
  • MS-SSIM (2 variations, GPU, OpenCL support)
  • 3SSIM (GPU, OpenCL support)
  • stSSIM
  • VQM
  • MSU Blurring Metric
  • MSU Blocking Metric
  • MSU Brightness Flicking Metric – opensource plugin
  • MSU Brightness Independent PSNR – opensource plugin
  • MSU Drop Frame Metric – opensource plugin
  • MSU Noise Estimation Metric
  • MSU Scene Change Detector
Video and Image Formats Support
  • Video files: *.AVI, *.DAT, *.DIVX, *.F4V, *.FLV, *.H265, *.M2TS, *.M2V, *.M4V, *.MKV, *.MOV, *.MP4, *.MPG, *.MTS, *.MXF, *.OGM, *.OGV, *.QT, *.TS, *.VOB, *.WMV, *.265, *.3G2, *.3GP, *.3GPP and others
  • AviSynth: *.AVS
  • RAW files: *.YUV (scientific), *.Y4M
  • Image files and image sequences: *.BMP, *.CUT, *.DDS, *.EXR, *.G3, *.GIF, *.HDR, *.ICO, *.IFF, *.LBM, *.J2K, *.J2C, *.JNG, *.JP2, *.JPG, *.JIF, *.JPEG, *.JPE, *.JXR, *.WDP, *.HDP, *.MNG, *.PCD, *.PCX, *.PCT, *.PICT, *.PIC, *.PNG, *.PBM, *.PGM, *.PPM, *.PSD, *.RAS, *.SGI, *.RGB, *.RGBA, *.BW, *.TGA, *.TARGA, *.TIF, *.TIFF, *.WAP, *.WBMP, *.WBM, *.WEBP, *.XBM, *.XPM
ROI Support (via masking)

Allows to calculate metrics in Regions of Interest (ROI). ROI should be specified by additonal provided video with mask for each frame.

Metrics Visualization

Video visualization file is generated for combination [metric, color component, reference]. Color and luminance of each pixel in visuzalization video is defined by metric value in that pixel (very useful for codec and filter debugging).

Results in CSV format

Metrics results and average values are saved in set of *.CSV (comma-separated values) file which can be opened everywhere.

Results in JSON format

All metric results and information about file opening are saved in single JSON file or stdout of command line utility.

Comparative Analysis

Multiple references can be compared against the original simultaneously.

2 refs Unlim*
Professional Bit Depth Support

(over 8 bits per color component)

  • RAW files
    • P010 (10 bit 4:2:0 yuv)
    • P014 (14 bit 4:2:0 yuv)
    • P016 (16 bit 4:2:0 yuv)
    • P210 (10 bit 4:2:2 yuv)
    • P214 (14 bit 4:2:2 yuv)
    • P216 (16 bit 4:2:2 yuv)
    • P410 (10 bit 4:4:4 yuv)
    • P414 (14 bit 4:4:4 yuv)
    • P416 (16 bit 4:4:4 yuv)
    • P410_RGB (10 bit 4:4:4 rgb)
    • P414_RGB (14 bit 4:4:4 rgb)
    • P416_RGB (16 bit 4:4:4 rgb)
  • TIFF files with 16 and 32 bps

Batch Processing

VQMT provides GUI and command-line (CL) interfaces. It is possible using CL-tool to calculate several metrics for a given set of color components simultaneously and for more files (in parallel), thus achieving significant speed advantage comparing to case of using GUI tool.

Over HD Support

Processing of video with resolution equal or higher than 1280x720: HD, FullHD, 4K, 8K video.

Download FREE version Purchase PRO version
multiple references allowed in command line interface

Plots Examples


These plots were built in MATLAB, based on measurement results from MSU VQMT.

Results (1) Per-frame Y-PSNR for several codecs

Results (2) Y-PSNR dependency vs bitrate and frame number

Results (3) Average Y-PSNR for several codecs and bitrates

Results (4) Colored surface of Y-PSNR vs frame number and bitrate

Error (1) Example of the error in codec, detected with VQMT.
Plots examples Another examples of plots built based on VQMT output.

Comparison with Analogs


Comparison with Analogs

MSU VQMT
(not free for companies)

Elecard Video QuEst (commercial)

Video Quality Studio (freeware)

PSNR Checker (freeware)

Avisynth plugins (SSIM, VQM) (freeware)

Supported objective metrics 16 + 5 (plugins) + 3 (GPU) 8 3 1 2
Plug-ins interface YES NO NO NO NO
Comparative analysis (comparison of two codecs in one pass) YES NO NO NO NO
Supported input formats *.AVI, AviSynth (*.AVS), *.BMP, *.YUV, *.Y4M and other media formats (*.MOV, *.VOB, *.WMV, *.MP4, *.MPG, *.MKV, *.FLV, etc.) using AviSynth and automatic scripts generation Supports any video stream if compatible decoder supporting the YV12 or UYVY output is registered in the system AVI AVI Formats, supported by AviSynth
User interface GUI + command line (PRO) GUI GUI GUI Called from AviSynth scripts (you need to learn AviSynth scripting)
Automatically saving frames with maximum difference in quality YES NO NO NO NO
Plots with results of the comparison YES NO NO NO NO
Video with metric value visualization YES YES/NO NO NO NO


Contributors


Special thanks to following key contributors:
Show more...
Walt Disney Studios Intel Corporation Skype NASA Nvidia Corporation Apple Inc. Home Box Office, Inc. Microsoft Corporation Olympic Broadcasting Services 20th Century Fox Film Corporation Oracle Corporation Cisco Systems, Inc. Dolby Laboratories, Inc. Sony Computer Entertainment, Inc. Facebook, Inc. RealNetworks, Inc. QuickPlay Media, Inc. MediaTek, Inc. Fox Broadcasting Company NBCUniversal Ericsson Motorola Solutions, Inc. AVerMedia Technologies Inc. AMETEK, Inc. Sorenson Communications InterDigital Intuitive Surgical, Inc. TASER International, Inc. National Teleconsultants LLC Evertz Microsystems Limited Telestream, Inc University of Waterloo Simon Fraser University Wrocław University of Technology University of West Bohemia University of Vienna Fraunhofer-Institut für Digitale Medientechnologie IDMT Julius Maximilian University of Würzburg Federal University of Pará Hamburg University of Technology Analog Devices, Inc. Extron Electronics Lockheed Martin Exar Chips&Media, Inc. HDLogix, Inc. Comtronic Computer, Inc. Ittiam Systems VISLINK Whitney Medical Solutions Movidius Gaikai iMemories, Inc. Avaya Inc. Snell Ltd CEVA, Inc. Rockwell Collins, Inc. CDNetworks Elemental Technologies, Inc. Luxoft Smith Micro Software, Inc. BroadSoft Sky Deutschland AG Bell Media DirecTV Kaltura Netflix Inc. Vubiquity, Inc Telus Communications Beijing TL-Chinasoft Technology Co., Ltd Veset RGB Networks Burosch Audio-Video-Technik Telefónica, S.A. Allegro DVT Octasic Inc. Vlaamse Radio- en Televisieomroeporganisatie
Studios
Walt Disney Studios Home Box Office, Inc. Olympic Broadcasting Services 20th Century Fox Film Corporation Fox Broadcasting Company NBCUniversal
Hardware & Devices
Intel Corporation Nvidia Corporation Apple Inc. Cisco Systems, Inc. Sony Computer Entertainment, Inc. Dolby Laboratories, Inc. Ericsson Motorola Solutions, Inc. AMETEK, Inc. Evertz Microsystems Limited Telestream, Inc Analog Devices, Inc. Extron Electronics Lockheed Martin Exar Chips&Media, Inc. HDLogix, Inc. Comtronic Computer, Inc.
Software & Solutions
Skype Microsoft Corporation Oracle Corporation Facebook, Inc. QuickPlay Media, Inc. MediaTek, Inc. RealNetworks, Inc. AVerMedia Technologies Inc. Ittiam Systems Elemental Technologies, Inc. Luxoft Smith Micro Software, Inc. BroadSoft
Education
University of Waterloo Simon Fraser University Wrocław University of Technology University of West Bohemia University of Vienna Fraunhofer-Institut für Digitale Medientechnologie IDMT Julius Maximilian University of Würzburg Federal University of Pará Hamburg University of Technology
Television & Media Industry
Sky Deutschland AG Bell Media DirecTV Kaltura Netflix Inc. Vubiquity, Inc Telus Communications Beijing TL-Chinasoft Technology Co., Ltd Veset RGB Networks Burosch Audio-Video-Technik Telefónica, S.A. Allegro DVT Octasic Inc. Vlaamse Radio- en Televisieomroeporganisatie
Others
Sorenson Communications InterDigital Intuitive Surgical, Inc. TASER International, Inc. National Teleconsultants LLC VISLINK Whitney Medical Solutions Movidius Gaikai iMemories, Inc. Avaya Inc. Snell Ltd CEVA, Inc. Rockwell Collins, Inc. CDNetworks
Show less

Testimonials


We have testimonials from the following big companies: Small companies: And universities:

Changelog



MSU Video Quality Measurement Tools



Contacts


e-mail: 


Other Resources


Video resources:

Bookmark this page:   Add to Del.icio.us Add to Del.icio.us     Digg It Digg It     reddit reddit

 
Last updated: 10-May-2017

Search (Russian):
Server size: 8069 files, 1215Mb (Server statistics)

Project updated by
Server Team and MSU Video Group


Project sponsored by YUVsoft Corp.

Project supported by MSU Graphics & Media Lab