Video Area Home >> Video-Codec Comparisons >> HEVC/AV1 Video Codecs Comparison 2020

MSU UGC Subjective Express Comparison 2020

Video group head: Dr. Dmitriy Vatolin
Project head: Dr. Dmitriy Kulikov
Measurements, analysis: Dr. Mikhail Erofeev,
Anastasia Antsiferova,
Egor Sklyarov,
Alexander Yakovenko,
Nickolay Safonov

Navigation


Description


In MSU UGC Subjective Express Comparison 2020, we analyzed 8 software codecs on UGC content.

For both parts of the report, 10 sequences were selected from YouTube UGC dataset. For objective report we used SSIM, PSNR and VMAF. In the subjective part of the report we conducted an experiment on the Subjectify.us platform.

According to the results of the research, PAV1 outperforms other codecs by YUV-SSIM, while Kingsoft is the best by Y-VMAF and subjective score.

Objective Subjective
Best quality
(YUV-SSIM)
  1. PAV1
  2. x265
  3. SVT-AV1
YUV-Subjective:
  1. Kingsoft
  2. PAV1
  3. x265
Best quality
(Y-VMAF)
  1. Kingsoft
  2. D265
  3. x265
Best quality
(YUV-PSNR avg. MSE)
  1. D265
  2. x265
  3. PAV1

Download

UGC Express Report
Objective comparison of hardware-accelerated video encoders
Released on December, 19



Full version for free
8 encoders
PAV1, Kingsoft, D265, SVT-AV1, SVT-HEVC, SVT-VP9, x264, x265
10 FullHD video sequences from YouTube UGC
1 fps encoding
Objective and subjective comparisons
HTML report
900+ interactive charts

Participated codecs

Codec name
1 PAV1
2 Kingsoft
3 D265
4 SVT-AV1
5 SVT-HEVC
6 SVT-VP9
7 x264
8 x265

Comparison Rules


HEVC codec testing objectives

The main goal of this report is the presentation of a comparative evaluation of the quality of new HEVC codecs and codecs of other standards using objective measures of assessment. The comparison was done using settings provided by the developers of each codec. Nevertheless, we required all presets to satisfy minimum speed requirement on the particular use case. The main task of the comparison is to analyze different encoders for the task of transcoding video – e.g., compressing video for personal use.

Test Hardware Characteristics

  • CPU: Intel Socket 1151 Core i7 8700K (Coffee Lake) (3.7Ghz, 6C12T, TDP 95W)
  • Mainboard: ASRock Z370M Pro4
  • RAM: Crucial CT16G4DFD824A 2x16GB (totally 32 GB) DIMM DDR4 2400MHz CL15
  • OS: Windows 10 x64

Videos

For this comparison we used video sequences from YouTube UGC dataset.

Name Category Resolution Full ID
blue_hair Vlog 1080P Vlog_1080P-35cd
boys Vlog 1080P Vlog_1080P-52fe
game_streamer Gaming 1080P Gaming_1080P-6db2
happy_dog Vlog 1080P Vlog_1080P-5904
light_show CoverSong 1080P CoverSong_1080P-1b0c
mountain_dog Vlog 1080P Vlog_1080P-23cb
pool_underwater Vlog 1080P Vlog_1080P-4921
pumba Vlog 1080P Vlog_1080P-21f5
tourist Vlog 1080P Vlog_1080P-1df9
winter_riding Vlog 1080P Vlog_1080P-2600

Codec Analysis and Tuning for Codec Developers and Codec Users


Computer Graphics and Multimedia Laboratory of Moscow State University:

  • 15+ years working in the area of video codec analysis and tuning using objective quality metrics and subjective comparisons.
  • 27+ reports of video codec comparisons and analysis (H.265, H.264, AV1, VP9, MPEG-4, MPEG-2, decoders' error recovery).
  • Methods and algorithms for codec comparison and analysis development, separate codec's features and codec's options analysis.

We could perform next tasks for codec developers and codec users.

Strong and Weak Points of Your Codec

  • Deep encoder parts analysis (ME, RC on GOP, mode decision, etc).
  • Weak and strong points for your encoder and complete information about encoding quality on different content types.
  • Encoding Quality improvement by the pre and post filtering (including technologies licensing).

Independent Codec Estimation Comparing to Other Codecs for Different Use-cases

  • Comparative analysis of your encoder and other encoders.
  • We have direct contact with many codec developers.
  • You will know place of your encoder between other newest well-known encoders (compare encoding quality, speed, bitrate handling, etc.).

Encoder Features Implementation Optimality Analysis

We perform encoder features effectiveness (speed/quality trade-off) analysis that could lead up to 30% increase in the speed/quality characteristics of your codec. We can help you to tune your codec and find best encoding parameters.

Thanks


Special thanks to the following contributors of our previous comparisons
Google Intel AMD NVidia
ATI Adobe ISPhone dicas
KDDI R&D labs Dolby Tata Elxsi Octasic
Qualcomm Voceweb Elgato Telecast
Huawei MainConcept Vitec Tencent

Leave a feedback



Contact Information



compression.ru
in cooperation
with
Lomonosov MSU
Graphics & Media Lab
(Video Group)
Dubna State University
Institute for Information
Transmission Problems RAS

Subscribe to report updates



Materials about MSU Codec Comparison


See all MSU Video Codecs Comparisons

MSU video codecs comparisons resources:


Other Materials


Video resources:

Last updated: 11-October-2021


Server size: 8069 files, 1215Mb (Server statistics)

Project updated by
Server Team and MSU Video Group

Project sponsored by YUVsoft Corp.

Project supported by MSU Graphics & Media Lab