Video group head: Dr. Dmitriy Vatolin Project head: Dr. Dmitriy Kulikov Measurements, analysis: Nickolay Safonov, Nikita Alutis, Ekaterina Shumitskaya, Mikhail Voronin, Dr. Mikhail Erofeev, Anastasia Antsiferova, Egor Sklyarov, Alexander Gushin
compression.ru	Lomonosov Moscow State University (MSU) Graphics and Media Lab	Dubna International State University	Institute for Information Transmission Problems, Russian Academy of Science

Important Dates

Navigation

• News
• About
• 2022 Comparison parts
• New features
• Comparison Rules and Methodology
• Frequently asked question (FAQ)
• Participate
• Feedback
• Thanks
  
• Contact

News

• 26.07.2023 - New preset requirements for 4K comparison
• 26.07.2023 4K comparison application deadline changed to July, 30
• 26.06.2023 - New preset requirements for 4K comparison
• 10.10.2022 - New preset requirements for FullHD and FPGA comparisons
• 18.08.2022 - Subjective comparison application deadline changed
• 26.07.2022 - FullHD, Subjective and FPGA comparisons application deadlines changed
• 26.07.2022 - Changed in methodology
• 22.07.2022 - New preset requirements for FullHD comparison
• 14.07.2022 - New preset requirements for FullHD comparison
• 10.07.2022 - FullHD and Subjective comparisons application deadline changed
• 16.06.2022 - Preset requirements have been updated

About Annual MSU Video Codecs Comparisons

We perform comparative unbiased analysis for

• software implementations
• hardware (GPU-based) implementations
• cloud-based implementations

With MSU Codecs Comparison developers can verify the performance of their codec. We share test sequences, encoding parameters and codecs versions so all developers can reproduce the results of the comparison. Participation with publishing of all results is for FREE. Private participation is for fee (contact us for the details).

• There were more than 400.000 downloads of previous H.264/MPEG-4 AVC and H.265/HEVC video codec comparisons reports
• Many codecs' bugs were found and reported to developers
• 210+ encoders were tested
• More than 35 private reports for codec developers (description of codec's weak and strong points) after public report versions

• Objective measurements
• Subjective analysis
• Encoding time
• Speed/Quality trade-off analysis
• Averaged objective results analysis
• Leaders in different use cases

2022 Comparison parts and requirements

New features in MSU Video Codecs Comparison

Comparison Rules and Methodology

• Decoding is performed with reference decoder (H.264/AVC, H.265/HEVC, VP9, AV1). For other standards participants should provide decoder
• We don't limit GOP size and intra-period
• We don't limit number of passes in the encoding. Total encoding time should fulfill use case speed requirements

• Presets for different speed requirements should be provided by the developers
• Codec should allow to set arbitrary bitrate of resulting stream in constant quality mode
• Preferable codec interface - console codec version (with batch processing support - bitrate and file names must be possible to assign from the command line)
• Encoder should be compatible with reference decoder, for encoders of custom standards a decoder should be provided

• Codec files (CLI executable file is preferable)
• Codec's presets

1. Prepare encoder. After your application, we send you instructions on how to prepare encoding presets for this year testing use cases (there are limitations for speed) and login for a submission system.
2. Submission. You send us encoder and presets (our hardware characteristics can be found on the comparison page). Testing methodology is described in presentation.
3. Speed and quality pre-check. We test the speed of your encoder. We let you know if some speedup is needed or any bugs are found. If the requirements are not satisfied, you submit an updated version and we test it again. Finally, when all requirements are satisfied, you confirm the usage of presets and encoder.
4. Measurements. We perform the main measurements on this year test video set and prepare a draft of the report. This will take about 1-3 months depending on the number of participants.
5. Draft report and verification. We send you a draft report with your results and the results of other public participants. You can double-check the results. If you participate privately, in this step you will need to decide whether you will publish your results.
6. Report release. After your confirmation, we prepare and publish the final report on the comparison page. We send you the Enterprise version of the report (with all sequences, charts, etc.).

Thanks

Contact Information

Other Materials