WP2050 - Subjective Testing System

[drowe67]

Develop a subjective testing system, e.g. paired comparison tests, P808, or MUSHRA, in order to evaluate the speech quality of new Codec 2 modes.

• Decide on test methodology, "P.808 : Subjective evaluation of speech quality with a crowdsourcing approach" looks promising.
• Can it be run online, e.g. off a web site? It should at least be easily reproducible by groups of Ham in other countries, to perform language specific testing.
• Can we develop and run such a system with modest resources available?
• Develop software to run test and statistical post processing
• Document how to install and run the tests (e.g. for Hams in other countries)
• Practice run