First we would like to thank for your help with performing this evaluation, we appreciate the effort you invest.
In the following test
you will be presented with sets of voice signals. First the original (reference), then a collection of resynthesis' obtained with different algorithms.
Your task is to rate the similarity of the resynthesis compared to the reference using a scale between 0 and 100.
General Instructions
Make sure you have the time to take the test in one sitting. It will take around 5 minutes.
Do the test in a quiet place.
Use headphones.
Verify that the sound level is loud enough
so that you can hear all details properly.
Use the following test sound to adjust your volume now.
Rating instruction
Listen first to the reference to understand the target.
Then listen to the other sounds and rate the similarity compared to the reference
on a scale from 0 to 100.
If there is any technical problem notably if the sound is not playing,
tick the box in the column Problem.
(but please note that it may take a few seconds for all sounds to load)
The task is to give your subjective impression of the amount of differences you perceive, so there is no right or wrong.
Possible differences are: Sound timbre/color, noise level, added clicks or noises, changes in the fundamental frequency or loudness contours.
Every difference you perceive should lead to a reduction, but if the difference is not annoying you should leave the slider above 60. !
Note: differences may be very subtle. Don't mind listen to the recordings multiple times if you are unsure.
The whole test should take about 5 minutes.
The grading with numbers should follow this table :