A short quiz on vision system evaluation

Adrian F. Clark

  1. When evaluating vision systems, it is normal to:

  2. You are developing a automatic passport system for use by immigration, where pictures of people are compared to those in their passports. Which of the following is the best approach to take?

  3. Which test is most appropriate for comparing algorithms' performances?

  4. What do we do if we want to see if one algorithm's performance is better than another's ?

  5. What assumption underlies a null hypothesis test?

  6. What is `ground truth'?

  7. You are developing software for the Police to show mugshots of suspects to the witness of a crime. Which of the following is the best approach to take?

  8. Which corner of a ROC curve indicates the best performance?

  9. What are the axes of a ROC curve?

  10. What do we do if we want to see if algorithms' performances differ?

  11.