When evaluating vision systems, it is normal to:

- train on all data but test on only the test set
have different training and test sets

- train on the training set and test using both training and test sets
- use the same training and test sets

You are developing a automatic passport system for use by immigration, where pictures of people are compared to those in their passports. Which of the following is the best approach to take?

- minimize the number of false negatives
- maximize the number of true positives, even if the false positive rate is high
- maximize the number of true positives
minimize the number of false positives

What is `ground truth'?

data known to be correct

- values obtained by an algorithm that are known to be true
- the true values obtained by an algorithm
- images of the ground

What are the axes of a ROC curve?

TP and FP

- FP and FN
- TP and FN
- TP and TN

What assumption underlies a null hypothesis test?

- that the algorithms don't work
- that the algorithms differ in performance
that there is no performance difference between algorithms

- that the algorithms return a null result

What is a false positive?

- A false result from an algorithm
- A positive result that is false
A true result from an algorithm that is incorrect

- A false result from an algorithm that should be correct

Which test is most appropriate for comparing algorithms' performances?

- Laplace's test
McNemar's test

- Canny's test
- Gauss's test

What is a false negative?

- A false result from an algorithm that should be negative
A false result from an algorithm that should have succeeded

- A negative result that is false
- A false result from an algorithm

You are developing software for the Police to show mugshots of suspects to the witness of a crime. Which of the following is the best approach to take?

- maximize the number of true positives
maximize the number of true positives, even if the false positive rate is high

- minimize the number of false positives
- minimize the number of false negatives

What do we do if we want to see if one algorithm's performance is better than another's ?

- Look up the Z-score in binomial tables
- Look up the Z-score in Normal distribution tables
Look up the Z-score in one-tailed tables

- Look up the Z-score in two-tailed tables