A quiz on the stereo experiment

Adrian F. Clark

1. How does calibrate.py process the images?

   • in RGB space
   • in BGR space

   • as grey-scale ones

   • in HSV space

   The program converts input images to grey-scale before passing them to the routine to find corners.

2. Why does the chessboard pattern have different numbers of squares in the x- and y-directions?

   • to remove any ambiguities over its orientation

   • to ensure there are enough corners
   • so that it prints on a sheet of A4 paper
   • there is no particular reason

   The number of squares differ so that the software can determine that the target has been rotated.

3. How close is the reconstruction by camera calibration to the correct result?

   • well within the error bounds

   • exactly correct
   • nothing like correct
   • within two times the error bounds

   My own calculation from measuring the nose position in the two images was 485.33 and the calibration yielded $(484.66 \pm 1.31)$. The two agree to well within the error (uncertainty) from the calibration, and that will be much less than the uncertainty in the estimation of the nose position.

4. What is the pattern on a calibration target?

   • a chessboard

   • a set of concentric circles
   • a set of plus-shaped lines
   • a QR code

   Camera calibration usually makes use of a chessboard pattern, though the number of black and white squares does not necessarily match the number on a chessboard. It is used because it is fairly easy to detect and the edges between squares allow sub-pixel accuracy to be found.

5. What is estimated by the camera calibration process?

   • the spacing between pixels
   • the baseline of the stereo imaging system
   • the disparity

   • the focal length of the camera

   Camera calibration, at least as used here, estimates the focal length.

6. How is the error (uncertainty) in the focal length estimated by calibrate.py?

   • from the locations of the corners
   • from the accuracy of the located corners

   • the difference between horizontal and vertical focal lengths

   • from the regularity of the spacing of detected corners

   The code in the program uses the difference between the horizontal and vertical focal lengths as an estimate of the uncertainty.

7. How were the synthetic images of Candide created?

   • using Unity

   • using POV-ray

   • using Blender
   • using OpenGL

   The Candide model is rendered using POV-ray, a freely-available, high-quality rendering package based around ray-tracing technology. It is far from being real-time but does (or rather can, for we wouldn't describe the appearance of Candide as being photo-realistic) produce high-quality output. Its most important characteristic for computer vision is that it is driven by a kind of programming language, so one can write scripts to generate POV-ray input files, which is what was done here.

8. When calculating the position of Candide's nose in 3D, what contributes most to its error (uncertainty)?

   • position of her nose

   • the pixel spacing
   • the focal length
   • the baseline

   The error (uncertainty) in estimating the position of her nose is by far the least accurate quantity measured, so this is largely what influences the accuracy of the overall result.

9. What is the main purpose of this experiment?

   • to explore the use of computer vision on 3D problems
   • to allow us to practise how error (uncertainty) propagation
   • to see how to match corners

   • to find out how accurate the camera calibration functionality in OpenCV is

   The real reason for this experiment is to ascertain whether the ability to calibrate the camera leads to accurate 3D reconstruction. The technique is very widely used in the games and movie industries for capturing human motion, and also finds important application in the medical world for capturing body shape for making prosethics. It is, of course, used in vision-guided robotics too.

10. What is the maximum number of iterations allowed in calibrate.py?

    • 30

    • 50
    • 100
    • 10

    The definition of term_crit permits up to 30 iterations, admittedly a fairly arbitrary choice.