On the method of caustics: An exact analysis based on geometrical optics