In MacOSx x64 it was getting a memory leak even without initializing points: http://code.opencv.org/issues/4250