Tracking Lucas Kanade

Hi Developers, I using calcOpticalFlowPyrLK, I already have the previous and following points, I to keep track of the object have the following points. the following points the rest with dots of detected objects if the subtraction is less than 2, I say that it is the object. I hope I can help. Best regards