An algorithm for automatically tracking moving multiple objects that cross in the field of view of a tracking and measuring television system is presented in this paper.This algorithmincludes tracking tactics
a judgement on the overlapped and separated moment of these objects
and the affiration of the correspondence relationship between these object’s images.The least square method is used for calculating the direction of each object’s movement.