Abstract:In view of the difficulties in tracking the overlapping targets in traffic surveillance scene and the difficulty of the vehicle correlation in two consecutive frames, the solutions of the region motion similarity segmentation and the similarity correlation matrix are proposed,background substraction is used for detecting targets,after eliminating gaps, holes and separation, etc. ,motion vector is calculated in the motion region by block matching search and local optical flow method, and then the fuzzy clustering method is used to implement the regional integration of motion vectors, which completes adhesion segmentation of the moving target, and reduces the amount of computation.In the part of tracking, target tracking is established on the basis of the target correlation, and the target matching is completed by using similarity correlation matrix of distance and local binary pattern features between frames , so as to realize the multiple target correlation. By using image sequences in PETS to test, The proposed algorithm can achieve continuous tracking and accurate target segmentation,and the processing speed is fast,which shows that the algorithm is robust and applicable.