Abstract:Absrtact: Although ECO algorithm has greatly improved the tracking effect, it does not perform well in complex scenes and even loses the target, that is, its robustness is not high. In this regard, this paper discusses how to improve the robustness of ECO algorithm by using the ability of deep feature to process deep semantics and the ability of shallow feature to process texture color information. At the same time, it compares the different functions of depth feature and shallow feature in target tracking, and puts forward an improved method, Firstly, resnet-101 network with deeper level is selected on the deep network; Secondly, the parameters suitable for this network are modified. The experiment of the algorithm in otb-2015 also achieved good results,The success rates of low resolution, background clutter, illumination change and scale change are 0.135, 0.034, 0.031 and 0.024 respectively.