Traditional block motion compensations only use single motion vector field, There are some movement abnormalities in the motion vector field, The excessive movement abnormalities declines quality of interpolated frame. In order to solve this problem, a side information prediction algorithm based on joint motion compensation is proposed. The method uses bidirectional motion estimation to calculate motion vector field of the interpolated frame, then it uses motion vector of the current block and its eight neighboring block to joint predict the target block. The motion vector of the eight neighboring block very closes to the true motion vector of the current interpolated block, because of local smoothing feature of motion vector field. The results show the proposed algorithm improves the fault-tolerance of motion compensation.