In order to solve the challenges of standard Kalman filter in INS/GNSS/ visual embedded navigation system, such as parameter adjustment based on experience, suboptimal convergence performance and sensitivity to noise statistical changes, an automatic parameter optimization method based on improved glowworm algorithm is proposed. In order to solve the parameter optimization problem in multi-sensor fusion navigation system, Lévy flight mechanism is introduced into glowworm algorithm, and the characteristics of long tail distribution are used to increase population diversity and improve the overall search ability. In addition, by designing an adaptive parameter adjustment strategy, the dynamic balance between the process of algorithm exploration and utilization can be realized, and a better individual retention mechanism can be introduced to effectively inhibit the degradation of the optimal solution.Based on this and utilizing the statistical properties of innovative sequences, fitness functions for the covariance matrix of the combined real-time optimization process noise Q and the covariance matrix of the observed noise R have been developed. This will significantly improve the efficiency of global navigation and the convergence performance of the algorithm. Simulation results show that the optimization algorithm not only outperforms traditional Kalman filters in terms of position and attitude estimation accuracy but also enhances convergence speed and further improves system stability and robustness, paving the way for automatic parameter adaptation in a multi-sensor fusion navigation system.