Currently, the management system of electronic shelf label is mainly deployed on the computer. Considering the shortages of computer fixed position and using keyboard and mouse, such as low flexibility and limited processing efficiency, the paper designed a management system based on the Android platform and speech recognition technology to improve the portability and efficiency of the operation. The experiment results shows that the speech management system can manage the ESL by a high recognition performance and operating efficiency way. And this is not only conducive to the promotion and application of electronic shelf label, but also provides a reference for the application to other control areas.