The advancement of technology in educational contexts, especially through the use of mobile devices and applications, has significantly transformed the educational landscape. For these reasons, the objective was to evaluate the level of agreement among the evaluators on a mobile application designed to learn the basic concepts of music. To this end, a methodology based on the Intraclass Correlation Coefficient (ICC) and ANOVA analysis with Friedman as the main analysis techniques was used. The study used a specific instrument to evaluate mobile music education apps. The sample was composed of 60 music teachers, of which 28 were university professors and 32 were primary school teachers. The results showed a high level of agreement among all the assessors, demonstrating strong consistency and reliability in the evaluations carried out. These findings support both the robustness of the evaluations issued on the mobile application and the high reliability of the instrument used for its evaluation.