Evaluation of CNN Models with Transfer Learning in Art Media Classification in Terms of Accuracy and Class Relationship



Título del documento: Evaluation of CNN Models with Transfer Learning in Art Media Classification in Terms of Accuracy and Class Relationship
Revista: Computación y sistemas
Base de datos:
Número de sistema: 000607881
ISSN: 1405-5546
Autores: 1
2
2
3
2
Instituciones: 1Instituto Tecnológico de San Luís Potosí, Tecnológico Nacional de México, San Luís Potosí. México
2Universidad Autónoma de San Luís Potosí, Facultad de Ingeniería, México
3Universidad del Mar, Instituto de Industrias, México
Año:
Periodo: Ene-Mar
Volumen: 28
Número: 1
Paginación: 233-244
País: México
Idioma: Inglés
Resumen en inglés The accuracy obtained in Art Media Classification (AMC) using CNN is lower compared to other image classification problems, where the acceptable accuracy ranges from 90 to 99%. This article presents an analysis of the performance of three different CNNs with transfer learning for AMC, to answer the question of what challenges arise in this application. We proposed the Art Media Dataset (ArtMD) to train three CNNs. ArtMD contains five classes of art: Drawing, Engraving, Iconography, Painting, and Sculpture. The analysis of the results demonstrates that all the tested CNNs exhibit similar behavior. Drawing, Engraving, and Painting had the highest relationship, showing a strong relationship between Drawing and Engraving. We implemented two more experiments, removing first Drawing and then Engraving. The best performance with 86% accuracy was achieved by removing Drawing. Analysis of the confusion matrix of the three experiments for each CNN confirms that Drawing and Painting have the lowest accuracy, showing a strong misclassification with the other classes. This analysis presents the degree of relationship between the three CNN models and details the challenges of AMC.
Keyword: Art media classification,
Convolutional neural networks,
Transfer learning
Texto completo: Texto completo (Ver PDF) Texto completo (Ver HTML)