Cross-Domain Failures of Fake News Detection



Título del documento: Cross-Domain Failures of Fake News Detection
Revue: Computación y sistemas
Base de datos:
Número de sistema: 000560441
ISSN: 1405-5546
Autores: 1
1
1
Instituciones: 1Samsung R&D Institute Poland, Varsovia. Polonia
Año:
Periodo: Jul-Sep
Volumen: 23
Número: 3
Paginación: 1089-1097
País: México
Idioma: Inglés
Tipo de documento: Artículo
Resumen en inglés Fake news recognition has become a prominent research topic in natural language processing. Researchers reported significant successes when applying methods based on various stylometric and lexical features and machine learning, with accuracy reaching 90%. This article is focused on answering the question: are the fake news detection models universally applicable or limited to the domain they have been trained on? We used four different, freely available English language Fake News corpora and trained models in both in-domain and cross-domain setting. We also explored and compared features important in each domain. We found that the performance in cross-domain setting degrades by 20% and sets of features important to detect fake texts differ between domains. Our conclusions support the hypothesis that high accuracy of machine learning models applied to fake news detection may be related to over-fitting, and models need to be trained and evaluated on mixed types of texts.
Disciplinas: Ciencias de la computación
Palabras clave: Procesamiento de datos
Keyword: Fake news detection,
Cross-domain,
Cross-domain failures,
Data processing
Texte intégral: Texto completo (Ver HTML) Texto completo (Ver PDF)