Performance Analysis of Distributed Computing Frameworks for Big Data Analytics: Hadoop Vs Spark



Título del documento: Performance Analysis of Distributed Computing Frameworks for Big Data Analytics: Hadoop Vs Spark
Revue: Computación y sistemas
Base de datos:
Número de sistema: 000560476
ISSN: 1405-5546
Autores: 1
1
2
Instituciones: 1Banaras Hindu University, Institute of Science, Varanasi, Uttar Pradesh. India
2Indian Institute of Information Technology, Allahabad, Uttar Pradesh. India
Año:
Periodo: Abr-Jun
Volumen: 24
Número: 2
Paginación: 669-686
País: México
Idioma: Inglés
Tipo de documento: Artículo
Resumen en inglés In the last one decade, the tremendous growth in data emphasizes big data storage and management issues with the highest priorities. For providing better support to software developers for dealing with big data problems, new programming platforms are continuously developing and Hadoop MapReduce is a big game-changer followed by Spark, which sets the world of big data on fire with its processing speed and comfortable APIs. Hadoop framework emerged as a leading tool based on the MapReduce programming model with a distributed file system. Spark is on the other hand, recently developed big data analysis and management framework used to explore unlimited underlying features of Big Data. In this research work, a comparative analysis of Hadoop MapReduce and Spark has been presented based on working principle, performance, cost, ease of use, compatibility, data processing, failure tolerance, and security. Experimental analysis has been performed to observe the performance of Hadoop MapReduce and Spark for establishing their suitability under different constraints of the distributed computing environment.
Disciplinas: Ciencias de la computación
Palabras clave: Procesamiento de datos
Keyword: Big data,
Parallel processing,
Distributed environments,
Distributed frameworks,
Hadoop MapReduce,
Spark,
Big data analytics,
Data processing
Texte intégral: Texto completo (Ver HTML) Texto completo (Ver PDF)