Performance Analysis of Distributed Computing Frameworks for Big Data Analytics: Hadoop Vs Spark



Document title: Performance Analysis of Distributed Computing Frameworks for Big Data Analytics: Hadoop Vs Spark
Journal: Computación y sistemas
Database:
System number: 000560476
ISSN: 1405-5546
Authors: 1
1
2
Institutions: 1Banaras Hindu University, Institute of Science, Varanasi, Uttar Pradesh. India
2Indian Institute of Information Technology, Allahabad, Uttar Pradesh. India
Year:
Season: Abr-Jun
Volumen: 24
Number: 2
Pages: 669-686
Country: México
Language: Inglés
Document type: Artículo
English abstract In the last one decade, the tremendous growth in data emphasizes big data storage and management issues with the highest priorities. For providing better support to software developers for dealing with big data problems, new programming platforms are continuously developing and Hadoop MapReduce is a big game-changer followed by Spark, which sets the world of big data on fire with its processing speed and comfortable APIs. Hadoop framework emerged as a leading tool based on the MapReduce programming model with a distributed file system. Spark is on the other hand, recently developed big data analysis and management framework used to explore unlimited underlying features of Big Data. In this research work, a comparative analysis of Hadoop MapReduce and Spark has been presented based on working principle, performance, cost, ease of use, compatibility, data processing, failure tolerance, and security. Experimental analysis has been performed to observe the performance of Hadoop MapReduce and Spark for establishing their suitability under different constraints of the distributed computing environment.
Disciplines: Ciencias de la computación
Keyword: Procesamiento de datos
Keyword: Big data,
Parallel processing,
Distributed environments,
Distributed frameworks,
Hadoop MapReduce,
Spark,
Big data analytics,
Data processing
Full text: Texto completo (Ver HTML) Texto completo (Ver PDF)