Big Data: Properties, Challenges, Data processing techniques using Hadoop Map Reduce and Distributed File Systems

Author(s):

Mayuri K P , Sir M Visvesvaraya Institute of Technology; C Padmini, Sir M Visvesvaraya Institute of Technology

Keywords:

Big data, Hadoop, HDFS, MapReduce

Abstract:

Big data has drawn huge attention from researchers in information sciences, Healthcare, Business, Policy and decision makers in government and enterprises. In addition social, scientific and engineering applications have created large amounts of both structured and unstructured information which needs to be processed, analyzed and linked. This paper is aimed to demonstrate a close- up view about big data characteristics, challenges and issues in adopting and accepting big data technology and its processing techniques. Several solutions to the big data problem have emerged which introduce the MapReduce environment and it is available as open-source in Hadoop. Hadoop’s distributed processing, MapReduce algorithms and overall architecture are a major step towards achieving the promised benefits of big data.

Other Details:

Manuscript Id	:	IJSTEV3I11108
Published in	:	Volume : 3, Issue : 11
Publication Date	:	01/06/2017
Page(s)	:	140-146

Download Article