Big data is the term representing any collection of datasets so large and complex which is difficult to process using traditional data processing applications. The challenges comprise of analysis, capture, search, sharing, storage, transfer, visualization, and privacy violations. Big data is a set of techniques and technologies that need new forms of integration to uncover large hidden values from large datasets which is diverse, complex, and of a massive scale. Big data environment is used to acquire, organize and analyze a variety of data. The main objective of this paper is to give a general perspective of big data analytics, its process, tools and techniques used. There is an immense need for the construction of algorithms to handle Big Data. Many algorithms are defined in the analysis of large data set. A review of various techniques and algorithms are also discussed in this paper. The massive volume of both structured and unstructured data which is so large, it is difficult to gather and analyze for getting the required solution. It is better to have some tools which help in processing the complex data sets. This paper is also focused on various tools available to extract required data from big data.

Big data, Data extraction, Data cleansing, Decision making, Visualization, Predictive analysis

[1] .CH.Chandra Sekhar, CH.Sekhar, ‘productivity Improvement in Agriculture Sector Using Big Data Tools’, publication a www.researchgate.net, 978-1-5090-6399-4/17/$31.00_c 2017 IEEEConference Paper • March 2017.
[2]. Mohammed K. Hassan, Ali I. El Desouky, Sally M. Elghamrawy, and Amany M. Sarhan, ‘Big Data Challenges and Opportunities in Healthcare Informatics and Smart Hospitals’, © Springer International Publishing AG 2017.
[3]. Ashish Bajpai, Dayanand, “Big Data Analytics in Cyber Security” International Journal of Computer Sciences and Engineering, Vol:6, Issue;7, 2018.
[4]. K. Sree Divya, P.Bhargavi2, “Machine Learning Algorithms in Big data Analytics”, International Journal of Computer Sciences and Engineering, Vol:6, Issue;1,2017.
[5]. Mohamed Abdel-Basset, Mai Mohamed, Florentin Smarandache, and Victor Chang,’ Neutrosophic Association Rule Mining Algorithm for Big Data Analysis’, Symmetry 2018, 10, 106; DOI: 10.3390/sym10040106
[6]. A Rytsarev, A V Kupriyanov, Clustering of social media content with the use of Big Data technology’ The IV International Conference on Information Technology and Nanotechnology.
[7]. Ajay Kumar Pal, Saurabh Pal, ‘Analysis and Mining of Educational Data for Predicting the Performance of Students’, International Journal of Electronics Communication and Computer Engineering Volume 4, Issue 5.
[8]. Brijesh Kumar Baradwaj, Saurabh Pal,’ Mining Educational Data to Analyze Students‟ Performance’, (IJACSA) International Journal of Advanced Computer Science and Applications, Vol. 2, No. 6, 2011.
[9]. Vinayak A. Bharadi, Prachi P.Abhyankar, ‘Analysis And Prediction in Agriculture Data using Data Mining Techniques’International Journal of Research In Science & Engineering Special Issue 7ICEMAN March 2017 IJRISE
[10]. Senthil Vadivu, Dr. Prasanna Devi, Vishnu Kiran, Manivannan,’ Modelling A Predictive Analytics Methodology For Forecasting Rice Variety And Quality On Yield On Farm And Farming Attributes Using Bigdata’, International Journal of Pure and Applied Mathematics Volume 116 No. 5 2017, 61-65.
[11]. Ashwani Kumar Kushwaha, SwetaBhattachrya,’ Crop yield prediction using Agro Algorithm in Hadoop’, IRACST - International Journal of Computer Science and Information Technology & Security (IJCSITS), Vol. 5, No2, April 2015
[12]. Ekta Joshi1, Dr. D. A.Parikh, ‘An Improved K-Means Clustering Algorithm’, International Journal of Scientific Research in Science, Engineering and Technology, 2018IJSRSET, Volume 4, Issue 1.
. [13]. D Ramesh, B Vishnu Vardhan, ‘Analysis Of Crop Yield Prediction Using Data Mining Techniques’, IJRET: International Journal of Research in Engineering and Technology, Volume: 04, Issue: 01 Jan-2015.
[14]. Lean Yu, Yaqing Zhao, Ling Tang c, Zebin Yang d, ‘Online big data-driven oil consumption forecasting with Google trends ‘, International Journal of Forecasting 35 (2019) 213–223, 2017 Elsevier.
[15]. Gunasekaran Manogaran and DaphneLopez, ‘Health data analytics using scalable logistic regression with stochastic gradient descent’, Int. J. Advanced Intelligence Paradigms, Vol. 10, 2018.
[16]. Abdallah, V. Detriments, H. Mylonas, K. Tatsis & E. Chatzi,’ Fault diagnosis of wind turbine structures using decision tree learning algorithms with big data’,2018 Taylor & Francis Group, London.
[17]. Eka Sugiyarti, Kamarul Azmi Jasmi, Bushrah Basiron, Miftachul Huda,
Shankar K., Andino Maseleno,’ Decision Support System Of Scholarship Grantee Selection Using Data Mining ‘, International Journal of Pure and Applied Mathematics, Volume 119 No. 15 201,
[18]. Michelle Cristina Araujo Picolia, Gilberto Camara, Ieda Sanchez,’ Big earth observation time series analysis for monitoring Brazilian Agriculture ‘, ISPRS Journal of Photogrammetry and Remote Sensing • August 2018, isprsjprs.
[19]. Konstantinos G. Liakos, Patrizia Busato, Dimitrios Moshou, Simon Pearson and Dionysis Bochtis,` Machine Learning in Agriculture: A Review ‘, Sensors 2018, 18, 2674.
[20]. Miguel Molina-Solana, Mar´ıa Rosa,⇤, M. Dolores Ruiz, Juan Gomez-Romero, M.J. Martin-Bautista, ‘Data Science for Building Energy Management: a review’, Article in Renewable and Sustainable Energy Reviews, April 2017 DOI: 10.1016/j.rser.2016.11.132.
[21]. Nirbhey Singh Pahwa, Vidhi Soni, Neeha Khalfay, Deepali Vora, Stock Prediction using Machine Learning a Review Paper ‘International Journal of Computer Applications (0975 – 8887) Volume 163 – No 5, April 2017.
[22 ].Mansi Shinde, Kimaya Ekbote, Sonali Ghorpade, Sanket Pawar, Shubhada Mone, ‘Crop Recommendation and Fertilizer Purchase System’, Mansi Shinde et al, / (IJCSIT) International Journal of Computer Science and Information Technologies, Vol. 7 (2), 2016, 665-667.
[23]. Magdalena Cantabella, Raquel Martínez-España ∗, Belén Ayuso, Juan Antonio Yáñez, Andrés Muñoz,’ Analysis of student behavior in learning management systems through a Big Data framework’, Future Generation Computer Systems 90 (2019)262272,2 2018 Elsevier B.V.
[24]. Mohamed Abdel-Basset 1,* ID, Mai Mohamed 1, Florentin Smarandache 2,* ID and Victor Chang 3, ‘Neutrosophic Association Rule Mining Algorithm for Big Data Analysis’, Symmetry 2018, 10, 106; DOI:10.3390/sym10040106.
[25]. F. Padillo • J.M. Luna • S. Ventura, ‘A grammar-guided genetic programming algorithm for associative classification in Big Data’, Article in Cognitive Computation • November 2018.
[26]. J. Jenifer Nancy, Jhansi Rani, Dr. D. Devaraj, ‘Association Rule Mining in Big Data using MapReduce Approach in Hadoop’, GRD Journals | Global Research and Development Journal for Engineering | International Conference on Innovations in Engineering and Technology (ICIET) - 2016 | July 2016.
[27 ]. Daxin Tian, Yuki Zhu, Xuting Duan, Junjie Hu, Zhengguo Sheng, Min Chen, IEEE, Jian Wang, Yunpeng Wang,’ An Effective Fuel Level Data Cleaning And Repairing Method for Vehicle Monitor Platform’, - IEEE Transactions, 2019 - ieeexplore.ieee.org.
[28]. Mohamed Alleghany, Dhiya-Jumeily, Thar Baker, Abir Hussain, Jamila Mustafin, and Ahmed J. Aljaaf,’ Applications of Machine Learning Techniques for Software Engineering Learning and Early Prediction of Students’ Performance ‘,© Springer Nature Singapore Pte Ltd. 2019.
[29]. Shili Lian, Liangliang Wan, Ling Zhan, and Yansheng Wu, ‘Research on Recognition of Nine Kinds of Fine Gestures Based on Adaptive AdaBoost Algorithm and Multi-Feature Combination’, IEEE, VOLUME 7, 2019.
[30]. Rishabh Kapoor, Shiva Verma & M L Sharma,’ Multi-Lingual Comparative Sentiment Analysis Of Twitter Data Using Ann Algorithm’, R Kapoor, S Verma, ML Sharma -Digitalization,2018researchgate.net, ISBN: AR No.-3093/ISBN/2018/A.
[31]. A. Sankari Karthiga, M. Satish Mary, M. Yogini,’ Early Prediction of Heart Disease Using Decision Tree Algorithm’, International Journal of Advanced Research in Basic Engineering Sciences and Technology (IJARBEST) Vol.3, Issue.3, March 2017.