Date of Publication :18th April 2018
Abstract: In past decades the analysis of structured data has seen remarkable achievement. The principle objective of this project is to show, how data produced from YouTube can be mined and utilized to achieve targeted and real time decisions by using Hadoop framework. In this Project the dataset is gathered using the YouTube API and stored in Hadoop Distributed File System (HDFS). MapReduce algorithm is applied to process the dataset and identify the top video categories and video uploaders as well as most viewed videos.
Reference :
-
- PrathyushaRani Merla Yiheng Liang, Data Analysis using Hadoop MapReduce Environment, 2017 IEEE International Conference on Big Data (BIGDATA)
- Hadoop Map-Reduce Tutorial at http://hadoop.apache.org/docs/current/ hadoopmapreduce-client/hadoop-mapreduce-clientcore/MapReduceTutorial.html
- Statistics and facts about YouTube. https://www.statista.com/topics/2019/
- Hadoop Setup, http://www.bogotobogo.com/Hadoop/BigData_hadoop_Install_ on_ubuntu_single_node_cluster.php
- Tom White, 2012, Hadoop: The Definitive Guide, O’reilly
- Hadoop Tutorial, Yahoo Developer Network, http://developer.yahoo.com/hadoop/tutorial