#Udacity Intro to Hadoop and MapReduce Final Project
####Zach Farmer
This repository contains code used in the pursuit of Udacity's Intro to Hadoop and MapReduce course. The repository houses my implementation of the class final project.
Analyzed Udacity forum data in order to explore MapReduce design patterns and structures. Filter, Summarization and Structural patterns were explored and implemented in order to answer a series of questions related to the forum dataset.
Hadoop_Final_Project.ipynb :
- Contains the project in entirety.
forum_data.tar.gz:
- Contains the forum data files
student_test_posts.csv:
- Contains a small test dataset used in construction of mappers and reducers.
Following .py files are all the mappers and reducers created in the pursuit of this project. These scripts can be exported to a Hadoop distributed file system and run on the datasets contained in the forum_data tar file.
mapper_TopTags.pyreducer_TopTags.pymapper_PostLength.pyreducer_PostLength.pymapper_studentTime.pyreducer_studentTime_sansNumpy.pyreducer_studentTime.pymapper_studyGroups.pyreducer_studyGroups.py