edx-analytics

1. Overview of Project
2. Hadoop installation in single node
3. Hadoop basic commands
4. Hive Installation
5. Basic hive commands
6. Sqoop Installation
7. Sqoop Import into Hive
8. Sqoop Export from Hive
9. Hadoop multi node cluster set-up
10. Analysing the paper "Detecting Student Misuse of Intelligent Tutoring Systems by Ryan Shaun Baker, Albert T. Corbett, Kenneth R. Koedinger "
11. Figuring out possible hive queries for analysis and analysing the edx log for feature extraction.
12. Actual hive queries for edx analysis
13. Parsing log file and extracting the essential features for the Analysis(Java coding).
14. importing the extracted feature into hive and hdfs
15. Making real time hdfs by calling the parser through cron tab in fixed interval of time

Future work

1. Parse the log when any events gets fire or some content in the log chnages or gets added.
2. Statistical analysis using R.