Course: Big Data Analysis

Make sure to check my.poly.edu for course announcements

Week 1: Monday Sept. 10th - Course Overview

• Course overview (First day of classes!)
• Student survey
• Introduction to Big Data

Week 2: Monday Sept. 17th - Map-Reduce

• Introduction to map-reduce

Readings

• google original paper
• Mining of Massive Datasets, Chapter 2
• Data-Intensive Text Processing with MapReduce, Chapter 2

Week 3: Monday Sept. 24th - Statistics is easy

• Guest lecture by Dennis Shasha
• Statistics and Big Data

Readings

• http://www.morganclaypool.com/doi/abs/10.2200/S00142ED1V01Y200807MAS001 -- book is available for free for NYU students
• JF: add references for issues related to stats and big data

Week 4: Monday Oct. 1st - Databases and Big Data

• Databases and Big Data

Readings

• JF: ADD: NoSQL databases (reading papers from literature)

Column store vs. tuple store. HBase, MongoDB, VaultDB, Cassandra, HadoopDB (Facebook) Overview of different architectures, distributed databases vs. hadoop, transaction support...

Week 5: Monday Oct. 8st - Finding Similar Items

• Overview of information integration

Readings

• Mining of Massive Datasets, chapter 3; information integration; entity resolution

Week 6: Monday Oct. 15st - Graph Analysis

• Graph algorithms, link analysis, social networks

Readings

• Mining of Massive Datasets, Chapter 5
• Data-Intensive Text Processing with MapReduce, Chapter 5

Week 7: Monday Oct. 22st - Introduction to Visualization; Data stewardship and provenance

• Guest lecture by Claudio Silva and Lauro Lins

Readings

• Hellerstein (ask Claudio for additional references)
• ADD: provenance and reproducibility

Week 8: Monday Oct. 29th - TBD swap oct 15

• Reading: inverted index and crawling (Lin chapter 4)
• Ask Torsten (tentative, ask him for reading material)

Readings

• Data-Intensive Text Processing with MapReduce, Chapter 4

Week 9: Monday Nov. 12th - Frequent Itemsets

Reading

• Mining of Massive Datasets, Chapter 6

Week 10: Monday Nov. 5th - Mining Data Streams =

Readings

• Mining of Massive Datasets, Chapter 4

Week 11: Monday Nov. 19th - Clustering

Readings

• Mining of Massive Datasets, Chapter 7

Week 12: Monday Nov. 26th - Recommendation Systems

Readings

• Mining of Massive Datasets, Chapter 9

Week 13 Monday Dec. 3rd - EM algorithms for text processing

• Data-Intensive Text Processing with MapReduce, Chapter 6