| Practice | Detail | Reference |
|---|---|---|
| Inverted Index MapReduce | The basic version of Inverted Index on Hadoop | ex1, ex2, ex3, ex4 |
| Spark Inverted Index | The basic version of Inverted Index using PySpark | |
| TF-IDF MapReduce | Build TF-IDF among given articles | ex1, ex2 |
| TF-IDF Spark | MLlib ex |
TF-IDF stands for term frequency–inverse document frequency
- MLlib - Feature Extraction and Transformation - RDD-based API - TF-IDF
- MLlib - Extracting, transforming and selecting features
- official example data
Inverted Index
TF-IDF
- xcc0322/tfidf-wikipedia-information-retrieval - Wikipedia TF-IDF project
- SatishUC15/TFIDF-HadoopMapReduce