Updated repo structure

RutgersComLab · Jul 12, 2022 · ca0b96d · ca0b96d
1 parent 7ddbf7e
commit ca0b96d
Show file tree

Hide file tree

Showing 74 changed files with 20,773 additions and 1 deletion.
diff --git a/README.md b/README.md
@@ -1,4 +1,5 @@
 # Topic modeling for NYT articles
+
 ## Overview
 In this project, we try to identify how trends have changed for 'automation' across decades, by analyzing [The New York Times](https://www.nytimes.com/) articles from 1950 to 2021. We also try to identify other topics that managed to get media attraction consistently over each decade. We use a variety of approaches and techniques for data cleaning and standardization, and also use packages such as Gensim, spaCy, NLTK, BERTopic etc to complete this analysis.
 
@@ -33,7 +34,7 @@ To understand how the trends have changed for 'automation' across decades, we lo
 </ol>
 We build a visualization on top of count/lemmatized to get a better sense of the distrbution of the top 50 words in the corpus across the decades.
 
-#### Trend for other topics
+#### Trend for Other Topics
 This project approaches the problem using 4 different techniques:
 Decade wise topic modeling using LDA
 Decade wise topic modeling using BERTopic

diff --git a/code/Count Visualization.ipynb → code/automation/Count Visualization.ipynb b/code/Count Visualization.ipynb → code/automation/Count Visualization.ipynb
diff --git a/Count.ipynb → code/automation/Count.ipynb b/Count.ipynb → code/automation/Count.ipynb
diff --git a/Data Cleaning and Transformation.ipynb → ...on/Data Cleaning and Transformation.ipynb b/Data Cleaning and Transformation.ipynb → ...on/Data Cleaning and Transformation.ipynb
diff --git a/code/BERTopic - DTM.ipynb → code/other topics/BERTopic - DTM.ipynb b/code/BERTopic - DTM.ipynb → code/other topics/BERTopic - DTM.ipynb
diff --git a/code/BERTopic.ipynb → code/other topics/BERTopic.ipynb b/code/BERTopic.ipynb → code/other topics/BERTopic.ipynb
diff --git a/code/LDA Seq Model.ipynb → code/other topics/LDA Seq Model.ipynb b/code/LDA Seq Model.ipynb → code/other topics/LDA Seq Model.ipynb
diff --git a/code/LdaModel.ipynb → code/other topics/LdaModel.ipynb b/code/LdaModel.ipynb → code/other topics/LdaModel.ipynb
diff --git a/results/BERTopic-DTM.zip b/results/BERTopic-DTM.zip
diff --git a/results/BERTopic.zip b/results/BERTopic.zip
diff --git a/results/Count Visualization.zip b/results/Count Visualization.zip
diff --git a/results/LDA.zip b/results/LDA.zip
diff --git a/results/automation/bigram.html b/results/automation/bigram.html
diff --git a/results/automation/trigram.html b/results/automation/trigram.html
diff --git a/results/other topics/Dynamic Topic Modeling (DTM)/BERTopic-DTM/clusters.html b/results/other topics/Dynamic Topic Modeling (DTM)/BERTopic-DTM/clusters.html
diff --git a/results/other topics/Dynamic Topic Modeling (DTM)/BERTopic-DTM/line chart.html b/results/other topics/Dynamic Topic Modeling (DTM)/BERTopic-DTM/line chart.html
diff --git a/results/LDA Seq Model.html → ...ng (DTM)/LDA Seq Model/LDA Seq Model.html b/results/LDA Seq Model.html → ...ng (DTM)/LDA Seq Model/LDA Seq Model.html