Reading Beyond the Center

This repository contains code for embeddings, plots and results of our paper:

"Reading Beyond the Center. Modeling Book Encounters in the Danish Periphery (1800-1850)" which will be presented at CHR2025.

Useful directions 📌

Some useful directions:

• /src/ contains scripts to create embeddings
• /figures/ contains the figures generated by the notebooks
• /notebooks/ contains the notebooks used for the analysis

Data & paper 📝

The dataset used in this paper is available at huggingface, which is an earlier version and subset of this dataset.

The trained embeddings are also available at huggingface.

Please cite our [paper](link coming soon) if you use the code, dataset or embeddings:

Project Organization 🏗️

├── LICENSE                    <- Open-source license if one is chosen.
│
├── README.md                  <- The top-level README for developers using this project.
│
├── src/                       
│   │
│   ├── process_articles.py    <- Code to get embeddings from newspaper article chunks.
│   ├── mean_pooling.py        <- Code to get average embeddings from newspaper articles.
│   └── merge_text_embs.py     <- Merge texts and embeddings. 
│   
│
├── data/                      <- Data used for the analysis in notebooks.
│
├── prompt_optimization/       <- Data related to the prompt optimization task with GPT.
│
│
├── notebooks/                 <- Jupyter notebooks.
│   │
│   ├── classify_articles.ipynb                <- Notebook to classify article types.
│   ├── explore_and_find_book_ads.ipynb        <- Notebook to get descriptive statistics and create a subset of book advertisements.
│   ├── create_gold_book_announcements.ipynb   <- Notebook to create gold standard book announcements.
│   ├── classify_book_announcements.ipynb      <- Notebook to classify book announcements.  
│   ├── api_gpt.ipynb                          <- Notebook to annotate book titles with GPT.
│   └── analyse_titles.ipynb                   <- Notebook to analyse book titles and do statistical tests.
│
└── figures/                      <- Generated graphics and figures used in the paper.