Skip to content

melanieganz/ReproducibleQuantitativeDataAnalysis-2025

Repository files navigation

ReproducibleQuantitativeDataScience

A course prepared by Dr Melanie Ganz and Dr Cyril Pernet, with amazing guests: Dr Robert Oostenveld (RO), Dr Michael Hanke (MH) and Dr Nikola Stikov (NS). The course structure is over 5 days plus personal work: 2 days, course work, 2 days, course work, and 1 day with presentations.

For teachers: We expect students to join the course several months after starting their PhD allowing them to already have data and some code. This will allow them to apply the concepts developed to their own data and code. It is also expected to have a platform to interact with students via a 'wall' with notes.

For students: During the course, active participation is expected. In session 1, we'll use padlet to interact with each other (anonymous posting allowed) and also do group work. In session 2, we use GitHub (that you learn in session 1) to share code and review each other code. It is recommended to share something you are working on, but if you feel uncomfortable with that, prepare something to be shared/reviewed. In session 3, you must present in front of everybody. While it may feel uncomfortable, it is expected from any PhD student to be able to do so, and not just for this course. In general, there are no rights and wrongs in trying to improve reproducibility, it is only expected that you try given the conceptual and practical tools presented.

Part 1

Day 1 - Data Collection and data storage

  • Introduction to reproducibility: Definitions and origins
  • How do you store data on your computer? Data structures and data naming
  • Data provenance: keeping track of where data are coming from
  • Reproducibility is hard: case studies

Day 2 - Reproducible designs, protocols and pre-registration

  • Concepts and tools for protocol documentation, and study pre-registration
  • Data Privacy, Ethic and GDP - lecture and practical case reviews
  • Using markdown see cheat sheet for documentation - practical
  • Version control and social coding with Git -- people who know can pair wih newbies

Course work

Using your PhD research data, protocol, code, etc, write a report explaining from where you start, and which measures are already in place to increase reproducibility as per concepts presented during days 1 and 2. What measures can be taken to increase reproducibility and if any, why some cannot be implemented? (page count 2 to 3)

Submit your coursework via e-mail to Cyril and Melanie.

Part 2

Day 3 - Better coding

  • Programming
  • Good coding practices
  • An introduction to computational analysis methods: permutation, bootstrap, cross-validation, out-of-sample generalization
  • Time to update your code - push code here, review each other work, present, discuss with teachers

Day 4 - Better analyses

  • P-hacking
  • Understanding p-values
  • Feedback on coursework and discuss further issues to make your PhD reproducible
  • Computational reproducibility

Please prepare before the course:

Course work

Improve code you are using based on the concepts and tools reviewed over the 4 days: from version control and better inline documentation, to functionalization and modern computational statistics.
Make a 10 minutes presentation summarizing all of your course works and what measures you have taken to improve reproducibility in your PhD (including work from session 1).

Part 3

Day 5 - Data sharing

  • The ‘data’ cycle, sharing from raw data to figures - lecture
  • Reproducible publishing see example here
  • Presentations and discussions/social event (drinks and pizza 4h)

About

Repository for the UCPH SCIENCE PhD course Reproducible Quantitative Data Analysis 2025

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Contributors 3

  •  
  •  
  •