Let's talk about joins | Crystal Lewis
Working with data would be so much simpler if we always only had one dataset to work with. However, in the world of research, we often have multiple datasets, collected from different instruments, participants, or time periods, and our research questions typically require these data to be linked in some way. Yet, before combining data, it’s important to consider what type of join makes the most sense for our specific purposes, as well as how to correctly perform those joins. This blog post reviews the various ways we may consider combining our data. In general, there are two ways to link our data, horizontally or vertically. When linking or joining data horizontally we are matching rows by one or more variables (i.e., keys), making a wider dataset. When joining vertically, column names are matched and datasets are stacked on top of each other, making a longer dataset. Joins can be done in many different programs (e.g., SQL, R, Stata, SAS). Most of this post will be applicable to any la
Let’s talk about joins | Crystal Lewis Working with data would be so much simpler if we always only had one dataset to work with. However, in the world of research, we often have multiple datasets, collected from different instruments, participants, or time periods, and our research questions typically require these data to be linked in some way. Yet, before combining data, it’s important to consider what type of join makes the most sense for our specific purposes, as well as how to correctly perform those joins. This blog post reviews the various ways we may consider combining our data. Types
related reading
- Analysis of Open Government Datasets From a Data Design and Integration Perspectiveopenproceedings.org
- 聚合、联接或合并数据 - Tableauhelp.tableau.com
- 12 Tidy data | Python for Data Sciencebyuidatascience.github.io
- [2011.10427] Dataset Discovery in Data Lakesarxiv.org
- Retrieve, Merge, Predict: Augmenting Tables with Data Lakeshal.science
- The Great Data Integration Schlep — LessWronglesswrong.com
- Assignment 3: Merging Spreadsheets (CS 2110 Fall 2024)courses.cis.cornell.edu
- The Beginner's Guide to Databasestechnically.substack.com
- GitHub - awesomedata/awesome-public-datasets: A topic-centric list of HQ open datasets. · GitHubgithub.com
- Best Practices for Organizing Data - Honeycomb Docsdocs.honeycomb.io
- Salesforce Helpkb.tableau.com
- What I Learned From The Modern Data Stack Conference 2021 - James Lejameskle.com