Full Citation

Title: How well do automated linkingmethods perform? Lessons from U.S. historical data

Citation Type: Miscellaneous

Publication Year: 2019

ISBN:

ISSN:

DOI:

NSFID:

PMCID:

PMID:

Abstract: This paper reviews the literature in historical record linkage in the U.S. and examines the performance of widely-used record linking algorithms and common variations in their assumptions. We use two highquality, hand-linked datasets and one synthetic ground truth to examine the direct effects of linking algorithms on data quality. We find that (1) no algorithm (including hand-linking) consistently produces representative samples; (2) 15 to 37 percent of links chosen by widely-used algorithms are classified as errors by trained human reviewers; and (3) false links are systematically related to baseline sample characteristics, showing that some algorithms may induce systematic measurement error into analyses. A case study shows that the combined effects of (1)-(3) attenuate estimates of the intergenerational income elasticity by up to 20 percent, and common variations in algorithm assumptions result in greater attenuation. As current practice moves to automate linking and increase link rates, these results highlight the important potential consequences of linking errors on inferences with linked data. We conclude with constructive suggestions for reducing linking errors and directions for future research.

Url: http://www-personal.umich.edu/~baileymj/Bailey_Cole_Henderson_Massey.pdf

User Submitted?: No

Authors: Bailey, Martha; Cole, Connor; Henderson, Morgan; Massey, Catherine

Publisher: University of Michigan

Data Collections: IPUMS USA

Topics: Other, Population Data Science

Countries: