Non-Random Assignment of Individual Identifiers and Selection into Linked Data: Implications for Research
January 2026
Working Paper Number:
CES-26-06
Abstract
The U.S. Census Bureau's Person Identification Validation System facilitates anonymous linkages between survey and administrative records by assigning Protected Identification Keys (PIKs) to person records. While PIK assignment is generally accurate, some person records are not successfully assigned a PIK, which can lead to sample selection bias in analyses of linked data. Using the American Community Survey (ACS) and the Current Population Survey Annual Social and Economic Supplement (CPS ASEC) between 2005 and 2022, we corroborate and extend existing findings on the drivers of PIK assignment, showing that the rate of PIK assignment varies widely across socio-demographic subgroups. Using earnings as a test case, we then show that limiting a survey sample of wage earners to person records with PIKs or successful linkages to W-2 wage records tends to overestimate self-reported wage earnings, on average, indicative of linkage-induced selection bias. In a validation exercise, we demonstrate that reweighting methods, such as inverse probability weighting or entropy balancing, can mitigate this bias.
Document Tags and Keywords
Keywords
Keywords are automatically generated using KeyBERT, a powerful and innovative
keyword extraction tool that utilizes BERT embeddings to ensure high-quality and contextually relevant
keywords.
By analyzing the content of working papers, KeyBERT identifies terms and phrases that capture the essence of the
text, highlighting the most significant topics and trends. This approach not only enhances searchability but
provides connections that go beyond potentially domain-specific author-defined keywords.
:
estimating,
survey,
respondent,
earnings,
bias,
matching,
race,
socioeconomic,
census bureau,
irs,
sampling,
household surveys,
earner,
linkage
Tags
Tags are automatically generated using a pretrained language model from spaCy, which excels at
several tasks, including entity tagging.
The model is able to label words and phrases by part-of-speech,
including "organizations." By filtering for frequent words and phrases labeled as "organizations", papers are
identified to contain references to specific institutions, datasets, and other organizations.
:
Internal Revenue Service,
Bureau of Labor Statistics,
Social Security Administration,
Current Population Survey,
American Community Survey,
Social Security Number,
Protected Identification Key,
W-2,
National Academy of Sciences,
Social and Economic Supplement,
Census Bureau Disclosure Review Board,
PIKed,
Person Validation System,
Person Identification Validation System,
Individual Taxpayer Identification Numbers,
SSA Numident,
COVID-19,
CPS ASEC
Similar Working Papers
Similarity between working papers are determined by an unsupervised neural
network model
know as Doc2Vec.
Doc2Vec is a model that represents entire documents as fixed-length vectors, allowing for the
capture of semantic meaning in a way that relates to the context of words within the document. The model learns to
associate a unique vector with each document while simultaneously learning word vectors, enabling tasks such as
document classification, clustering, and similarity detection by preserving the order and structure of words. The
document vectors are compared using cosine similarity/distance to determine the most similar working papers.
Papers identified with 🔥 are in the top 20% of similarity.
The 10 most similar working papers to the working paper 'Non-Random Assignment of Individual Identifiers and Selection into Linked Data: Implications for Research' are listed below in order of similarity.
-
Working PaperThe Nature of the Bias When Studying Only Linkable Person Records: Evidence from the American Community Survey
April 2014
Working Paper Number:
carra-2014-08
Record linkage across survey and administrative records sources can greatly enrich data and improve their quality. The linkage can reduce respondent burden and nonresponse follow-up costs. This is particularly important in an era of declining survey response rates and tight budgets. Record linkage also creates statistical bias, however. The U.S. Census Bureau links person records through its Person Identification Validation System (PVS), assigning each record a Protected Identification Key (PIK). It is not possible to reliably assign a PIK to every record, either due to insufficient identifying information or because the information does not uniquely match any of the administrative records used in the person validation process. Non-random ability to assign a PIK can potentially inject bias into statistics using linked data. This paper studies the nature of this bias using the 2009 and 2010 American Community Survey (ACS). The ACS is well-suited for this analysis, as it contains a rich set of person characteristics that can describe the bias. We estimate probit models for whether a record is assigned a PIK. The results suggest that young children, minorities, residents of group quarters, immigrants, recent movers, low-income individuals, and non-employed individuals are less likely to receive a PIK using 2009 ACS. Changes to the PVS process in 2010 significantly addressed the young children deficit, attenuated the other biases, and increased the validated records share from 88.1 to 92.6 percent (person-weighted).View Full Paper PDF
-
Working PaperNational Experimental Wellbeing Statistics - Version 1
February 2023
Working Paper Number:
CES-23-04
This is the U.S. Census Bureau's first release of the National Experimental Wellbeing Statistics (NEWS) project. The NEWS project aims to produce the best possible estimates of income and poverty given all available survey and administrative data. We link survey, decennial census, administrative, and third-party data to address measurement error in income and poverty statistics. We estimate improved (pre-tax money) income and poverty statistics for 2018 by addressing several possible sources of bias documented in prior research. We address biases from 1) unit nonresponse through improved weights, 2) missing income information in both survey and administrative data through improved imputation, and 3) misreporting by combining or replacing survey responses with administrative information. Reducing survey error substantially affects key measures of well-being: We estimate median household income is 6.3 percent higher than in survey estimates, and poverty is 1.1 percentage points lower. These changes are driven by subpopulations for which survey error is particularly relevant. For house holders aged 65 and over, median household income is 27.3 percent higher and poverty is 3.3 percentage points lower than in survey estimates. We do not find a significant impact on median household income for householders under 65 or on child poverty. Finally, we discuss plans for future releases: addressing other potential sources of bias, releasing additional years of statistics, extending the income concepts measured, and including smaller geographies such as state and county.View Full Paper PDF
-
Working PaperIntegrating Administrative and Survey Data to Estimate WIC Eligibility and Access
July 2026
Working Paper Number:
CES-26-43
The Special Supplemental Nutrition Program for Women, Infants, and Children (WIC) provides benefits to low-income, nutritionally at-risk women, infants, and children. To administer WIC, officials and program managers at the federal and state level want to understand who is eligible for the program, who among the eligible population chooses to participate, and who is not accessing the program despite their eligibility. Novel individual-level data linkages between restricted-use WIC Administrative Records and the American Community Survey provide WIC access rates estimated at the state and county levels, as well as estimates disaggregated by the demographic and socioeconomic characteristics of individuals and their households. These estimates are developed by the Census-FNS-ERS Joint Project, a research partnership among the U.S. Census Bureau, the US Department of Agriculture's Food and Nutrition Service and Economic Research Service, and state WIC agencies that provide the requisite WIC administrative data to the Census Bureau. This paper details and evaluates our current data linkage and estimation methods, reports results, and identifies areas for improvement and further research.View Full Paper PDF
-
Working PaperDifferences in Disability Insurance Allowance Rates
August 2025
Working Paper Number:
CES-25-54
Allowance rates for disability insurance applications vary by race and ethnicity, but it is unclear to what extent these differences are artifacts of other differing socio-economic and health characteristics, or selection issues in SSA's race and ethnicity data. This paper uses the 2015 American Community Survey linked to 2015-2019 SSA administrative data to investigate DI application allowance rates among non-Hispanic White, non-Hispanic Black, non-Hispanic Asian, non-Hispanic American Indian/Alaska Native, and Hispanic applicants aged 25-65. The analysis uses regression, propensity score matching, and inverse probability weighting to estimate differences in allowance rates among applicants who are similar on observable characteristics. Relative to raw comparisons, differences by race and ethnicity in multivariate analyses are substantially smaller in magnitude and are generally not statistically significant.View Full Paper PDF
-
Working PaperPotential Bias When Using Administrative Data to Measure the Family Income of School-Aged Children
January 2025
Working Paper Number:
CES-25-03
Researchers and practitioners increasingly rely on administrative data sources to measure family income. However, administrative data sources are often incomplete in their coverage of the population, giving rise to potential bias in family income measures, particularly if coverage deficiencies are not well understood. We focus on the school-aged child population, due to its particular import to research and policy, and because of the unique challenges of linking children to family income information. We find that two of the most significant administrative sources of family income information that permit linking of children and parents'IRS Form 1040 and SNAP participation records'usefully complement each other, potentially reducing coverage bias when used together. In a case study considering how best to measure economic disadvantage rates in the public school student population, we demonstrate the sensitivity of family income statistics to assumptions about individuals who do not appear in administrative data sources.View Full Paper PDF
-
Working PaperAccess to the Special Supplemental Nutrition Program for Women, Infants, and Children (WIC) at the State and Substate Levels: Meaning and Measurement
July 2026
Working Paper Number:
CES-26-44
This study estimates eligibility and access rates for the U.S. Department of Agriculture's (USDA) Special Supplemental Nutrition Program for Women, Infants, and Children (WIC) administrative data linked with American Community Survey (ACS) data. This study is one result of a long-term research collaboration among USDA's Economic Research Service; the U.S. Department of Commerce, Bureau of the Census; USDA's Food and Nutrition Service (FNS); and participating state WIC agencies.'By analyzing WIC participation at the state and substate levels, the report provides insights into program reach and demographic differences. The findings confirm that the Census Bureau estimates meet high statistical reliability standards, providing valuable data for program officials and managers, and other stakeholders, to enhance program outreach and effectiveness. A key focus of the report is the comparison between Census Bureau and USDA, FNS estimates, which differ in methodology and measurement scope.View Full Paper PDF
-
Working PaperEmployment and Earnings Trajectories of HUD Program Participants
May 2026
Working Paper Number:
CES-26-31
Federal housing assistance programs, such as those run by the U.S. Department of Housing and Urban Development (HUD), have been shown to reduce rent burden and improve housing stability for program participants, which may in turn have downstream impacts on their labor market attachment and career trajectories. However, existing studies from individual cities or states provide mixed evidence on the association of housing assistance with labor market outcomes. By linking HUD administrative records to matched employee-employer earnings records from the Longitudinal Employer-Household Dynamics (LEHD) program, we document how the labor market trajectories of program participants change as they enter and exit federal housing assistance programs, examining outcomes over a 14-year window surrounding entry or exit. In our analysis of entry, we find that the employment rates and earnings of first-time HUD program participants begin to increase upon entering a HUD program, which represents a reversal of prior declining trends in these outcomes. Suggestive of a positive association, these increases in employment and earnings trends exceed those of low-income non-participants from the American Community Survey (ACS). In our analysis of exits, we find that program participants who eventually leave a HUD program have increasing pre-exit trends in employment and earnings that then flatten upon exiting. Comparing these negative changes in trend to the relatively stable trajectories of those who remain in HUD programs throughout the analysis suggests that exits are associated with diminished employment and earnings trajectories.View Full Paper PDF
-
Working PaperThe Design of Sampling Strata for the National Household Food Acquisition and Purchase Survey
February 2025
Working Paper Number:
CES-25-13
The National Household Food Acquisition and Purchase Survey (FoodAPS), sponsored by the United States Department of Agriculture's (USDA) Economic Research Service (ERS) and Food and Nutrition Service (FNS), examines the food purchasing behavior of various subgroups of the U.S. population. These subgroups include participants in the Supplemental Nutrition Assistance Program (SNAP) and the Special Supplemental Nutrition Program for Women, Infants, and Children (WIC), as well as households who are eligible for but don't participate in these programs. Participants in these social protection programs constitute small proportions of the U.S. population; obtaining an adequate number of such participants in a survey would be challenging absent stratified sampling to target SNAP and WIC participating households. This document describes how the U.S. Census Bureau (which is planning to conduct future versions of the FoodAPS survey on behalf of USDA) created sampling strata to flag the FoodAPS targeted subpopulations using machine learning applications in linked survey and administrative data. We describe the data, modeling techniques, and how well the sampling flags target low-income households and households receiving WIC and SNAP benefits. We additionally situate these efforts in the nascent literature on the use of big data and machine learning for the improvement of survey efficiency.View Full Paper PDF
-
Working PaperThe Mis-Measurement of Permanent Earnings: New Evidence from Social Security Earnings Data
May 2002
Working Paper Number:
CES-02-12
This study investigates the reliability of using short-term averages of earnings as a proxy for permanent earnings in empirical research. An earnings dynamics model is estimated on a large sample of men covering the period from 1983 to 1997 following the cohort-based methodology of Baker and Solon (1999). The analysis uses a unique dataset that matches men in the 1984, 1990 and 1996 Surveys of Income and Program Participation (SIPP) to the Social Security Administration's Summary Earnings Records (SER). The results confirm that using a short-term average of earnings can lead to spurious estimates of the effect of lifetime earnings on a particular outcome. In addition, the transitory variance appears to vary considerably over the lifecycle. The share of earnings variance due to transitory factors is higher among blacks and the persistence of transitory shocks appears to be greater for this group as well. Finally, the transitory variance appears to be a more important factor in explaining the overall earnings variance of college educated men than those without college.View Full Paper PDF
-
Working PaperThe Icing on the Cake: The Effects of Monetary Incentives on Income Data Quality in the SIPP
January 2024
Working Paper Number:
CES-24-03
Accurate measurement of key income variables plays a crucial role in economic research and policy decision-making. However, the presence of item nonresponse and measurement error in survey data can cause biased estimates. These biases can subsequently lead to sub-optimal policy decisions and inefficient allocation of resources. While there have been various studies documenting item nonresponse and measurement error in economic data, there have not been many studies investigating interventions that could reduce item nonresponse and measurement error. In our research, we investigate the impact of monetary incentives on reducing item nonresponse and measurement error for labor and investment income in the Survey of Income and Program Participation (SIPP). Our study utilizes a randomized incentive experiment in Waves 1 and 2 of the 2014 SIPP, which allows us to assess the effectiveness of incentives in reducing item nonresponse and measurement error. We find that households receiving incentives had item nonresponse rates that are 1.3 percentage points lower for earnings and 1.5 percentage points lower for Social Security income. Measurement error was 6.31 percentage points lower at the intensive margin for interest income, and 16.48 percentage points lower for dividend income compared to non-incentive recipient households. These findings provide valuable insights for data producers and users and highlight the importance of implementing strategies to improve data quality in economic research.View Full Paper PDF
