Accurate measurement of key income variables plays a crucial role in economic research and policy decision-making. However, the presence of item nonresponse and measurement error in survey data can cause biased estimates. These biases can subsequently lead to sub-optimal policy decisions and inefficient allocation of resources. While there have been various studies documenting item nonresponse and measurement error in economic data, there have not been many studies investigating interventions that could reduce item nonresponse and measurement error. In our research, we investigate the impact of monetary incentives on reducing item nonresponse and measurement error for labor and investment income in the Survey of Income and Program Participation (SIPP). Our study utilizes a randomized incentive experiment in Waves 1 and 2 of the 2014 SIPP, which allows us to assess the effectiveness of incentives in reducing item nonresponse and measurement error. We find that households receiving incentives had item nonresponse rates that are 1.3 percentage points lower for earnings and 1.5 percentage points lower for Social Security income. Measurement error was 6.31 percentage points lower at the intensive margin for interest income, and 16.48 percentage points lower for dividend income compared to non-incentive recipient households. These findings provide valuable insights for data producers and users and highlight the importance of implementing strategies to improve data quality in economic research.
-
An Analysis of Sample Selection and the Reliability of Using Short-term Earnings Averages in SIPP-SSA Matched Data
December 2011
Working Paper Number:
CES-11-39
In this paper, we document the extent to which the sample of the Survey of Income and Program Participation that is matched to the Social Security Administration's administrative earnings records is nationally representative. We conclude that the match bias is small, so selection is not a serious concern. The matched sample over-represents individuals who are wealthy, who have financial assets or who have received a government-transfer and under-represents individuals who attrited from the SIPP. We use this matched sample to examine the relationship between short-term averages of earnings from the SIPP earnings and average lifetime earnings from the administrative records. Our estimates suggest that using short averages of earnings may understate the effects of permanent income on particular outcomes of interest.
View Full
Paper PDF
-
Self-Employment Income Reporting on Surveys
April 2023
Working Paper Number:
CES-23-19
We examine the relation between administrative income data and survey reports for self-employed and wage-earning respondents from 2000 - 2015. The self-employed report 40 percent more wages and self-employment income in the survey than in tax administrative records; this estimate nets out differences between these two sources that are also shared by wage-earners. We provide evidence that differential reporting incentives are an important explanation of the larger self-employed gap by exploiting a well-known artifact ' self-employed respondents exhibit substantial bunching at the
first EITC kink in their administrative records. We do not observe the same behavior in their survey responses even after accounting for survey measurement concerns.
View Full
Paper PDF
-
Non-Random Assignment of Individual Identifiers and Selection into Linked Data: Implications for Research
January 2026
Working Paper Number:
CES-26-06
The U.S. Census Bureau's Person Identification Validation System facilitates anonymous linkages between survey and administrative records by assigning Protected Identification Keys (PIKs) to person records. While PIK assignment is generally accurate, some person records are not successfully assigned a PIK, which can lead to sample selection bias in analyses of linked data. Using the American Community Survey (ACS) and the Current Population Survey Annual Social and Economic Supplement (CPS ASEC) between 2005 and 2022, we corroborate and extend existing findings on the drivers of PIK assignment, showing that the rate of PIK assignment varies widely across socio-demographic subgroups. Using earnings as a test case, we then show that limiting a survey sample of wage earners to person records with PIKs or successful linkages to W-2 wage records tends to overestimate self-reported wage earnings, on average, indicative of linkage-induced selection bias. In a validation exercise, we demonstrate that reweighting methods, such as inverse probability weighting or entropy balancing, can mitigate this bias.
View Full
Paper PDF
-
Using Linked Survey and Administrative Data to Better Measure Income: Implications for Poverty, Program Effectiveness and Holes in the Safety Net
October 2015
Working Paper Number:
CES-15-35
We examine the consequences of underreporting of transfer programs in household survey data for several prototypical analyses of low-income populations. We focus on the Current Population Survey (CPS), the source of official poverty and inequality statistics, but provide evidence that our qualitative conclusions are likely to apply to other surveys. We link administrative data for food stamps, TANF, General Assistance, and subsidized housing from New York State to the CPS at the individual level. Program receipt in the CPS is missed for over one-third of housing assistance recipients, 40 percent of food stamp recipients and 60 percent of TANF and General Assistance recipients. Dollars of benefits are also undercounted for reporting recipients, particularly for TANF, General Assistance and housing assistance. We find that the survey data sharply understate the income of poor households, as conjectured in past work by one of the authors. Underreporting in the survey data also greatly understates the effects of anti-poverty programs and changes our understanding of program targeting, often making it seem that welfare programs are less targeted to both the very poorest and middle income households than they are. Using the combined data rather than survey data alone, the poverty reducing effect of all programs together is nearly doubled while the effect of housing assistance is tripled. We also re-examine the coverage of the safety net, specifically the share of people without work or program receipt. Using the administrative measures of program receipt rather than the survey ones often reduces the share of single mothers falling through the safety net by one-half or more.
View Full
Paper PDF
-
Reporting of Indian Health Service Coverage in the American Community Survey
May 2018
Working Paper Number:
carra-2018-04
Response error in surveys affects the quality of data which are relied on for numerous research and policy purposes. We use linked survey and administrative records data to examine reporting of a particular item in the American Community Survey (ACS) - health coverage among American Indians and Alaska Natives (AIANs) through the Indian Health Service (IHS). We compare responses to the IHS portion of the 2014 ACS health insurance question to whether or not individuals are in the 2014 IHS Patient Registration data. We evaluate the extent to which individuals misreport their IHS coverage in the ACS as well as the characteristics associated with misreporting. We also assess whether the ACS estimates of AIANs with IHS coverage represent an undercount. Our results will be of interest to researchers who rely on survey responses in general and specifically the ACS health insurance question. Moreover, our analysis contributes to the literature on using administrative records to measure components of survey error.
View Full
Paper PDF
-
Screening Out the Needy: the Effects of SNAP Work Requirements
July 2026
Working Paper Number:
CES-26-46
We examine the effectiveness of work requirements as a screening device in the Supplemental Nutrition Assistance Program (SNAP). Work requirements for 'able-bodied adults without dependents' were suspended after the Great Recession and gradually reinstated across counties and states in the 2010s. Using linked administrative SNAP and employment data from five states and a triple-differences design, we find that work requirements reduce SNAP participation by seven percent without increasing labor supply and disproportionately screen out low-income individuals. We develop a welfare framework to interpret these results and find that the social costs of work requirements exceed budget savings.
View Full
Paper PDF
-
Employment and Earnings Trajectories of HUD Program Participants
May 2026
Working Paper Number:
CES-26-31
Federal housing assistance programs, such as those run by the U.S. Department of Housing and Urban Development (HUD), have been shown to reduce rent burden and improve housing stability for program participants, which may in turn have downstream impacts on their labor market attachment and career trajectories. However, existing studies from individual cities or states provide mixed evidence on the association of housing assistance with labor market outcomes. By linking HUD administrative records to matched employee-employer earnings records from the Longitudinal Employer-Household Dynamics (LEHD) program, we document how the labor market trajectories of program participants change as they enter and exit federal housing assistance programs, examining outcomes over a 14-year window surrounding entry or exit. In our analysis of entry, we find that the employment rates and earnings of first-time HUD program participants begin to increase upon entering a HUD program, which represents a reversal of prior declining trends in these outcomes. Suggestive of a positive association, these increases in employment and earnings trends exceed those of low-income non-participants from the American Community Survey (ACS). In our analysis of exits, we find that program participants who eventually leave a HUD program have increasing pre-exit trends in employment and earnings that then flatten upon exiting. Comparing these negative changes in trend to the relatively stable trajectories of those who remain in HUD programs throughout the analysis suggests that exits are associated with diminished employment and earnings trajectories.
View Full
Paper PDF
-
The Impact of Expanding Public Health Insurance on Safety Net Program Participation: Evidence From the ACA Medicaid Expansion
May 2026
Working Paper Number:
CES-26-32
We examine spillover effects from the ACA Medicaid expansion to public programs providing cash and food assistance. We consider program participation in contiguous county pairs crossing state borders, where one state took up the Medicaid expansion and the other did not, allowing us to better control for local economic trends that could affect program participation. We find that the Medicaid expansion increased participation in food assistance and one of the cash programs, with impacts mainly due to participation conditional on eligibility, rather than from labor supply responses. Our results demonstrate the potential for spillovers across safety net programs.
View Full
Paper PDF
-
Criminal court fees, earnings, and expenditures: A multi-state RD analysis of survey and administrative data
February 2023
Working Paper Number:
CES-23-06
Millions of people in the United States face fines and fees in the criminal court system each year, totaling over $27 billion in overall criminal debt to-date. In this study, we leverage five distinct natural experiments in Florida, Michigan, North Carolina, Texas, and Wisconsin using regression discontinuity designs to evaluate the causal impact of such financial sanctions and user fees. We consider a range of long-term outcomes including employment, recidivism, household expenditures, and other self-reported measures of well-being, which we measure through a combination of administrative records on earnings and employment, the Criminal Justice Administrative Records System, and household surveys. We find consistent evidence across the range of natural experiments and subgroup analyses of precise null effects on the population, ruling out long-run impacts larger than +/-3.6% on total earnings and +/-4.7% on total recidivism. Failure to find changes in outcomes undermines popular narratives of poverty traps arising from criminal debt but argues against the use of fines and fees as a source of local revenue and as a crime control tool.
View Full
Paper PDF
-
Childhood Housing and Adult Earnings: A Between-Siblings Analysis of Housing Vouchers and Public Housing
January 2013
Working Paper Number:
CES-13-48RR
To date, research on the long-term effects of childhood participation in voucher-assisted and public housing has been limited by the lack of data and suitable identification strategies. We create a national level longitudinal data set that enables us to analyze how children's housing experiences affect adult earnings and incarceration rates. While naive estimates suggest there are substantial negative consequences to childhood participation in voucher assisted and public housing, this result appears to be driven largely by selection of households into housing assistance programs. To mitigate this source of bias, we employ household fixed-effects specifications that use only within-household (across-sibling) variation for identification. Compared to naive specifications, household fixed-effects estimates for earnings are universally more positive, and they suggest that there are positive and statistically significant benefits from childhood residence in assisted housing on young adult earnings for nearly all demographic groups. Childhood participation in assisted housing also reduces the likelihood of incarceration across all household race/ethnicity groups. Time spent in voucher-assisted or public housing is especially beneficial for females from non-Hispanic Black households, who experience substantial increases in expected earnings and lower incarceration rates.
View Full
Paper PDF