CREAT: Census Research Exploration and Analysis Tool

The Icing on the Cake: The Effects of Monetary Incentives on Income Data Quality in the SIPP

January 2024

Abstract

Document Tags and Keywords

Similar Working Papers Similarity between working papers are determined by an unsupervised neural network model know as Doc2Vec.

Doc2Vec is a model that represents entire documents as fixed-length vectors, allowing for the capture of semantic meaning in a way that relates to the context of words within the document. The model learns to associate a unique vector with each document while simultaneously learning word vectors, enabling tasks such as document classification, clustering, and similarity detection by preserving the order and structure of words. The document vectors are compared using cosine similarity/distance to determine the most similar working papers. Papers identified with 🔥 are in the top 20% of similarity.

The 10 most similar working papers to the working paper 'The Icing on the Cake: The Effects of Monetary Incentives on Income Data Quality in the SIPP' are listed below in order of similarity.

• Working Paper

  
  
  An Analysis of Sample Selection and the Reliability of Using Short-term Earnings Averages in SIPP-SSA Matched Data
  

  December 2011

  Authors: Bhashkar Mazumder, Jonathan Davis

  Working Paper Number:

  CES-11-39

  In this paper, we document the extent to which the sample of the Survey of Income and Program Participation that is matched to the Social Security Administration's administrative earnings records is nationally representative. We conclude that the match bias is small, so selection is not a serious concern. The matched sample over-represents individuals who are wealthy, who have financial assets or who have received a government-transfer and under-represents individuals who attrited from the SIPP. We use this matched sample to examine the relationship between short-term averages of earnings from the SIPP earnings and average lifetime earnings from the administrative records. Our estimates suggest that using short averages of earnings may understate the effects of permanent income on particular outcomes of interest.
  View Full Paper PDF

  ---

• Working Paper

  
  
  Parental Earnings and Children's Well-Being and Future Success: An Analysis of the SIPP Matched to SSA Earnings Data
  

  April 2011

  Authors: Bhashkar Mazumder, Jonathan Davis

  Working Paper Number:

  CES-11-12

  We estimate the association between parental earnings and a wide variety of indicators of child well-being using data from the Survey of Income and Program Participation (SIPP) matched to administrative earnings records from the Social Security Administration. We find that the use of longer time averages of parent earnings leads to substantially higher estimated effects compared to using only a single year of parent earnings. This suggests that previous studies may have understated the potential efficacy of income support programs to improve child well-being. Further, policy makers should take into account the attenuation bias when comparing studies that use different time spans to measure parental income. Using 7 year time averages of parent earnings, we show for example, that a doubling of parent earnings reduces the probability of a teenager reporting being in poor health by close to 50 percent and a child having insufficient food by 75 percent.
  View Full Paper PDF

  ---

• Working Paper

  
  
  Errors in Survey Reporting and Imputation and Their Effects on Estimates of Food Stamp Program Participation
  

  April 2011

  Authors: Bruce Meyer, Robert Goerge

  Working Paper Number:

  CES-11-14

  Benefit receipt in major household surveys is often underreported. This misreporting leads to biased estimates of the economic circumstances of disadvantaged populations, program takeup, and the distributional effects of government programs, and other program effects. We use administrative data on Food Stamp Program (FSP) participation matched to American Community Survey (ACS) and Current Population Survey (CPS) household data. We show that nearly thirty-five percent of true recipient households do not report receipt in the ACS and fifty percent do not report receipt in the CPS. Misreporting, both false negatives and false positives, varies with individual characteristics, leading to complicated biases in FSP analyses. We then directly examine the determinants of program receipt using our combined administrative and survey data. The combined data allow us to examine accurate participation using individual characteristics missing in administrative data. Our results differ from conventional estimates using only survey data, as such estimates understate participation by single parents, non-whites, low income households, and other groups. To evaluate the use of Census Bureau imputed ACS and CPS data, we also examine whether our estimates using survey data alone are closer to those using the accurate combined data when imputed survey observations are excluded. Interestingly, excluding the imputed observations leads to worse ACS estimates, but has less effect on the CPS estimates.
  View Full Paper PDF

  ---

• Working Paper

  
  
  Criminal court fees, earnings, and expenditures: A multi-state RD analysis of survey and administrative data
  

  February 2023

  Authors: Michael Mueller-Smith, Carl Lieberman, Elizabeth Luh

  Working Paper Number:

  CES-23-06

  Millions of people in the United States face fines and fees in the criminal court system each year, totaling over $27 billion in overall criminal debt to-date. In this study, we leverage five distinct natural experiments in Florida, Michigan, North Carolina, Texas, and Wisconsin using regression discontinuity designs to evaluate the causal impact of such financial sanctions and user fees. We consider a range of long-term outcomes including employment, recidivism, household expenditures, and other self-reported measures of well-being, which we measure through a combination of administrative records on earnings and employment, the Criminal Justice Administrative Records System, and household surveys. We find consistent evidence across the range of natural experiments and subgroup analyses of precise null effects on the population, ruling out long-run impacts larger than +/-3.6% on total earnings and +/-4.7% on total recidivism. Failure to find changes in outcomes undermines popular narratives of poverty traps arising from criminal debt but argues against the use of fines and fees as a source of local revenue and as a crime control tool.
  View Full Paper PDF

  ---

• Working Paper

  
  
  Self-Employment Income Reporting on Surveys
  

  April 2023

  Authors: John Voorheis, Christian Imboden, Caroline Weber

  Working Paper Number:

  CES-23-19

  We examine the relation between administrative income data and survey reports for self-employed and wage-earning respondents from 2000 - 2015. The self-employed report 40 percent more wages and self-employment income in the survey than in tax administrative records; this estimate nets out differences between these two sources that are also shared by wage-earners. We provide evidence that differential reporting incentives are an important explanation of the larger self-employed gap by exploiting a well-known artifact ' self-employed respondents exhibit substantial bunching at the first EITC kink in their administrative records. We do not observe the same behavior in their survey responses even after accounting for survey measurement concerns.
  View Full Paper PDF

  ---

• Working Paper

  
  
  National Experimental Wellbeing Statistics - Version 1
  

  February 2023

  Authors: Nikolas Mittag, Joshua Mitchell, Adam Bee, Jonathan Rothbaum, Carl Sanders, Lawrence Schmidt, Matthew Unrath

  Working Paper Number:

  CES-23-04

  This is the U.S. Census Bureau's first release of the National Experimental Wellbeing Statistics (NEWS) project. The NEWS project aims to produce the best possible estimates of income and poverty given all available survey and administrative data. We link survey, decennial census, administrative, and third-party data to address measurement error in income and poverty statistics. We estimate improved (pre-tax money) income and poverty statistics for 2018 by addressing several possible sources of bias documented in prior research. We address biases from 1) unit nonresponse through improved weights, 2) missing income information in both survey and administrative data through improved imputation, and 3) misreporting by combining or replacing survey responses with administrative information. Reducing survey error substantially affects key measures of well-being: We estimate median household income is 6.3 percent higher than in survey estimates, and poverty is 1.1 percentage points lower. These changes are driven by subpopulations for which survey error is particularly relevant. For house holders aged 65 and over, median household income is 27.3 percent higher and poverty is 3.3 percentage points lower than in survey estimates. We do not find a significant impact on median household income for householders under 65 or on child poverty. Finally, we discuss plans for future releases: addressing other potential sources of bias, releasing additional years of statistics, extending the income concepts measured, and including smaller geographies such as state and county.
  View Full Paper PDF

  ---

• Working Paper

  
  
  Childhood Housing and Adult Earnings: A Between-Siblings Analysis of Housing Vouchers and Public Housing
  

  January 2013

  Authors: John Haltiwanger, Fredrik Andersson, Daniel Weinberg, Mark J. Kutzbach, Giordano Palloni, Henry O. Pollakowski

  Working Paper Number:

  CES-13-48RR

  To date, research on the long-term effects of childhood participation in voucher-assisted and public housing has been limited by the lack of data and suitable identification strategies. We create a national level longitudinal data set that enables us to analyze how children's housing experiences affect adult earnings and incarceration rates. While naive estimates suggest there are substantial negative consequences to childhood participation in voucher assisted and public housing, this result appears to be driven largely by selection of households into housing assistance programs. To mitigate this source of bias, we employ household fixed-effects specifications that use only within-household (across-sibling) variation for identification. Compared to naive specifications, household fixed-effects estimates for earnings are universally more positive, and they suggest that there are positive and statistically significant benefits from childhood residence in assisted housing on young adult earnings for nearly all demographic groups. Childhood participation in assisted housing also reduces the likelihood of incarceration across all household race/ethnicity groups. Time spent in voucher-assisted or public housing is especially beneficial for females from non-Hispanic Black households, who experience substantial increases in expected earnings and lower incarceration rates.
  View Full Paper PDF

  ---

• Working Paper

  
  
  Spillovers From Costly Credit
  

  March 2013

  Authors: Brian T. Melzer

  Working Paper Number:

  CES-13-11

  Recent research on the effects of credit access among low- and moderate-income households finds that high-cost payday loans exacerbate, rather than alleviate, financial distress for a subset of borrowers (Melzer 2011; Skiba and Tobacman 2011). In this study I find that others, outside the borrowing household, bear a portion of these costs too: households with payday loan access are 20% more likely to use food assistance benefits and 10% less likely to make child support payments required of non-resident parents. These findings suggest that as borrowers accommodate interest and principal payments on payday loan debt, they prioritize loan payments over other liabilities like child support payments and they turn to transfer programs like food stamps to supplement the household's resources. To establish this finding, the analysis uses a measure of payday loan access that is robust to the concern that lender location decisions and state policies governing payday lending are endogenous relative to household financial condition. The analysis also confirms that the effect is absent in the mid-1990s, prior to the spread of payday lending, and that the effect grows over time, in parallel with the growth of payday lending.
  View Full Paper PDF

  ---

• Working Paper

  
  
  Using Linked Survey and Administrative Data to Better Measure Income: Implications for Poverty, Program Effectiveness and Holes in the Safety Net
  

  October 2015

  Authors: Bruce Meyer, Nikolas Mittag

  Working Paper Number:

  CES-15-35

  We examine the consequences of underreporting of transfer programs in household survey data for several prototypical analyses of low-income populations. We focus on the Current Population Survey (CPS), the source of official poverty and inequality statistics, but provide evidence that our qualitative conclusions are likely to apply to other surveys. We link administrative data for food stamps, TANF, General Assistance, and subsidized housing from New York State to the CPS at the individual level. Program receipt in the CPS is missed for over one-third of housing assistance recipients, 40 percent of food stamp recipients and 60 percent of TANF and General Assistance recipients. Dollars of benefits are also undercounted for reporting recipients, particularly for TANF, General Assistance and housing assistance. We find that the survey data sharply understate the income of poor households, as conjectured in past work by one of the authors. Underreporting in the survey data also greatly understates the effects of anti-poverty programs and changes our understanding of program targeting, often making it seem that welfare programs are less targeted to both the very poorest and middle income households than they are. Using the combined data rather than survey data alone, the poverty reducing effect of all programs together is nearly doubled while the effect of housing assistance is tripled. We also re-examine the coverage of the safety net, specifically the share of people without work or program receipt. Using the administrative measures of program receipt rather than the survey ones often reduces the share of single mothers falling through the safety net by one-half or more.
  View Full Paper PDF

  ---

• Working Paper

  
  
  The Antipoverty Impact of the EITC: New Estimates from Survey and Administrative Tax Records
  

  April 2019

  Authors: Maggie R. Jones, James P. Ziliak

  Working Paper Number:

  CES-19-14R

  We reassess the antipoverty effects of the EITC using unique data linking the CPS Annual Social and Economic Supplement to IRS data for the same individuals spanning years 2005-2016. We compare EITC benefits from standard simulators to administrative EITC payments and find that significantly more actual EITC payments flow to childless tax units than predicted, and to those whose family income places them above official poverty thresholds. However, actual EITC payments appear to be target efficient at the tax unit level. In 2016, about 3.1 million persons were lifted out of poverty by the EITC, substantially less than prior estimates.
  View Full Paper PDF

  ---