Though unit nonresponse threatens data quality in both cross-sectional and panel surveys, little is understood about how initial nonresponse and later panel attrition may be theoretically or empirically distinct phenomena. This study advances current knowledge of the determinants of both unit nonresponse and panel attrition within the context of the U.S. Census Bureau's Survey of Income and Program Participation (SIPP) panel survey, which I link with high-quality federal administrative records, paradata, and geographic data. By exploiting the SIPP's interpenetrated sampling design and relying on cross-classified random effects modeling, this study quantifies the relative effects of sample household, interviewer, and place characteristics on baseline nonresponse and later attrition, addressing a critical gap in the literature. Given the reliance on successful record linkages between survey sample households and federal administrative data in the nonresponse research, this study also undertakes an explicitly spatial analysis of the place-based characteristics associated with successful record linkages in the U.S.
-
The Impact of Household Surveys on 2020 Census Self-Response
July 2022
Working Paper Number:
CES-22-24
Households who were sampled in 2019 for the American Community Survey (ACS) had lower self-response rates to the 2020 Census. The magnitude varied from -1.5 percentage point for household sampled in January 2019 to -15.1 percent point for households sampled in December 2019. Similar effects are found for the Current Population Survey (CPS) as well.
View Full
Paper PDF
-
The Icing on the Cake: The Effects of Monetary Incentives on Income Data Quality in the SIPP
January 2024
Working Paper Number:
CES-24-03
Accurate measurement of key income variables plays a crucial role in economic research and policy decision-making. However, the presence of item nonresponse and measurement error in survey data can cause biased estimates. These biases can subsequently lead to sub-optimal policy decisions and inefficient allocation of resources. While there have been various studies documenting item nonresponse and measurement error in economic data, there have not been many studies investigating interventions that could reduce item nonresponse and measurement error. In our research, we investigate the impact of monetary incentives on reducing item nonresponse and measurement error for labor and investment income in the Survey of Income and Program Participation (SIPP). Our study utilizes a randomized incentive experiment in Waves 1 and 2 of the 2014 SIPP, which allows us to assess the effectiveness of incentives in reducing item nonresponse and measurement error. We find that households receiving incentives had item nonresponse rates that are 1.3 percentage points lower for earnings and 1.5 percentage points lower for Social Security income. Measurement error was 6.31 percentage points lower at the intensive margin for interest income, and 16.48 percentage points lower for dividend income compared to non-incentive recipient households. These findings provide valuable insights for data producers and users and highlight the importance of implementing strategies to improve data quality in economic research.
View Full
Paper PDF
-
Resident Perceptions of Crime: How Similar are They to Official Crime Rates?
March 2007
Working Paper Number:
CES-07-10
This study compares the relationship between official crime rates and residents' perceptions of crime in census tracts. Employing a unique dataset that links household level data from the American Housing Survey metro samples over a period of 25 years (1976-2000) with official crime rate data for census tracts in selected cities during selected years, this large sample provides considerable ability to generalize the findings. I find that residents' perception of crime is most strongly related to official rates of tract violent crime. Models simultaneously taking into account both violent and property crime consistently found that property crime actually has a negative effect on perceived crime. Among types of violent crime, the robbery rate is consistently related to higher levels of perceived crime in the tract, whereas it appears a structural shift occurred in the mid-1980s in which aggravated assault and murder rates now impact perceptions of crime, even when taking into account the robbery rate.
View Full
Paper PDF
-
Neighborhood Racial Status and White Out-Mobility
March 2026
Working Paper Number:
CES-26-19
Drawing on American Community Survey data, this study examines how whites' relative socioeconomic standing vis-'-vis nonwhite neighbors affects the association between minority presence and white out-mobility. Moving beyond the racial preferences versus racial proxy debate, we integrate group competition and contact theories with status theory to conceptualize 'racial status' as whites' first-order income rank relative to the subgroup status of Black, Hispanic, and Asian residents at the census tract level. Multilevel linear probability models show that whites lacking advantaged status are generally more likely to move. However, the positive association between Black or Asian concentration and white departure is weaker among status-disadvantaged whites, while the negative association with Hispanic concentration is stronger. These patterns lend greater support to contact theory than to group competition theory. By foregrounding relative status, the study demonstrates that racial and socioeconomic mechanisms are intertwined in shaping white residential mobility.
View Full
Paper PDF
-
Whose Neighborhood Now? Gentrification and Community Life in Low-Income Urban Neighborhoods
June 2024
Working Paper Number:
CES-24-29
Gentrification is a process of urban change that has wide-ranging social and political impacts, but previous studies provide divergent findings. Does gentrification leave residents feeling alienated, or does it bolster neighborhood social satisfaction? Politically, does urban change mobilize residents, or leave them disengaged? I assess a national, cross-sectional sample of about 17,500 respondents in lower-income urban neighborhoods, and use a structural equation modeling approach to model six latent variables pertaining to local social environment and political participation. Amongst the full sample, gentrification has a positive association with all six factors. However, this relationship depends upon respondents' level of income, length of residency, and racial identity. White residents and those with shorter length of residency report higher levels of social cohesion as gentrification increases, but there is no such association amongst racial minority groups and longer-term residents. This finding aligns with a perspective on gentrification as a racialized process, and demonstrates that gentrification-related amenities primarily serve the interests of white residents and newcomers. All groups, however, are more likely to participate in neighborhood politics as gentrification increases, drawing attention to the agency of local residents as they attempt to influence processes of urban change.
View Full
Paper PDF
-
Factors that Influence Change in Hispanic Identification: Evidence from Linked Decennial Census and American Community Survey Data
October 2018
Working Paper Number:
CES-18-45
This study explores patterns of ethnic boundary crossing as evidenced by changes in Hispanic origin responses across decennial census and survey data. We identify socioeconomic, cultural, and demographic factors associated with Hispanic response change. In addition, we assess whether changes in the Hispanic origin question between the 2000 and 2010 censuses influenced changes in Hispanic reporting. We use a unique large dataset that links a person's unedited responses to the Hispanic origin question across Census 2000, the 2010 Census and the 2006-2010 American Community Survey five-year file. We find that most of the individuals in the sample identified consistently as Hispanic regardless of changes in the wording of the Hispanic origin question. Individuals who changed in or out of a Hispanic identification, as well as those who consistently identified as non-Hispanic (of Hispanic ancestry), differed in socioeconomic and cultural characteristics from individuals who consistently reported as Hispanic. The likelihood of changing their Hispanic origin response is higher among U.S.-born individuals, those reporting mixed Hispanic and non-Hispanic ancestries, those who speak only English at home, and those who live in tracts that are predominantly non-Hispanic. Racial identification and detailed Hispanic background also influence changes in Hispanic origin responses. Finally, changes in mode and relationship to the reference person in the household are associated with changes in Hispanic origin responses, suggesting that data collection elements also can influence Hispanic origin response change.
View Full
Paper PDF
-
Is Subsidized Childcare Associated with Lower Risk of Grade Retention for Low-Income Children? Evidence from Child Care and Development Fund Administrative Records Linked to the American Community Survey
June 2017
Working Paper Number:
carra-2017-06
This study investigates whether low-income young children's experience of Child Care and Development Fund (CCDF)-subsidized childcare is associated with a lower subsequent likelihood of being held back in grades K-12. High-quality childcare has been shown to improve low-income children's school readiness. However, no previous study has examined the link specifically between subsidized care and grade retention. I do so here by matching information on children from CCDF administrative records to later observations of the same children in the American Community Survey (ACS). I use logistic regression to compare the likelihood of grade retention between CCDF-recipient children and non-recipient children who also appear in the ACS in the years 2008-2014 (N=2,284,857). I find strong evidence for an association between CCDF-subsidized care and lower risk of grade retention, especially among non-Hispanic Black children and Hispanic children. I also find evidence that receiving CCDF-subsidized center-based care in particular is associated with a lower risk of being held back than CCDF-subsidized family daycare, babysitter care, or relative care, again with the largest apparent benefit to non-Hispanic Black children and Hispanic children.
View Full
Paper PDF
-
Status Inconsistency and Geographic Mobility in the United States
March 2026
Working Paper Number:
CES-26-20
This study examines how neighborhood status and individual status jointly shape geographic mobility in the United States. Drawing on restricted-use American Community Survey data, we conceptualize neighborhood status as the relative standing of a census tract's median family income compared to demographically similar reference neighborhoods, and individual status as a household's relative income rank within its tract. Building on comparison theory and status inconsistency perspectives, we test whether mismatches between neighborhood and individual status influence short-distance (within-county) and long-distance (between-county) mobility. Multinomial logistic models reveal that disadvantaged neighborhood status increases within-county mobility, particularly when paired with high individual status, supporting spatial assimilation arguments. Conversely, low individual status in high-status neighborhoods heightens mobility, consistent with relative deprivation theory rather than status signaling. Results suggest that status inconsistency plays a central role in residential decision-making and that neighborhood status primarily affects short-distance mobility. The findings advance research on stratification and internal migration by integrating relative contextual and positional mechanisms.
View Full
Paper PDF
-
Lessons for Targeted Program Evaluation: A Personal and Professional History of the Survey of Program Dynamics
August 2007
Working Paper Number:
CES-07-24
The Survey of Program Dynamics (SPD) was created by the 1996 welfare reform legislation to facilitate its evaluation. This paper describes the evolution of that survey, discusses its implementation, and draws lessons for future evaluation. Large-scale surveys can be an important part of a portfolio of evaluation methods, but sufficient time must be given to data collection agencies if a high-quality longitudinal survey is expected. Such a survey must have both internal (agency) and external (policy analyst) buy-in. Investments in data analysis by agency staff, downplayed in favor of larger sample sizes given a fixed budget, could have contributed to more external acceptance. More attention up-front to reducing the potentially deleterious effects of attrition in longitudinal surveys, such as through the use of monetary incentives, might have been worthwhile. Given the problems encountered by the Census Bureau in producing the SPD, I argue that ongoing multi-purpose longitudinal surveys like the Survey of Income and Program Participation are potentially more valuable than episodic special-purpose surveys.
View Full
Paper PDF
-
Neighborhood Effects on High-School Drop-Out Rates and Teenage Childbearing: Tests for Non-Linearities, Race-Specific Effects, Interactions with Family Characteristics, and Endogenous Causation using Geocoded California Census Microdata
May 2008
Working Paper Number:
CES-08-12
This paper examines the relationship between neighborhood characteristics and the likelihood that a youth will drop out of high school or have a child during the teenage years. Using a dataset that is uniquely wellsuited to the study of neighborhood effects, the impact of the neighborhood poverty rate and the percentage of professionals in the local labor force on youth outcomes in California is examined. The first section of the paper tests for non-linearities in the relationship between indicators of neighborhood distress and youth outcomes. Some evidence is found for a break-point at low levels of poverty. Suggestive but inconclusive evidence is also found for a second breakpoint, at very high levels of poverty, for African-American youth only. The second part of the paper examines interactions between family background characteristics and neighborhood effects, and finds that White youth are most sensitive to neighborhood effects, while the effect of parental education depends on the neighborhood measure in question. Among White youth, those from single-parent households are more vulnerable to neighborhood conditions. The third section of the paper finds that for White youth and Hispanic youth, the relevant neighborhood variables appear to be the own-race poverty rates and the percentage of professionals of youths' own race. The final section of the paper estimates a tract-fixed effects model, using the results from the third section to define multiple relevant poverty rates within each tract. The fixed-effects specification suggests that for White and Hispanic youth in California, neighborhood effects remain significant, even with the inclusion of controls for any unobserved family and neighborhood characteristics that are constant within tracts.
View Full
Paper PDF