When and Why Does Nonresponse Occur? Comparing the Determinants of Initial Unit Nonresponse and Panel Attrition
September 2023
Working Paper Number:
CES-23-44
Abstract
Though unit nonresponse threatens data quality in both cross-sectional and panel surveys, little is understood about how initial nonresponse and later panel attrition may be theoretically or empirically distinct phenomena. This study advances current knowledge of the determinants of both unit nonresponse and panel attrition within the context of the U.S. Census Bureau's Survey of Income and Program Participation (SIPP) panel survey, which I link with high-quality federal administrative records, paradata, and geographic data. By exploiting the SIPP's interpenetrated sampling design and relying on cross-classified random effects modeling, this study quantifies the relative effects of sample household, interviewer, and place characteristics on baseline nonresponse and later attrition, addressing a critical gap in the literature. Given the reliance on successful record linkages between survey sample households and federal administrative data in the nonresponse research, this study also undertakes an explicitly spatial analysis of the place-based characteristics associated with successful record linkages in the U.S.
Document Tags and Keywords
Keywords
Keywords are automatically generated using KeyBERT, a powerful and innovative
keyword extraction tool that utilizes BERT embeddings to ensure high-quality and contextually relevant
keywords.
By analyzing the content of working papers, KeyBERT identifies terms and phrases that capture the essence of the
text, highlighting the most significant topics and trends. This approach not only enhances searchability but
provides connections that go beyond potentially domain-specific author-defined keywords.
:
census data,
survey,
respondent,
unobserved,
disadvantaged,
housing,
residential,
sampling,
sample,
survey households,
resident,
disparity,
survey income,
census responses
Tags
Tags are automatically generated using a pretrained language model from spaCy, which excels at
several tasks, including entity tagging.
The model is able to label words and phrases by part-of-speech,
including "organizations." By filtering for frequent words and phrases labeled as "organizations", papers are
identified to contain references to specific institutions, datasets, and other organizations.
:
Ordinary Least Squares,
Current Population Survey,
Decennial Census,
Survey of Income and Program Participation,
Computer Assisted Telephone Interviews and Computer Assisted Personal Interviews,
American Community Survey,
Health and Retirement Study,
Protected Identification Key,
Computer Assisted Personal Interview,
General Education Development,
Person Validation System,
CATI
Similar Working Papers
Similarity between working papers are determined by an unsupervised neural
network model
know as Doc2Vec.
Doc2Vec is a model that represents entire documents as fixed-length vectors, allowing for the
capture of semantic meaning in a way that relates to the context of words within the document. The model learns to
associate a unique vector with each document while simultaneously learning word vectors, enabling tasks such as
document classification, clustering, and similarity detection by preserving the order and structure of words. The
document vectors are compared using cosine similarity/distance to determine the most similar working papers.
Papers identified with 🔥 are in the top 20% of similarity.
The 10 most similar working papers to the working paper 'When and Why Does Nonresponse Occur? Comparing the Determinants of Initial Unit Nonresponse and Panel Attrition' are listed below in order of similarity.
-
Working PaperResident Perceptions of Crime: How Similar are They to Official Crime Rates?
March 2007
Working Paper Number:
CES-07-10
This study compares the relationship between official crime rates and residents' perceptions of crime in census tracts. Employing a unique dataset that links household level data from the American Housing Survey metro samples over a period of 25 years (1976-2000) with official crime rate data for census tracts in selected cities during selected years, this large sample provides considerable ability to generalize the findings. I find that residents' perception of crime is most strongly related to official rates of tract violent crime. Models simultaneously taking into account both violent and property crime consistently found that property crime actually has a negative effect on perceived crime. Among types of violent crime, the robbery rate is consistently related to higher levels of perceived crime in the tract, whereas it appears a structural shift occurred in the mid-1980s in which aggravated assault and murder rates now impact perceptions of crime, even when taking into account the robbery rate.View Full Paper PDF
-
Working PaperWhose Neighborhood Now? Gentrification and Community Life in Low-Income Urban Neighborhoods
June 2024
Working Paper Number:
CES-24-29
Gentrification is a process of urban change that has wide-ranging social and political impacts, but previous studies provide divergent findings. Does gentrification leave residents feeling alienated, or does it bolster neighborhood social satisfaction? Politically, does urban change mobilize residents, or leave them disengaged? I assess a national, cross-sectional sample of about 17,500 respondents in lower-income urban neighborhoods, and use a structural equation modeling approach to model six latent variables pertaining to local social environment and political participation. Amongst the full sample, gentrification has a positive association with all six factors. However, this relationship depends upon respondents' level of income, length of residency, and racial identity. White residents and those with shorter length of residency report higher levels of social cohesion as gentrification increases, but there is no such association amongst racial minority groups and longer-term residents. This finding aligns with a perspective on gentrification as a racialized process, and demonstrates that gentrification-related amenities primarily serve the interests of white residents and newcomers. All groups, however, are more likely to participate in neighborhood politics as gentrification increases, drawing attention to the agency of local residents as they attempt to influence processes of urban change.View Full Paper PDF
-
Working PaperThe Impact of Household Surveys on 2020 Census Self-Response
July 2022
Working Paper Number:
CES-22-24
Households who were sampled in 2019 for the American Community Survey (ACS) had lower self-response rates to the 2020 Census. The magnitude varied from -1.5 percentage point for household sampled in January 2019 to -15.1 percent point for households sampled in December 2019. Similar effects are found for the Current Population Survey (CPS) as well.View Full Paper PDF
-
Working PaperFederal-Local Partnerships on Immigration Law Enforcement: Are the Policies Effective in Reducing Violent Victimization?
April 2023
Working Paper Number:
CES-23-18
Our understanding of how immigration enforcement impacts crime has been informed by data from the police crime statistics. This study complements existing research by using longitudinal multilevel data from the National Crime Victimization Survey (NCVS) for 2005-2014 to simultaneously assess the impact of the three predominant immigration policies that have been implemented in local communities. The results indicate that the activation of Secure Communities and 287(g) task force agreements significantly increased violent victimization risk among Latinos, whereas they showed no evident impact on victimization risk among non-Latino Whites and Blacks. The activation of 287(g) jail enforcement agreements and anti-detainer policies had no significant impact on violent victimization risk during the period.Contrary to their stated purpose of enhancing public safety, our results show that the Secure Communities program and 287(g) task force agreements did not reduce crime, but instead eroded security in American communities by increasing the likelihood that Latinos experienced violent victimization. These results support the Federal government's ending of 287(g) task force agreements and its more recent move to end the Secure Communities program. Additionally, the results of our study add to the evidence challenging claims that anti-detainer policies pose a threat to violence risk.View Full Paper PDF
-
Working PaperDisconnected Geography: A Spatial Analysis of Disconnected Youth in the United States
January 2016
Working Paper Number:
CES-16-37
Since the Great Recession, US policy and advocacy groups have sought to better understand its effect on a group of especially vulnerable young adults who are not enrolled in school or training programs and not participating in the labor market, so called 'disconnected youth.' This article distinguishes between disconnected youth and unemployed youth and examines the spatial clustering of these two groups across counties in the US. The focus is to ascertain whether there are differences in underlying contextual factors among groups of counties that are mutually exclusive and spatially disparate (non-adjacent), comprising two types of spatial clusters ' high rates of disconnected youth and high rates of unemployed youth. Using restricted, household-level census data inside the Census Research Data Center (RDC) under special permission by the US Census Bureau, we were able to define these two groups using detailed household questionnaires that are not available to researchers outside the RDC. The geospatial patterns in the two types of clusters suggest that places with high concentrations of disconnected youth are distinctly different in terms of underlying characteristics from places with high concentrations of unemployed youth. These differences include, among other things, arrests for synthetic drug production, enclaves of poor in rural areas, persistent poverty in areas, educational attainment in the populace, children in poverty, persons without health insurance, the social capital index, and elders who receive disability benefits. This article provides some preliminary evidence regarding the social forces underlying the two types of observed geospatial clusters and discusses how they differ.View Full Paper PDF
-
Working PaperHigh Labor Force Attachment, but Few Social Ties? Life-Course Predictors of Women's Receipt of Childcare Subsidies
September 2019
Working Paper Number:
CES-19-26
The U.S. federal Child Care and Development Fund (CCDF) childcare subsidy represents the largest source of means-tested assistance for U.S. families with low incomes. The CCDF subsidy aims to help mothers with low incomes gain employment and education, with implications for women's labor force participation, and the wellbeing of their children. Because recipients of the CCDF subsidy are either already employed, or seek the subsidy with the goal of gaining employment or schooling, this group may represent the public assistance recipients who are best able to succeed in the low-wage labor market. However, existing research on the CCDF observes recipients only after they begin receiving the subsidy, thus giving an incomplete picture of whether recipients may select into subsidy receipt, and how subsidy recipiency is situated in women's broader work and family trajectories. My study links administrative records from the CCDF to the American Community Survey (ACS) to construct a longitudinal data set from 38 states that observes CCDF recipients in the 1-2 years before they first received the subsidy. I compare women who subsequently received the CCDF subsidy to other women with low incomes in the ACS who did not go on to receive the subsidy, with a total of roughly 641,000 individuals. I find that CCDF recipients are generally positively-selected on employment history and educational attainment, but appear to have lower levels of social support than non-recipients.View Full Paper PDF
-
Working PaperNeighborhood Effects on High-School Drop-Out Rates and Teenage Childbearing: Tests for Non-Linearities, Race-Specific Effects, Interactions with Family Characteristics, and Endogenous Causation using Geocoded California Census Microdata
May 2008
Working Paper Number:
CES-08-12
This paper examines the relationship between neighborhood characteristics and the likelihood that a youth will drop out of high school or have a child during the teenage years. Using a dataset that is uniquely wellsuited to the study of neighborhood effects, the impact of the neighborhood poverty rate and the percentage of professionals in the local labor force on youth outcomes in California is examined. The first section of the paper tests for non-linearities in the relationship between indicators of neighborhood distress and youth outcomes. Some evidence is found for a break-point at low levels of poverty. Suggestive but inconclusive evidence is also found for a second breakpoint, at very high levels of poverty, for African-American youth only. The second part of the paper examines interactions between family background characteristics and neighborhood effects, and finds that White youth are most sensitive to neighborhood effects, while the effect of parental education depends on the neighborhood measure in question. Among White youth, those from single-parent households are more vulnerable to neighborhood conditions. The third section of the paper finds that for White youth and Hispanic youth, the relevant neighborhood variables appear to be the own-race poverty rates and the percentage of professionals of youths' own race. The final section of the paper estimates a tract-fixed effects model, using the results from the third section to define multiple relevant poverty rates within each tract. The fixed-effects specification suggests that for White and Hispanic youth in California, neighborhood effects remain significant, even with the inclusion of controls for any unobserved family and neighborhood characteristics that are constant within tracts.View Full Paper PDF
-
Working PaperThe Icing on the Cake: The Effects of Monetary Incentives on Income Data Quality in the SIPP
January 2024
Working Paper Number:
CES-24-03
Accurate measurement of key income variables plays a crucial role in economic research and policy decision-making. However, the presence of item nonresponse and measurement error in survey data can cause biased estimates. These biases can subsequently lead to sub-optimal policy decisions and inefficient allocation of resources. While there have been various studies documenting item nonresponse and measurement error in economic data, there have not been many studies investigating interventions that could reduce item nonresponse and measurement error. In our research, we investigate the impact of monetary incentives on reducing item nonresponse and measurement error for labor and investment income in the Survey of Income and Program Participation (SIPP). Our study utilizes a randomized incentive experiment in Waves 1 and 2 of the 2014 SIPP, which allows us to assess the effectiveness of incentives in reducing item nonresponse and measurement error. We find that households receiving incentives had item nonresponse rates that are 1.3 percentage points lower for earnings and 1.5 percentage points lower for Social Security income. Measurement error was 6.31 percentage points lower at the intensive margin for interest income, and 16.48 percentage points lower for dividend income compared to non-incentive recipient households. These findings provide valuable insights for data producers and users and highlight the importance of implementing strategies to improve data quality in economic research.View Full Paper PDF
-
Working PaperLessons for Targeted Program Evaluation: A Personal and Professional History of the Survey of Program Dynamics
August 2007
Working Paper Number:
CES-07-24
The Survey of Program Dynamics (SPD) was created by the 1996 welfare reform legislation to facilitate its evaluation. This paper describes the evolution of that survey, discusses its implementation, and draws lessons for future evaluation. Large-scale surveys can be an important part of a portfolio of evaluation methods, but sufficient time must be given to data collection agencies if a high-quality longitudinal survey is expected. Such a survey must have both internal (agency) and external (policy analyst) buy-in. Investments in data analysis by agency staff, downplayed in favor of larger sample sizes given a fixed budget, could have contributed to more external acceptance. More attention up-front to reducing the potentially deleterious effects of attrition in longitudinal surveys, such as through the use of monetary incentives, might have been worthwhile. Given the problems encountered by the Census Bureau in producing the SPD, I argue that ongoing multi-purpose longitudinal surveys like the Survey of Income and Program Participation are potentially more valuable than episodic special-purpose surveys.View Full Paper PDF
-
Working PaperPredicting the Effect of Adding a Citizenship Question to the 2020 Census
June 2019
Working Paper Number:
CES-19-18
The addition of a citizenship question to the 2020 census could affect the self-response rate, a key driver of the cost and quality of a census. We find that citizenship question response patterns in the American Community Survey (ACS) suggest that it is a sensitive question when asked about administrative record noncitizens but not when asked about administrative record citizens. ACS respondents who were administrative record noncitizens in 2017 frequently choose to skip the question or answer that the person is a citizen. We predict the effect on self-response to the entire survey by comparing mail response rates in the 2010 ACS, which included a citizenship question, with those of the 2010 census, which did not have a citizenship question, among households in both surveys. We compare the actual ACS-census difference in response rates for households that may contain noncitizens (more sensitive to the question) with the difference for households containing only U.S. citizens. We estimate that the addition of a citizenship question will have an 8.0 percentage point larger effect on self-response rates in households that may have noncitizens relative to those with only U.S. citizens. Assuming that the citizenship question does not affect unit self-response in all-citizen households and applying the 8.0 percentage point drop to the 28.1 % of housing units potentially having at least one noncitizen would predict an overall 2.2 percentage point drop in self-response in the 2020 census, increasing costs and reducing the quality of the population count.View Full Paper PDF
