BIAS IN FOOD STAMPS PARTICIPATION ESTIMATES IN THE PRESENCE OF MISREPORTING ERROR
March 2013
Working Paper Number:
CES-13-13
Abstract
This paper focuses on how survey misreporting of food stamp receipt can bias demographic estimation of program participation. Food stamps is a federally funded program which subsidizes the nutrition of low-income households. In order to improve the reach of this program, studies on how program participation varies by demographic groups have been conducted using census data. Census data are subject to a lot of misreporting error, both underreporting and over-reporting, which can bias the estimates. The impact of misreporting error on estimate bias is examined by calculating food stamp participation rates, misreporting rates, and bias for select household characteristics (covariates).
Document Tags and Keywords
Keywords
Keywords are automatically generated using KeyBERT, a powerful and innovative
keyword extraction tool that utilizes BERT embeddings to ensure high-quality and contextually relevant
keywords.
By analyzing the content of working papers, KeyBERT identifies terms and phrases that capture the essence of the
text, highlighting the most significant topics and trends. This approach not only enhances searchability but
provides connections that go beyond potentially domain-specific author-defined keywords.
:
data census,
census data,
survey,
bias,
population,
census bureau,
disparity,
survey income,
income households,
grocery
Tags
Tags are automatically generated using a pretrained language model from spaCy, which excels at
several tasks, including entity tagging.
The model is able to label words and phrases by part-of-speech,
including "organizations." By filtering for frequent words and phrases labeled as "organizations", papers are
identified to contain references to specific institutions, datasets, and other organizations.
:
Current Population Survey,
Survey of Income and Program Participation,
American Community Survey,
Protected Identification Key,
Supplemental Nutrition Assistance Program
Similar Working Papers
Similarity between working papers are determined by an unsupervised neural
network model
know as Doc2Vec.
Doc2Vec is a model that represents entire documents as fixed-length vectors, allowing for the
capture of semantic meaning in a way that relates to the context of words within the document. The model learns to
associate a unique vector with each document while simultaneously learning word vectors, enabling tasks such as
document classification, clustering, and similarity detection by preserving the order and structure of words. The
document vectors are compared using cosine similarity/distance to determine the most similar working papers.
Papers identified with 🔥 are in the top 20% of similarity.
The 10 most similar working papers to the working paper 'BIAS IN FOOD STAMPS PARTICIPATION ESTIMATES IN THE PRESENCE OF MISREPORTING ERROR' are listed below in order of similarity.
-
Working PaperMISCLASSIFICATION IN BINARY CHOICE MODELS🔥
May 2013
Working Paper Number:
CES-13-27
We derive the asymptotic bias from misclassification of the dependent variable in binary choice models. Measurement error is necessarily non-classical in this case, which leads to bias in linear and non-linear models even if only the dependent variable is mismeasured. A Monte Carlo study and an application to food stamp receipt show that the bias formulas are useful to analyze the sensitivity of substantive conclusions, to interpret biased coefficients and imply features of the estimates that are robust to misclassification. Using administrative records linked to survey data as validation data, we examine estimators that are consistent under misclassification. They can improve estimates if their assumptions hold, but can aggravate the problem if the assumptions are invalid. The estimators differ in their robustness to such violations, which can be improved by incorporating additional information. We propose tests for the presence and nature of misclassification that can help to choose an estimator.View Full Paper PDF
-
Working PaperA METHOD OF CORRECTING FOR MISREPORTING APPLIED TO THE FOOD STAMP PROGRAM
May 2013
Working Paper Number:
CES-13-28
Survey misreporting is known to be pervasive and bias common statistical analyses. In this paper, I first use administrative data on SNAP receipt and amounts linked to American Community Survey data from New York State to show that survey data can misrepresent the program in important ways. For example, more than 1.4 billion dollars received are not reported in New York State alone. 46 percent of dollars received by house- holds with annual income above the poverty line are not reported in the survey data, while only 19 percent are missing below the poverty line. Standard corrections for measurement error cannot remove these biases. I then develop a method to obtain consistent estimates by combining parameter estimates from the linked data with publicly available data. This conditional density method recovers the correct estimates using public use data only, which solves the problem that access to linked administrative data is usually restricted. I examine the degree to which this approach can be used to extrapolate across time and geography, in order to solve the problem that validation data is often based on a convenience sample. I present evidence from within New York State that the extent of heterogeneity is small enough to make extrapolation work well across both time and geography. Extrapolation to the entire U.S. yields substantive differences to survey data and reduces deviations from official aggregates by a factor of 4 to 9 compared to survey aggregates.View Full Paper PDF
-
Working PaperErrors in Survey Reporting and Imputation and Their Effects on Estimates of Food Stamp Program Participation
April 2011
Working Paper Number:
CES-11-14
Benefit receipt in major household surveys is often underreported. This misreporting leads to biased estimates of the economic circumstances of disadvantaged populations, program takeup, and the distributional effects of government programs, and other program effects. We use administrative data on Food Stamp Program (FSP) participation matched to American Community Survey (ACS) and Current Population Survey (CPS) household data. We show that nearly thirty-five percent of true recipient households do not report receipt in the ACS and fifty percent do not report receipt in the CPS. Misreporting, both false negatives and false positives, varies with individual characteristics, leading to complicated biases in FSP analyses. We then directly examine the determinants of program receipt using our combined administrative and survey data. The combined data allow us to examine accurate participation using individual characteristics missing in administrative data. Our results differ from conventional estimates using only survey data, as such estimates understate participation by single parents, non-whites, low income households, and other groups. To evaluate the use of Census Bureau imputed ACS and CPS data, we also examine whether our estimates using survey data alone are closer to those using the accurate combined data when imputed survey observations are excluded. Interestingly, excluding the imputed observations leads to worse ACS estimates, but has less effect on the CPS estimates.View Full Paper PDF
-
Working PaperWithin and Across County Variation in SNAP Misreporting: Evidence from Linked ACS and Administrative Records
July 2014
Working Paper Number:
carra-2014-05
This paper examines sub-state spatial and temporal variation in misreporting of participation in the Supplemental Nutrition Assistance Program (SNAP) using several years of the American Community Survey linked to SNAP administrative records from New York (2008-2010) and Texas (2006-2009). I calculate county false-negative (FN) and false-positive (FP) rates for each year of observation and find that, within a given state and year, there is substantial heterogeneity in FN rates across counties. In addition, I find evidence that FN rates (but not FP rates) persist over time within counties. This persistence in FN rates is strongest among more populous counties, suggesting that when noise from sampling variation is not an issue, some counties have consistently high FN rates while others have consistently low FN rates. This finding is important for understanding how misreporting might bias estimates of sub-state SNAP participation rates, changes in those participation rates, and effects of program participation. This presentation was given at the CARRA Seminar, June 27, 2013View Full Paper PDF
-
Working PaperEstimation and Inference in Regression Discontinuity Designs with Clustered Sampling
August 2015
Working Paper Number:
carra-2015-06
Regression Discontinuity (RD) designs have become popular in empirical studies due to their attractive properties for estimating causal effects under transparent assumptions. Nonetheless, most popular procedures assume i.i.d. data, which is not reasonable in many common applications. To relax this assumption, we derive the properties of traditional non-parametric estimators in a setting that incorporates potential clustering at the level of the running variable, and propose an accompanying optimal-MSE bandwidth selection rule. Simulation results demonstrate that falsely assuming data are i.i.d. when selecting the bandwidth may lead to the choice of bandwidths that are too small relative to the optimal-MSE bandwidth. Last, we apply our procedure using person-level microdata that exhibits clustering at the census tract level to analyze the impact of the Low-Income Housing Tax Credit program on neighborhood characteristics and low-income housing supply.View Full Paper PDF
-
Working PaperThe EITC and Intergenerational Mobility
November 2020
Working Paper Number:
CES-20-35
We study how the largest federal tax-based policy intended to promote work and increase incomes among the poor'the Earned Income Tax Credit (EITC)'affects the socioeconomic standing of children who grew up in households affected by the policy. Using the universe of tax filer records for children linked to their parents, matched with demographic and household information from the decennial Census and American Community Survey data, we exploit exogenous differences by children's ages in the births and 'aging out' of siblings to assess the effect of EITC generosity on child outcomes. We focus on assessing mobility in the child income distribution, conditional on the parents' position in the parental income distribution. Our findings suggest significant and mostly positive effects of more generous EITC refunds on the next generation that vary substantially depending on the child's household type (single-mother or married family) and by the child's gender. All children except White children from single-mother households experience increases in cohort-specific income rank, own family income, and the probability of working at ages 25'26 in response to greater EITC generosity. Children from married households show a considerably stronger response on these measures than do children from single-mother households. Because of the concentration of family types within race groups, the more positive response among children from married households suggests the EITC might lead to higher within-generation racial income inequality. Finally, we examine how the impact of EITC generosity varies by the age at which children are exposed to higher benefits. These results suggest that children who first receive the more generous two-child treatment at later ages have a stronger positive response in terms of rank and family income than children exposed at younger ages.View Full Paper PDF
-
Working PaperThe Measurement of Medicaid Coverage in the SIPP: Evidence from California, 1990-1996
September 2002
Working Paper Number:
CES-02-21
This paper studies the accuracy of reported Medicaid coverage in the Survey of Income and Program Participation (SIPP) using a unique data set formed by matching SIPP survey responses to administrative records from the State of California. Overall, we estimate that the SIPP underestimates Medicaid coverage in the California populaton by about 10 percent. Among SIPP respondents who can be matched to administrative records, we estimate that the probability someone reports Medicaid coverage in a month when they are actually covered is around 85 percent. The corresponding probability for low-income children is even higher ' at least 90 percent. These estimates suggest that the SIPP provides reasonably accurate coverage reports for those who are actually in the Medicaid system. On the other hand, our estimate of the false positive rate (the rate of reported coverage for those who are not covered in the administrative records) is relatively high: 2.5 percent for the sample as a whole, and up to 20 percent for poor children. Some of this is due to errors in the recording of Social Security numbers in the administrative system, rather than to problems in the SIPP.View Full Paper PDF
-
Working PaperThe Effects of Smoking in Young Adulthood on Smoking and Health Later in Life: Evidence Based on the Vietnam Era Draft Lottery
September 2008
Working Paper Number:
CES-08-35
An important, unresolved question for health policymakers and consumers is whether cigarette smoking in young adulthood has significant lasting effects into later adulthood. The Vietnam era draft lottery offers an opportunity to address this question, because it randomly assigned young men to be more likely to experience conditions favoring cigarette consumption, including highly subsidized prices. Using this natural experiment, we find that military service increased the probability of smoking by 35 percentage points as of 1978-80, when men in the relevant cohorts were aged 25-30, but later in adulthood this effect was substantially attenuated and did not lead to large negative health effects.View Full Paper PDF
-
Working PaperThe Work Disincentive Effects of the Disability Insurance Program in the 1990s
February 2006
Working Paper Number:
CES-06-05
In this paper we evaluate the work disincentive effects of the Disability Insurance program during the 1990s. To accomplish this we construct a new large data set with detailed information on DI application and award decisions and use two different econometric evaluation methods. First, we apply a comparison group approach proposed by John Bound to estimate an upper bound for the work disincentive effect of the current DI program. Second, we adopt a Regression-Discontinuity approach that exploits a particular feature of the DI eligibility determination process to provide a credible point estimate of the impact of the DI program on labor supply for an important subset of DI applicants. Our estimates indicate that during the 1990s the labor force participation rate of DI beneficiaries would have been at most 20 percentage points higher had none received benefits. In addition, we find even smaller labor supply responses for the subset of 'marginal' applicants whose disability determination is based on vocational factors.View Full Paper PDF
-
Working PaperThe Distributional Effects of Minimum Wages: Evidence from Linked Survey and Administrative Data
March 2018
Working Paper Number:
carra-2018-02
States and localities are increasingly experimenting with higher minimum wages in response to rising income inequality and stagnant economic mobility, but commonly used public datasets offer limited opportunities to evaluate the extent to which such changes affect earnings growth. We use administrative earnings data from the Social Security Administration linked to the Current Population Survey to overcome important limitations of public data and estimate effects of the minimum wage on growth incidence curves and income mobility profiles, providing insight into how cross-sectional effects of the minimum wage on earnings persist over time. Under both approaches, we find that raising the minimum wage increases earnings growth at the bottom of the distribution, and those effects persist and indeed grow in magnitude over several years. This finding is robust to a variety of specifications, including alternatives commonly used in the literature on employment effects of the minimum wage. Instrumental variables and subsample analyses indicate that geographic mobility likely contributes to the effects we identify. Extrapolating from our estimates suggests that a minimum wage increase comparable in magnitude to the increase experienced in Seattle between 2013 and 2016 would have blunted some, but not nearly all, of the worst income losses suffered at the bottom of the income distribution during the Great Recession.View Full Paper PDF
