An Analysis of Sample Selection and the Reliability of Using Short-term Earnings Averages in SIPP-SSA Matched Data
December 2011
Working Paper Number:
CES-11-39
Abstract
In this paper, we document the extent to which the sample of the Survey of Income and Program Participation that is matched to the Social Security Administration's administrative earnings records is nationally representative. We conclude that the match bias is small, so selection is not a serious concern. The matched sample over-represents individuals who are wealthy, who have financial assets or who have received a government-transfer and under-represents individuals who attrited from the SIPP. We use this matched sample to examine the relationship between short-term averages of earnings from the SIPP earnings and average lifetime earnings from the administrative records. Our estimates suggest that using short averages of earnings may understate the effects of permanent income on particular outcomes of interest.
Document Tags and Keywords
Keywords
Keywords are automatically generated using KeyBERT, a powerful and innovative
keyword extraction tool that utilizes BERT embeddings to ensure high-quality and contextually relevant
keywords.
By analyzing the content of working papers, KeyBERT identifies terms and phrases that capture the essence of the
text, highlighting the most significant topics and trends. This approach not only enhances searchability but
provides connections that go beyond potentially domain-specific author-defined keywords.
:
census research,
respondent,
earnings,
financial,
average,
firms census,
retirement,
wealth,
record,
federal,
welfare,
socioeconomic,
irs,
ssa,
medicare,
medicaid,
earn
Tags
Tags are automatically generated using a pretrained language model from spaCy, which excels at
several tasks, including entity tagging.
The model is able to label words and phrases by part-of-speech,
including "organizations." By filtering for frequent words and phrases labeled as "organizations", papers are
identified to contain references to specific institutions, datasets, and other organizations.
:
Internal Revenue Service,
Social Security Administration,
Survey of Income and Program Participation,
Social Security,
Research Data Center,
Social Security Number,
Detailed Earnings Records,
Master Earnings File,
NUMIDENT
Similar Working Papers
Similarity between working papers are determined by an unsupervised neural
network model
know as Doc2Vec.
Doc2Vec is a model that represents entire documents as fixed-length vectors, allowing for the
capture of semantic meaning in a way that relates to the context of words within the document. The model learns to
associate a unique vector with each document while simultaneously learning word vectors, enabling tasks such as
document classification, clustering, and similarity detection by preserving the order and structure of words. The
document vectors are compared using cosine similarity/distance to determine the most similar working papers.
Papers identified with 🔥 are in the top 20% of similarity.
The 10 most similar working papers to the working paper 'An Analysis of Sample Selection and the Reliability of Using Short-term Earnings Averages in SIPP-SSA Matched Data' are listed below in order of similarity.
-
Working PaperLong-Run Earnings Volatility and Health Insurance Coverage: Evidence from the SIPP Gold Standard File
October 2011
Working Paper Number:
CES-11-35
Despite the notable increase in earnings volatility and the attention paid to the growing ranks of the uninsured, the relationship between career earnings and short- and mediumrun health insurance status has been ignored due to a lack of data. I use a new dataset, the SIPP Gold Standard File, that merges health insurance status and demographics from the Survey of Income and Program Participation with career earnings records from the Social Security Administration (SSA) and the Internal Revenue Service (IRS) to examine the relationship between long-run family earnings volatility and health insurance coverage. I find that more volatile career earnings are associated with an increased probability of experiencing an uninsured episode, with larger effects for men, young workers, and the unmarried. These findings are consistent with the 'scarring' literature, and suggest the importance of safety-net measures for job losses and health insurance coverage.View Full Paper PDF
-
Working PaperResponse Error & the Medicaid undercount in the CPS
December 2016
Working Paper Number:
carra-2016-11
The Current Population Survey Annual Social and Economic Supplement (CPS ASEC) is an important source for estimates of the uninsured population. Previous research has shown that survey estimates produce an undercount of beneficiaries compared to Medicaid enrollment records. We extend past work by examining the Medicaid undercount in the 2007-2011 CPS ASEC compared to enrollment data from the Medicaid Statistical Information System for calendar years 2006-2010. By linking individuals across datasets, we analyze two types of response error regarding Medicaid enrollment - false negative error and false positive error. We use regression analysis to identify factors associated with these two types of response error in the 2011 CPS ASEC. We find that the Medicaid undercount was between 22 and 31 percent from 2007 to 2011. In 2011, the false negative rate was 40 percent, and 27 percent of Medicaid reports in CPS ASEC were false positives. False negative error is associated with the duration of enrollment in Medicaid, enrollment in Medicare and private insurance, and Medicaid enrollment in the survey year. False positive error is associated with enrollment in Medicare and shared Medicaid coverage in the household. We discuss implications for survey reports of health insurance coverage and for estimating the uninsured population.View Full Paper PDF
-
Working PaperThe Icing on the Cake: The Effects of Monetary Incentives on Income Data Quality in the SIPP
January 2024
Working Paper Number:
CES-24-03
Accurate measurement of key income variables plays a crucial role in economic research and policy decision-making. However, the presence of item nonresponse and measurement error in survey data can cause biased estimates. These biases can subsequently lead to sub-optimal policy decisions and inefficient allocation of resources. While there have been various studies documenting item nonresponse and measurement error in economic data, there have not been many studies investigating interventions that could reduce item nonresponse and measurement error. In our research, we investigate the impact of monetary incentives on reducing item nonresponse and measurement error for labor and investment income in the Survey of Income and Program Participation (SIPP). Our study utilizes a randomized incentive experiment in Waves 1 and 2 of the 2014 SIPP, which allows us to assess the effectiveness of incentives in reducing item nonresponse and measurement error. We find that households receiving incentives had item nonresponse rates that are 1.3 percentage points lower for earnings and 1.5 percentage points lower for Social Security income. Measurement error was 6.31 percentage points lower at the intensive margin for interest income, and 16.48 percentage points lower for dividend income compared to non-incentive recipient households. These findings provide valuable insights for data producers and users and highlight the importance of implementing strategies to improve data quality in economic research.View Full Paper PDF
-
Working PaperBlack-White Differences in Intergenerational Economic Mobility in the U.S.
December 2011
Working Paper Number:
CES-11-40
Traditional measures of intergenerational mobility such as the intergenerational elasticity are not useful for inferences concerning group differences in mobility with respect to the pooled income distribution. This paper uses transition probabilities and measures of 'directional rank mobility' that can identify inter-racial differences in intergenerational mobility. The study uses two data sources including one that contains social security earnings for a large intergenerational sample. I find that recent cohorts of blacks are not only significantly less upwardly mobile but also significantly more downwardly mobile than whites. This implies a steady-state distribution in which there is no racial convergence in income. A descriptive analysis using covariates reveals that test scores in adolescence can explain much of the racial difference in both upward and downward mobility. Family structure can account for some of the racial gap in upward mobility but not downward mobility. Completed schooling and parental wealth also appear to account for some of the racial gaps in intergenerational mobility.View Full Paper PDF
-
Working PaperParental Earnings and Children's Well-Being and Future Success: An Analysis of the SIPP Matched to SSA Earnings Data
April 2011
Working Paper Number:
CES-11-12
We estimate the association between parental earnings and a wide variety of indicators of child well-being using data from the Survey of Income and Program Participation (SIPP) matched to administrative earnings records from the Social Security Administration. We find that the use of longer time averages of parent earnings leads to substantially higher estimated effects compared to using only a single year of parent earnings. This suggests that previous studies may have understated the potential efficacy of income support programs to improve child well-being. Further, policy makers should take into account the attenuation bias when comparing studies that use different time spans to measure parental income. Using 7 year time averages of parent earnings, we show for example, that a doubling of parent earnings reduces the probability of a teenager reporting being in poor health by close to 50 percent and a child having insufficient food by 75 percent.View Full Paper PDF
-
Working PaperThe Measurement of Medicaid Coverage in the SIPP: Evidence from California, 1990-1996
September 2002
Working Paper Number:
CES-02-21
This paper studies the accuracy of reported Medicaid coverage in the Survey of Income and Program Participation (SIPP) using a unique data set formed by matching SIPP survey responses to administrative records from the State of California. Overall, we estimate that the SIPP underestimates Medicaid coverage in the California populaton by about 10 percent. Among SIPP respondents who can be matched to administrative records, we estimate that the probability someone reports Medicaid coverage in a month when they are actually covered is around 85 percent. The corresponding probability for low-income children is even higher ' at least 90 percent. These estimates suggest that the SIPP provides reasonably accurate coverage reports for those who are actually in the Medicaid system. On the other hand, our estimate of the false positive rate (the rate of reported coverage for those who are not covered in the administrative records) is relatively high: 2.5 percent for the sample as a whole, and up to 20 percent for poor children. Some of this is due to errors in the recording of Social Security numbers in the administrative system, rather than to problems in the SIPP.View Full Paper PDF
-
Working PaperUnderstanding Earnings Instability: How Important are Employment Fluctuations and Job Changes?
August 2009
Working Paper Number:
CES-09-20
Using three panel datasets (the matched CPS, the SIPP, and the newly available Longitudinal Employment and Household Dynamics (LEHD) data), we examine trends in male earnings instability in recent decades. In contrast to several papers that find a recent upward trend in earnings instability using the PSID data, we find that earnings instability has been remarkably stable in the 1990s and the 2000s. We find that job changing rates remained relatively constant casting doubt on the importance of labor market 'churning.' We find some evidence that earnings instability increased among job stayers which lends credence to the view that greater reliance on incentive pay increased instability of worker pay. We also find an offsetting decrease in earnings instability among job changers due largely to declining unemployment associated with job changes. One caveat to our findings is that we focus on men who have positive earnings in two adjacent years and thus ignore men who exit the labor force or re-enter after an extended period. Preliminary investigation suggests that ignoring these transitions understates the rise in earnings instability over the past two decades.View Full Paper PDF
-
Working PaperMedicare Coverage and Reporting
December 2016
Working Paper Number:
carra-2016-12
Medicare coverage of the older population in the United States is widely recognized as being nearly universal. Recent statistics from the Current Population Survey Annual Social and Economic Supplement (CPS ASEC) indicate that 93 percent of individuals aged 65 and older were covered by Medicare in 2013. Those without Medicare include those who are not eligible for the public health program, though the CPS ASEC estimate may also be impacted by misreporting. Using linked data from the CPS ASEC and Medicare Enrollment Database (i.e., the Medicare administrative data), we estimate the extent to which individuals misreport their Medicare coverage. We focus on those who report having Medicare but are not enrolled (false positives) and those who do not report having Medicare but are enrolled (false negatives). We use regression analyses to evaluate factors associated with both types of misreporting including socioeconomic, demographic, and household characteristics. We then provide estimates of the implied Medicare-covered, insured, and uninsured older population, taking into account misreporting in the CPS ASEC. We find an undercount in the CPS ASEC estimates of the Medicare covered population of 4.5 percent. This misreporting is not random - characteristics associated with misreporting include citizenship status, year of entry, labor force participation, Medicare coverage of others in the household, disability status, and imputation of Medicare responses. When we adjust the CPS ASEC estimates to account for misreporting, Medicare coverage of the population aged 65 and older increases from 93.4 percent to 95.6 percent while the uninsured rate decreases from 1.4 percent to 1.3 percent.View Full Paper PDF
-
Working PaperTrends in Earnings Volatility using Linked Administrative and Survey Data
August 2020
Working Paper Number:
CES-20-24
We document trends in earnings volatility separately by gender in combination with other characteristics such as race, educational attainment, and employment status using unique linked survey and administrative data for the tax years spanning 1995-2015. We also decompose the variance of trend volatility into within- and between-group contributions, as well as transitory and permanent shocks. Our results for continuously working men suggest that trend earnings volatility was stable over our period in both survey and tax data, though with a substantial countercyclical business-cycle component. Trend earnings volatility among women declined over the period in both survey and administrative data, but unlike for men, there was no change over the Great Recession. The variance decompositions indicate that nonresponders, low-educated, racial minorities, and part-year workers have the greatest group specific earnings volatility, but with the exception of part-year workers, they contribute least to the level and trend of volatility owing to their small share of the population. There is evidence of stable transitory volatility, but rising permanent volatility over the past two decades in male and female earnings.View Full Paper PDF
-
Working PaperLong-Term Effects of Vietnam-Era Conscription: Schooling, Experience and Earnings
August 2007
Working Paper Number:
CES-07-23
Instrumental variables (IV) estimates using the draft lottery show that white Vietnam-era draftees suffered substantial post-service earnings losses in the 1970s and 1980s. Angrist (1990) explains these losses as due primarily to lost labor market experience. Non-public use data from the 2000 Census allow the first longerterm follow-up for a large sample from the draft-lottery cohorts. We use these data to estimate the effects of military service on earnings, schooling, and a number of other variables. Consistent with the loss-of -experience model, IV estimates of the effects of Vietnam-era service on earnings are close to zero in 2000, when the draft-lottery cohorts were middle-aged and experience profiles relatively flat. On the other hand, draft-lottery estimates show a marked increase in schooling for Vietnam-era veterans. A variety of evidence suggests this increase reflects the impact of the Vietnam-era GI Bill more than draft-avoidance behavior. The economic return to the increased schooling generated by Vietnam-era service, estimated in a wage equation that constrains the impact of Vietnam-era military service to run solely through the experience and schooling channels, appears to be less than the OLS return. Finally, we look at measures of disability. The IV estimates point to an increase in non-workrelated disability rates and non-SSA disability income, but the fact that there is no corresponding effect on employment, hours worked, or work-related disability rates suggests health was affected little by Vietnam-era service. Allowing for excess disability among veterans raises the estimated returns to GI-Bill schooling slightly.View Full Paper PDF
