An Analysis of Sample Selection and the Reliability of Using Short-term Earnings Averages in SIPP-SSA Matched Data
December 2011
Working Paper Number:
CES-11-39
Abstract
In this paper, we document the extent to which the sample of the Survey of Income and Program Participation that is matched to the Social Security Administration's administrative earnings records is nationally representative. We conclude that the match bias is small, so selection is not a serious concern. The matched sample over-represents individuals who are wealthy, who have financial assets or who have received a government-transfer and under-represents individuals who attrited from the SIPP. We use this matched sample to examine the relationship between short-term averages of earnings from the SIPP earnings and average lifetime earnings from the administrative records. Our estimates suggest that using short averages of earnings may understate the effects of permanent income on particular outcomes of interest.
Document Tags and Keywords
Keywords
Keywords are automatically generated using KeyBERT, a powerful and innovative
keyword extraction tool that utilizes BERT embeddings to ensure high-quality and contextually relevant
keywords.
By analyzing the content of working papers, KeyBERT identifies terms and phrases that capture the essence of the
text, highlighting the most significant topics and trends. This approach not only enhances searchability but
provides connections that go beyond potentially domain-specific author-defined keywords.
:
census research,
respondent,
earnings,
financial,
average,
firms census,
retirement,
wealth,
record,
federal,
welfare,
socioeconomic,
irs,
ssa,
medicare,
medicaid,
earn
Tags
Tags are automatically generated using a pretrained language model from spaCy, which excels at
several tasks, including entity tagging.
The model is able to label words and phrases by part-of-speech,
including "organizations." By filtering for frequent words and phrases labeled as "organizations", papers are
identified to contain references to specific institutions, datasets, and other organizations.
:
Internal Revenue Service,
Social Security Administration,
Survey of Income and Program Participation,
Social Security,
Research Data Center,
Social Security Number,
Detailed Earnings Records,
Master Earnings File,
NUMIDENT
Similar Working Papers
Similarity between working papers are determined by an unsupervised neural
network model
know as Doc2Vec.
Doc2Vec is a model that represents entire documents as fixed-length vectors, allowing for the
capture of semantic meaning in a way that relates to the context of words within the document. The model learns to
associate a unique vector with each document while simultaneously learning word vectors, enabling tasks such as
document classification, clustering, and similarity detection by preserving the order and structure of words. The
document vectors are compared using cosine similarity/distance to determine the most similar working papers.
Papers identified with 🔥 are in the top 20% of similarity.
The 10 most similar working papers to the working paper 'An Analysis of Sample Selection and the Reliability of Using Short-term Earnings Averages in SIPP-SSA Matched Data' are listed below in order of similarity.
-
Working PaperLong-Run Earnings Volatility and Health Insurance Coverage: Evidence from the SIPP Gold Standard File
October 2011
Working Paper Number:
CES-11-35
Despite the notable increase in earnings volatility and the attention paid to the growing ranks of the uninsured, the relationship between career earnings and short- and mediumrun health insurance status has been ignored due to a lack of data. I use a new dataset, the SIPP Gold Standard File, that merges health insurance status and demographics from the Survey of Income and Program Participation with career earnings records from the Social Security Administration (SSA) and the Internal Revenue Service (IRS) to examine the relationship between long-run family earnings volatility and health insurance coverage. I find that more volatile career earnings are associated with an increased probability of experiencing an uninsured episode, with larger effects for men, young workers, and the unmarried. These findings are consistent with the 'scarring' literature, and suggest the importance of safety-net measures for job losses and health insurance coverage.View Full Paper PDF
-
Working PaperParental Earnings and Children's Well-Being and Future Success: An Analysis of the SIPP Matched to SSA Earnings Data
April 2011
Working Paper Number:
CES-11-12
We estimate the association between parental earnings and a wide variety of indicators of child well-being using data from the Survey of Income and Program Participation (SIPP) matched to administrative earnings records from the Social Security Administration. We find that the use of longer time averages of parent earnings leads to substantially higher estimated effects compared to using only a single year of parent earnings. This suggests that previous studies may have understated the potential efficacy of income support programs to improve child well-being. Further, policy makers should take into account the attenuation bias when comparing studies that use different time spans to measure parental income. Using 7 year time averages of parent earnings, we show for example, that a doubling of parent earnings reduces the probability of a teenager reporting being in poor health by close to 50 percent and a child having insufficient food by 75 percent.View Full Paper PDF
-
Working PaperBlack-White Differences in Intergenerational Economic Mobility in the U.S.
December 2011
Working Paper Number:
CES-11-40
Traditional measures of intergenerational mobility such as the intergenerational elasticity are not useful for inferences concerning group differences in mobility with respect to the pooled income distribution. This paper uses transition probabilities and measures of 'directional rank mobility' that can identify inter-racial differences in intergenerational mobility. The study uses two data sources including one that contains social security earnings for a large intergenerational sample. I find that recent cohorts of blacks are not only significantly less upwardly mobile but also significantly more downwardly mobile than whites. This implies a steady-state distribution in which there is no racial convergence in income. A descriptive analysis using covariates reveals that test scores in adolescence can explain much of the racial difference in both upward and downward mobility. Family structure can account for some of the racial gap in upward mobility but not downward mobility. Completed schooling and parental wealth also appear to account for some of the racial gaps in intergenerational mobility.View Full Paper PDF
-
Working PaperResponse Error & the Medicaid undercount in the CPS
December 2016
Working Paper Number:
carra-2016-11
The Current Population Survey Annual Social and Economic Supplement (CPS ASEC) is an important source for estimates of the uninsured population. Previous research has shown that survey estimates produce an undercount of beneficiaries compared to Medicaid enrollment records. We extend past work by examining the Medicaid undercount in the 2007-2011 CPS ASEC compared to enrollment data from the Medicaid Statistical Information System for calendar years 2006-2010. By linking individuals across datasets, we analyze two types of response error regarding Medicaid enrollment - false negative error and false positive error. We use regression analysis to identify factors associated with these two types of response error in the 2011 CPS ASEC. We find that the Medicaid undercount was between 22 and 31 percent from 2007 to 2011. In 2011, the false negative rate was 40 percent, and 27 percent of Medicaid reports in CPS ASEC were false positives. False negative error is associated with the duration of enrollment in Medicaid, enrollment in Medicare and private insurance, and Medicaid enrollment in the survey year. False positive error is associated with enrollment in Medicare and shared Medicaid coverage in the household. We discuss implications for survey reports of health insurance coverage and for estimating the uninsured population.View Full Paper PDF
-
Working PaperThe Icing on the Cake: The Effects of Monetary Incentives on Income Data Quality in the SIPP
January 2024
Working Paper Number:
CES-24-03
Accurate measurement of key income variables plays a crucial role in economic research and policy decision-making. However, the presence of item nonresponse and measurement error in survey data can cause biased estimates. These biases can subsequently lead to sub-optimal policy decisions and inefficient allocation of resources. While there have been various studies documenting item nonresponse and measurement error in economic data, there have not been many studies investigating interventions that could reduce item nonresponse and measurement error. In our research, we investigate the impact of monetary incentives on reducing item nonresponse and measurement error for labor and investment income in the Survey of Income and Program Participation (SIPP). Our study utilizes a randomized incentive experiment in Waves 1 and 2 of the 2014 SIPP, which allows us to assess the effectiveness of incentives in reducing item nonresponse and measurement error. We find that households receiving incentives had item nonresponse rates that are 1.3 percentage points lower for earnings and 1.5 percentage points lower for Social Security income. Measurement error was 6.31 percentage points lower at the intensive margin for interest income, and 16.48 percentage points lower for dividend income compared to non-incentive recipient households. These findings provide valuable insights for data producers and users and highlight the importance of implementing strategies to improve data quality in economic research.View Full Paper PDF
-
Working PaperTrends in Earnings Volatility using Linked Administrative and Survey Data
August 2020
Working Paper Number:
CES-20-24
We document trends in earnings volatility separately by gender in combination with other characteristics such as race, educational attainment, and employment status using unique linked survey and administrative data for the tax years spanning 1995-2015. We also decompose the variance of trend volatility into within- and between-group contributions, as well as transitory and permanent shocks. Our results for continuously working men suggest that trend earnings volatility was stable over our period in both survey and tax data, though with a substantial countercyclical business-cycle component. Trend earnings volatility among women declined over the period in both survey and administrative data, but unlike for men, there was no change over the Great Recession. The variance decompositions indicate that nonresponders, low-educated, racial minorities, and part-year workers have the greatest group specific earnings volatility, but with the exception of part-year workers, they contribute least to the level and trend of volatility owing to their small share of the population. There is evidence of stable transitory volatility, but rising permanent volatility over the past two decades in male and female earnings.View Full Paper PDF
-
Working PaperThe Measurement of Medicaid Coverage in the SIPP: Evidence from California, 1990-1996
September 2002
Working Paper Number:
CES-02-21
This paper studies the accuracy of reported Medicaid coverage in the Survey of Income and Program Participation (SIPP) using a unique data set formed by matching SIPP survey responses to administrative records from the State of California. Overall, we estimate that the SIPP underestimates Medicaid coverage in the California populaton by about 10 percent. Among SIPP respondents who can be matched to administrative records, we estimate that the probability someone reports Medicaid coverage in a month when they are actually covered is around 85 percent. The corresponding probability for low-income children is even higher ' at least 90 percent. These estimates suggest that the SIPP provides reasonably accurate coverage reports for those who are actually in the Medicaid system. On the other hand, our estimate of the false positive rate (the rate of reported coverage for those who are not covered in the administrative records) is relatively high: 2.5 percent for the sample as a whole, and up to 20 percent for poor children. Some of this is due to errors in the recording of Social Security numbers in the administrative system, rather than to problems in the SIPP.View Full Paper PDF
-
Working PaperUnderstanding Earnings Instability: How Important are Employment Fluctuations and Job Changes?
August 2009
Working Paper Number:
CES-09-20
Using three panel datasets (the matched CPS, the SIPP, and the newly available Longitudinal Employment and Household Dynamics (LEHD) data), we examine trends in male earnings instability in recent decades. In contrast to several papers that find a recent upward trend in earnings instability using the PSID data, we find that earnings instability has been remarkably stable in the 1990s and the 2000s. We find that job changing rates remained relatively constant casting doubt on the importance of labor market 'churning.' We find some evidence that earnings instability increased among job stayers which lends credence to the view that greater reliance on incentive pay increased instability of worker pay. We also find an offsetting decrease in earnings instability among job changers due largely to declining unemployment associated with job changes. One caveat to our findings is that we focus on men who have positive earnings in two adjacent years and thus ignore men who exit the labor force or re-enter after an extended period. Preliminary investigation suggests that ignoring these transitions understates the rise in earnings instability over the past two decades.View Full Paper PDF
-
Working PaperUsing Administrative Earnings Records to Assess Wage Data Quality in the March Current Population Survey and the Survey of Income and Program Participation
November 2002
Working Paper Number:
tp-2002-22
The March Current Population Survey (CPS) and the Survey of Income and Program Participation (SIPP) produce different aggregates and distributions of annual wages. An excess of high wages and shortage of low wages occurs in the March CPS. SIPP shows the opposite, an excess of low wages and shortage of high wages. Exactly-matched Detailed Earnings Records (DER) from the Social Security Administration allow comparing March CPS and SIPP people's wages using data independent of the surveys. Findings include the following. March CPS and SIPP people differ little in their true wage characteristics. March CPS and SIPP represent a worker's percentile rank better than the dollar amount of wages. Workers with one job and low work effort have underestimated March CPS wages. March CPS has a higher level of "underground" wages than SIPP, and increasingly so in the 1990s. March CPS has a higher level of self-employment income "misclassified" as wages than SIPP, and increasingly so in the 1990s. These trends may explain one-third of March CPS's 6-percentage-point increase in aggregate wages relative to independent estimates from 1993 to 1995. Finally, the paper delineates March CPS occupations disproportionately likely to be absent from the administrative data entirely or to "misclassify" self-employment income as wages.View Full Paper PDF
-
Working PaperChildhood Housing and Adult Earnings: A Between-Siblings Analysis of Housing Vouchers and Public Housing
January 2013
Working Paper Number:
CES-13-48RR
To date, research on the long-term effects of childhood participation in voucher-assisted and public housing has been limited by the lack of data and suitable identification strategies. We create a national level longitudinal data set that enables us to analyze how children's housing experiences affect adult earnings and incarceration rates. While naive estimates suggest there are substantial negative consequences to childhood participation in voucher assisted and public housing, this result appears to be driven largely by selection of households into housing assistance programs. To mitigate this source of bias, we employ household fixed-effects specifications that use only within-household (across-sibling) variation for identification. Compared to naive specifications, household fixed-effects estimates for earnings are universally more positive, and they suggest that there are positive and statistically significant benefits from childhood residence in assisted housing on young adult earnings for nearly all demographic groups. Childhood participation in assisted housing also reduces the likelihood of incarceration across all household race/ethnicity groups. Time spent in voucher-assisted or public housing is especially beneficial for females from non-Hispanic Black households, who experience substantial increases in expected earnings and lower incarceration rates.View Full Paper PDF
