Estimating Measurement Error in SIPP Annual Job Earnings: A Comparison of Census Bureau Survey and SSA Administrative Data
July 2011
Working Paper Number:
CES-11-20
Abstract
We quantify sources of variation in annual job earnings data collected by the Survey of Income and Program Participation (SIPP) to determine how much of the variation is the result of measurement error. Jobs reported in the SIPP are linked to jobs reported in an administrative database, the Detailed Earnings Records (DER) drawn from the Social Security Administration's Master Earnings File, a universe file of all earnings reported on W-2 tax forms. As a result of the match, each job potentially has two earnings observations per year: survey and administrative. Unlike previous validation studies, both of these earnings measures are viewed as noisy measures of some underlying true amount of annual earnings. While the existence of survey error resulting from respondent mistakes or misinterpretation is widely accepted, the idea that administrative data are also error-prone is new. Possible sources of employer reporting error, employee under-reporting of compensation such as tips, and general differences between how earnings may be reported on tax forms and in surveys, necessitates the discarding of the assumption that administrative data are a true measure of the quantity that the survey was designed to collect. In addition, errors in matching SIPP and DER jobs, a necessary task in any use of administrative data, also contribute to measurement error in both earnings variables. We begin by comparing SIPP and DER earnings for different demographic and education groups of SIPP respondents. We also calculate different measures of changes in earnings for individuals switching jobs. We estimate a standard earnings equation model using SIPP and DER earnings and compare the resulting coefficients. Finally exploiting the presence of individuals with multiple jobs and shared employers over time, we estimate an econometric model that includes random person and firm effects, a common error component shared by SIPP and DER earnings, and two independent error components that represent the variation unique to each earnings measure. We compare the variance components from this model and consider how the DER and SIPP differ across unobservable components.
Document Tags and Keywords
Keywords
Keywords are automatically generated using KeyBERT, a powerful and innovative
keyword extraction tool that utilizes BERT embeddings to ensure high-quality and contextually relevant
keywords.
By analyzing the content of working papers, KeyBERT identifies terms and phrases that capture the essence of the
text, highlighting the most significant topics and trends. This approach not only enhances searchability but
provides connections that go beyond potentially domain-specific author-defined keywords.
:
survey,
respondent,
earnings,
employee,
employed,
statistician,
imputation,
discrepancy,
tax,
irs,
ssa,
earn,
employee data,
earner,
wage earnings,
survey income,
assessing,
employment earnings,
earnings employees,
assessed
Tags
Tags are automatically generated using a pretrained language model from spaCy, which excels at
several tasks, including entity tagging.
The model is able to label words and phrases by part-of-speech,
including "organizations." By filtering for frequent words and phrases labeled as "organizations", papers are
identified to contain references to specific institutions, datasets, and other organizations.
:
Internal Revenue Service,
Social Security Administration,
Financial, Insurance and Real Estate Industries,
Current Population Survey,
Employer Identification Numbers,
Survey of Income and Program Participation,
Cornell University,
Social Security,
Research Data Center,
Social Security Number,
National Institute on Aging,
Alfred P Sloan Foundation,
Cornell Institute for Social and Economic Research,
PSID,
Business Register,
Detailed Earnings Records,
Public Administration,
Computer Assisted Personal Interview,
W-2,
Master Earnings File,
Person Validation System
Similar Working Papers
Similarity between working papers are determined by an unsupervised neural
network model
know as Doc2Vec.
Doc2Vec is a model that represents entire documents as fixed-length vectors, allowing for the
capture of semantic meaning in a way that relates to the context of words within the document. The model learns to
associate a unique vector with each document while simultaneously learning word vectors, enabling tasks such as
document classification, clustering, and similarity detection by preserving the order and structure of words. The
document vectors are compared using cosine similarity/distance to determine the most similar working papers.
Papers identified with 🔥 are in the top 20% of similarity.
The 10 most similar working papers to the working paper 'Estimating Measurement Error in SIPP Annual Job Earnings: A Comparison of Census Bureau Survey and SSA Administrative Data' are listed below in order of similarity.
-
Working PaperEstimating Measurement Error in SIPP Annual Job Earnings: A Comparison of Census Survey and SSA Administrative Data🔥
September 2002
Working Paper Number:
tp-2002-24
The third chapter investigates measurement error in SIPP annual job earnings data linked to SSA administrative earnings data. The multiple earnings measures provided by the survey and administrative data enable the identification of components of true variation and variation due to measurement error. We find that 18% of the variation in SIPP annual job earnings can be attributed to measurement error. We also find that in both the SIPP and the DER, measurement error is persistent over time. A lower level of auto-correlation in the SIPP measurement error than in the economic error component leads to a lower reliability ratio of .62 for first-differenced earnings.View Full Paper PDF
-
Working PaperIs there an Advantage to Working? The Relationship between Maternal Employment and Intergenerational Mobility
September 2015
Working Paper Number:
CES-15-27
We investigate the question of whether investing in a child's development by having a parent stay at home when the child is young is correlated with the child's adult outcomes. Specifically, do children with stay-at-home mothers have higher adult earnings than children raised in households with a working mother? The major contribution of our study is that, unlike previous studies, we have access to rich longitudinal data that allows us to measure both the parental earnings when the child is very young and the adult earnings of the child. Our findings are consistent with previous studies that show insignificant differences between children raised by stay-at-home mothers during their early years and children with mothers working in the market. We find no impact of maternal employment during the first 5 years of a child's life on earnings, employment, or mobility measures of either sons or daughters. We do find, however, that maternal employment during children's high school years is correlated with a higher probability of employment as adults for daughters and a higher correlation between parent and daughter earnings ranks.View Full Paper PDF
-
Working PaperWage Dispersion, Compensation Policy and the Role of Firms
November 2005
Working Paper Number:
tp-2005-04
Empirical work in economics stresses the importance of unobserved firm- and person-level characteristics in the determination of wages, finding that these unobserved components account for the overwhelming majority of variation in wages. However, little is known about the mechanisms sustaining these wage di'er- entials. This paper attempts to demystify the firm-side of the puzzle by developing a statistical model that enriches the role that firms play in wage determination, allowing firms to influence both average wages as well as the returns to observable worker characteristics. I exploit the hierarchical nature of a unique employer-employee linked dataset for the United States, estimating a multilevel statistical model of earnings that accounts for firm-specific deviations in average wages as well as the returns to components of human capital - race, gender, education, and experience - while also controlling for person-level heterogeneity in earnings. These idiosyncratic prices reflect one aspect of firm compensation policy; another, and more novel aspect, is the unstructured characterization of the covariance of these prices across firms. I estimate the model's variance parameters using Restricted (or Residual) Maximum Likelihood tech- niques. Results suggest that there is significant variation in the returns to worker characteristics across firms. First, estimates of the parameters of the covariance matrix of firm-specific returns are statistically significant. Firms that tend to pay higher average wages also tend to pay higher than average returns to worker characteristics; firms that tend to reward highly the human capital of men also highly reward the human capital of women. For instance, the correlation between the firm-specific returns to education for men and women is 0.57. Second, the firm-specific returns account for roughly 9% of the variation in wages - approximately 50% of the variation in wages explained by firm-specific intercepts alone. The inclusion of firm-specific returns ties variation in wages, otherwise attributable to firm-specific intercepts, to observable components of human capital.View Full Paper PDF
-
Working PaperFathers, Children, and the Intergenerational Transmission of Employers
March 2018
Working Paper Number:
CES-18-12
We document the tendency of fathers in the U.S. to share employers with their sons and daughters. We show that the rate of job sharing is much higher than can be explained by the fact that fathers and sons tend to live near each other. Younger children are much more likely to share their father's employer, as are children of high-earning fathers. We find that sons' earnings at shared jobs tend to be higher than at unshared jobs but see no statistically signi?cant di'erence for daughters. Much of the earnings differential is associated with jobs at shared employers being in higher-paying industries. When we control for employer characteristics, we see a much smaller son earnings premium for working together with his father. We also investigate the impact of sharing an employer on intergenerational mobility and demonstrate that for sons, sharing an employer at some point before age 30 is associated with a higher rank in the earnings distribution as an adult but that this association is independent of the father's rank in the earnings distribution.View Full Paper PDF
-
Working PaperTrends in Earnings Inequality and Earnings Instability among U.S. Couples: How Important is Assortative Matching?
January 2015
Working Paper Number:
CES-15-04
We examine changes in inequality and instability of the combined earnings of married couples over the 1980-2009 period using two U.S. panel data sets: Social Security earnings data matched to Survey of Income and Program Participation panels (SIPP-SSA) and the Panel Study of Income Dynamics. Relative to male earnings inequality, the inequality of couples' earnings is both lower in levels and rises by a smaller amount. We also find that couples' earnings instability is lower in levels compared to male earnings instability and actually declines in the SIPP-SSA data. While wives' earnings played an important role in dampening the rise in inequality and year-to-year variation in resources at the family level, we find that marital sorting and coordination of labor supply decisions at the family level played a minor role. Comparing actual couples to randomly paired simulated couples, we find very similar trends in earnings inequality and instability.View Full Paper PDF
-
Working PaperEstimating the Relationship between Employer-Provided Health Insurance, Worker Mobility, and Wages
September 2002
Working Paper Number:
tp-2002-23
In this paper, a joint model of wages, hazard of a job ending, and probability of holding employer-provided health insurance is estimated, taking account of unobservable person and job characteristics. A unique data source, the 1990 and 1996 SIPP Panels linked to SSA administrative job histories, enables the identification of random person and job effects and the correlation of these effects across the three equations. The explicit modeling of this correlation produces consistent estimates of the effect of tenure on wages and the effect of health insurance on mobility. Substantial levels of job-lock and significant annual returns to seniority are found. Increasing the job-specific probability of obtaining employerprovided health insurance from 60% to 63%, or increasing the job-specific hourly wage rate by $.80, are both associated with an equivalent decrease in the hazard of the job ending. However, the dollar value of the wage benefit is substantially higher.View Full Paper PDF
-
Working PaperComparing Measures of Earnings Instability Based on Survey and Adminstrative Reports
August 2010
Working Paper Number:
CES-10-15
In Celik, Juhn, McCue, and Thompson (2009), we found that estimated levels of earnings instability based on data from the Current Population Survey (CPS) and the Survey of Income and Program Participation (SIPP) were reasonably close to each other and to others' estimates from the Panel Study of Income Dynamics (PSID), but estimates from unemployment insurance (UI) earnings were much larger. Given that the UI data are from administrative records which are often posited to be more accurate than survey reports, this raises concerns that measures based on survey data understate true earnings instability. To address this, we use links between survey samples from the SIPP and UI earnings records in the LEHD database to identify sources of differences in work history and earnings information. Substantial work has been done comparing earnings levels from administrative records to those collected in the SIPP and CPS, but our understanding of earnings instability would benefit from further examination of differences across sources in the properties of changes in earnings. We first compare characteristics of the overall and matched samples to address issues of selection in the matching process. We then compare earnings levels and jobs in the SIPP and LEHD data to identify differences between them. Finally we begin to examine how such differences affect estimates of earnings instability. Our preliminary findings suggest that differences in earnings changes for those in the lower tail of the earnings distribution account for much of the difference in instability estimates.View Full Paper PDF
-
Working PaperAre the Lasting Effects of Employee-Employer Separations induced by Layoff and Disability Similar? Exploring Job Displacement using Survey and Administrative Data
October 2005
Working Paper Number:
tp-2005-03
This paper integrates the existing literatures on displacement and health by examining the enduring effects of job dislocations that are induced by firm and individual shocks to employment. A joint estimation of hourly wage rates and weekly hours illuminates the disparities in these economic outcomes that exist between those who have reestablished themselves in the workplace subsequent to a layoff and those who have returned to work following the onset of a disability relative to those with uninterrupted job histories. As an extension of these ideas, employment transitions and workplace adjustments are modeled to capture spousal reactions to these shocks. Multiple indicators of health from the Survey of Income and Program Participation and Social Security Administrative benefits records are incorporated into the analyses of those with impairments that prompted job loss. These measures allow knowledge to be gleaned regarding the qualitative di'erences in the lasting impacts of job cessation resulting from medically diagnosed illnesses as compared to estimates uncovered using survey data sources alone. By considering time durations following these periods of separation in light of these indicators of well-being, a more comprehensive understanding of the long-run repercussions of employee-employer separation is acquired.View Full Paper PDF
-
Working PaperIncome Effects in Labor Supply: Evidence from Child-Related Tax Benefits
May 2016
Working Paper Number:
CES-16-24
A parent whose child is born in December can claim child-related tax benefits when she files her tax return a few months later. Parents of children born in January must wait more than a year before they can receive child-related tax benefits. As a result, families with December births have higher after-tax income in the first year of a child's life than otherwise similar families with January births. This paper estimates the corresponding income effect on maternal labor supply, testing whether mothers who give birth in December work and earn less in the months following birth. We use data from the American Community Survey, the Survey of Income and Program Participation, and the 2000 Decennial Census. We find that December mothers have a lower probability of working, particularly in the third month after a child's birth. Earnings data from the SIPP indicate that an additional dollar of child-related tax benefits reduces annual maternal earnings in the year following a child's birth by approximately one dollar.View Full Paper PDF
-
Working PaperDownward Nominal Wage Rigidity in the United States: New Evidence from Worker-Firm Linked Data
February 2019
Working Paper Number:
CES-19-07
This paper examines the extent and consequences of Downward Nominal Wage Rigidity (DNWR) using administrative worker-firm linked data from the Longitudinal Employer Household Dynamics (LEHD) program for a large representative U.S. state. Prior to the Great Recession, only 7-8% of job stayers are paid the same nominal hourly wage rate as one year earlier - substantially less than previously found in survey-based data - and about 20% of job stayers experience a wage cut. During the Great Recession, the incidence of wage cuts increases to 30%, followed by a large rise in the proportion of wage freezes to 16% as the economy recovers. Total earnings of job stayers exhibit even fewer zero changes and a larger incidence of reductions than hourly wage rates, due to systematic variations in hours worked. The results are consistent with concurrent findings in the literature that reductions in base pay are exceedingly rare but that firms use different forms of non-base pay and variations in hours worked to flexibilize labor cost. We then exploit the worker-firm link of the LEHD and find that during the Great Recession, firms with indicators of DNWR reduced employment by about 1.2% more per year. This negative effect is driven by significantly lower hiring rates and persists into the recovery. Our results suggest that despite the relatively large incidence of wage cuts in the aggregate, DNWR has sizable allocative consequences.View Full Paper PDF
