Comparing Measures of Earnings Instability Based on Survey and Adminstrative Reports
August 2010
Working Paper Number:
CES-10-15
Abstract
In Celik, Juhn, McCue, and Thompson (2009), we found that estimated levels of earnings instability based on data from the Current Population Survey (CPS) and the Survey of Income and Program Participation (SIPP) were reasonably close to each other and to others' estimates from the Panel Study of Income Dynamics (PSID), but estimates from unemployment insurance (UI) earnings were much larger. Given that the UI data are from administrative records which are often posited to be more accurate than survey reports, this raises concerns that measures based on survey data understate true earnings instability. To address this, we use links between survey samples from the SIPP and UI earnings records in the LEHD database to identify sources of differences in work history and earnings information. Substantial work has been done comparing earnings levels from administrative records to those collected in the SIPP and CPS, but our understanding of earnings instability would benefit from further examination of differences across sources in the properties of changes in earnings. We first compare characteristics of the overall and matched samples to address issues of selection in the matching process. We then compare earnings levels and jobs in the SIPP and LEHD data to identify differences between them. Finally we begin to examine how such differences affect estimates of earnings instability. Our preliminary findings suggest that differences in earnings changes for those in the lower tail of the earnings distribution account for much of the difference in instability estimates.
Document Tags and Keywords
Keywords
Keywords are automatically generated using KeyBERT, a powerful and innovative
keyword extraction tool that utilizes BERT embeddings to ensure high-quality and contextually relevant
keywords.
By analyzing the content of working papers, KeyBERT identifies terms and phrases that capture the essence of the
text, highlighting the most significant topics and trends. This approach not only enhances searchability but
provides connections that go beyond potentially domain-specific author-defined keywords.
:
economist,
quarterly,
survey,
respondent,
earnings,
employ,
employed,
recession,
estimates employment,
discrepancy,
salary,
regress,
earn,
wage earnings,
earnings employees,
earnings age
Tags
Tags are automatically generated using a pretrained language model from spaCy, which excels at
several tasks, including entity tagging.
The model is able to label words and phrases by part-of-speech,
including "organizations." By filtering for frequent words and phrases labeled as "organizations", papers are
identified to contain references to specific institutions, datasets, and other organizations.
:
Bureau of Labor Statistics,
Financial, Insurance and Real Estate Industries,
Current Population Survey,
Survey of Income and Program Participation,
Department of Labor,
Longitudinal Employer Household Dynamics,
PSID
Similar Working Papers
Similarity between working papers are determined by an unsupervised neural
network model
know as Doc2Vec.
Doc2Vec is a model that represents entire documents as fixed-length vectors, allowing for the
capture of semantic meaning in a way that relates to the context of words within the document. The model learns to
associate a unique vector with each document while simultaneously learning word vectors, enabling tasks such as
document classification, clustering, and similarity detection by preserving the order and structure of words. The
document vectors are compared using cosine similarity/distance to determine the most similar working papers.
Papers identified with 🔥 are in the top 20% of similarity.
The 10 most similar working papers to the working paper 'Comparing Measures of Earnings Instability Based on Survey and Adminstrative Reports' are listed below in order of similarity.
-
Working PaperEstimating Measurement Error in SIPP Annual Job Earnings: A Comparison of Census Bureau Survey and SSA Administrative Data
July 2011
Working Paper Number:
CES-11-20
We quantify sources of variation in annual job earnings data collected by the Survey of Income and Program Participation (SIPP) to determine how much of the variation is the result of measurement error. Jobs reported in the SIPP are linked to jobs reported in an administrative database, the Detailed Earnings Records (DER) drawn from the Social Security Administration's Master Earnings File, a universe file of all earnings reported on W-2 tax forms. As a result of the match, each job potentially has two earnings observations per year: survey and administrative. Unlike previous validation studies, both of these earnings measures are viewed as noisy measures of some underlying true amount of annual earnings. While the existence of survey error resulting from respondent mistakes or misinterpretation is widely accepted, the idea that administrative data are also error-prone is new. Possible sources of employer reporting error, employee under-reporting of compensation such as tips, and general differences between how earnings may be reported on tax forms and in surveys, necessitates the discarding of the assumption that administrative data are a true measure of the quantity that the survey was designed to collect. In addition, errors in matching SIPP and DER jobs, a necessary task in any use of administrative data, also contribute to measurement error in both earnings variables. We begin by comparing SIPP and DER earnings for different demographic and education groups of SIPP respondents. We also calculate different measures of changes in earnings for individuals switching jobs. We estimate a standard earnings equation model using SIPP and DER earnings and compare the resulting coefficients. Finally exploiting the presence of individuals with multiple jobs and shared employers over time, we estimate an econometric model that includes random person and firm effects, a common error component shared by SIPP and DER earnings, and two independent error components that represent the variation unique to each earnings measure. We compare the variance components from this model and consider how the DER and SIPP differ across unobservable components.View Full Paper PDF
-
Working PaperExploring Differences in Employment between Household and Establishment Data
April 2009
Working Paper Number:
CES-09-09
Using a large data set that links individual Current Population Survey (CPS) records to employer-reported administrative data, we document substantial discrepancies in basic measures of employment status that persist even after controlling for known definitional differences between the two data sources. We hypothesize that reporting discrepancies should be most prevalent for marginal workers and marginal jobs, and find systematic associations between the incidence of reporting discrepancies and observable person and job characteristics that are consistent with this hypothesis. The paper discusses the implications of the reported findings for both micro and macro labor market analysisView Full Paper PDF
-
Working PaperWorkplace Characteristics and Employment of Older Workers
September 2012
Working Paper Number:
CES-12-31
As aging of the U.S. population places increased demands on public programs such as Social Security, an important question is how long older Americans are willing and able to work before they retire from the labor force. While studies based on household surveys have provided information on the role of savings, health status, pension and health insurance coverage, there is relatively little information on how workplace and employer characteristics affect the employment of older workers. In this study we use linked employer-employee data to explore the relationship between the characteristics of jobs held at age 55 and early retirement. We focus on a sample of 63-year-olds drawn from the 2005-2008 American Community Survey. We match this sample to information on their earnings, employment, employers and coworkers drawn from the Longitudinal Employer-Household Dynamics data for the years in which they age from 55 to 63. We use employment status as reported in the ACS to split the sample into those who have retired by age 63 and those who continue to work. We then examine differences between early retirees and continuing workers in the characteristics of their employment at age 55, and at how these characteristics change as they approach age 63. We find that early retirees are more likely to be employed by larger employers at age 55 than are continuers. They work for employers with somewhat higher pay than do continuers, and are less likely to have young coworkers.View Full Paper PDF
-
Working PaperEstimating the "True" Cost of Job Loss: Evidence Using Matched Data from Califormia 1991-2000
June 2009
Working Paper Number:
CES-09-14
Estimates of the cost of job displacement from survey and administrative data differ markedly. This paper uses a unique match of data between the Displaced Worker Survey (DWS) and administrative wage records from California to examine the sources of this discrepancy. When we use similar estimation methods and account for measurement error in survey wages correlated with worker demographics, estimates of earnings losses at displacement are similar from both datasets and significantly larger than those based on the DWS alone. Also correcting for measurement errors in reported displacements suggests both sources of such estimates may yield lower bounds for the true cost of displacement.View Full Paper PDF
-
Working PaperUnderstanding Earnings Instability: How Important are Employment Fluctuations and Job Changes?
August 2009
Working Paper Number:
CES-09-20
Using three panel datasets (the matched CPS, the SIPP, and the newly available Longitudinal Employment and Household Dynamics (LEHD) data), we examine trends in male earnings instability in recent decades. In contrast to several papers that find a recent upward trend in earnings instability using the PSID data, we find that earnings instability has been remarkably stable in the 1990s and the 2000s. We find that job changing rates remained relatively constant casting doubt on the importance of labor market 'churning.' We find some evidence that earnings instability increased among job stayers which lends credence to the view that greater reliance on incentive pay increased instability of worker pay. We also find an offsetting decrease in earnings instability among job changers due largely to declining unemployment associated with job changes. One caveat to our findings is that we focus on men who have positive earnings in two adjacent years and thus ignore men who exit the labor force or re-enter after an extended period. Preliminary investigation suggests that ignoring these transitions understates the rise in earnings instability over the past two decades.View Full Paper PDF
-
Working PaperTwo Perspectives on Commuting: A Comparison of Home to Work Flows Across Job-Linked Survey and Administrative Files
January 2017
Working Paper Number:
CES-17-34
Commuting flows and workplace employment data have a wide constituency of users including urban and regional planners, social science and transportation researchers, and businesses. The U.S. Census Bureau releases two, national data products that give the magnitude and characteristics of home to work flows. The American Community Survey (ACS) tabulates households' responses on employment, workplace, and commuting behavior. The Longitudinal Employer-Household Dynamics (LEHD) program tabulates administrative records on jobs in the LEHD Origin-Destination Employment Statistics (LODES). Design differences across the datasets lead to divergence in a comparable statistic: county-to-county aggregate commute flows. To understand differences in the public use data, this study compares ACS and LEHD source files, using identifying information and probabilistic matching to join person and job records. In our assessment, we compare commuting statistics for job frames linked on person, employment status, employer, and workplace and we identify person and job characteristics as well as design features of the data frames that explain aggregate differences. We find a lower rate of within-county commuting and farther commutes in LODES. We attribute these greater distances to differences in workplace reporting and to uncertainty of establishment assignments in LEHD for workers at multi-unit employers. Minor contributing factors include differences in residence location and ACS workplace edits. The results of this analysis and the data infrastructure developed will support further work to understand and enhance commuting statistics in both datasets.View Full Paper PDF
-
Working PaperJob-to-Job Flows and Earnings Growth*
January 2017
Working Paper Number:
CES-17-08
The U.S. workforce has had little change in real wages, income, or earnings since the year 2000. However, even when there is little change in the average rate at which workers are compensated, individual workers experienced a distribution of wage and earnings changes. In this paper, we demonstrate how earnings evolve in the U.S. economy in the years 2001-2014 on a forthcoming dataset on earnings for stayers and transitioners from the U.S. Census Bureau's Job-to-Job Flows data product to account for the role of on-the-job earnings growth, job-to-job flows, and nonemployment in the growth of U.S. earnings.View Full Paper PDF
-
Working PaperThe Measurement of Medicaid Coverage in the SIPP: Evidence from California, 1990-1996
September 2002
Working Paper Number:
CES-02-21
This paper studies the accuracy of reported Medicaid coverage in the Survey of Income and Program Participation (SIPP) using a unique data set formed by matching SIPP survey responses to administrative records from the State of California. Overall, we estimate that the SIPP underestimates Medicaid coverage in the California populaton by about 10 percent. Among SIPP respondents who can be matched to administrative records, we estimate that the probability someone reports Medicaid coverage in a month when they are actually covered is around 85 percent. The corresponding probability for low-income children is even higher ' at least 90 percent. These estimates suggest that the SIPP provides reasonably accurate coverage reports for those who are actually in the Medicaid system. On the other hand, our estimate of the false positive rate (the rate of reported coverage for those who are not covered in the administrative records) is relatively high: 2.5 percent for the sample as a whole, and up to 20 percent for poor children. Some of this is due to errors in the recording of Social Security numbers in the administrative system, rather than to problems in the SIPP.View Full Paper PDF
-
Working PaperEarnings Growth, Job Flows and Churn
April 2020
Working Paper Number:
CES-20-15
How much do workers making job-to-job transitions benefit from moving away from a shrinking and towards a growing firm? We show that earnings growth in the transition increases with net employment growth at the destination firm and, to a lesser extent, decreases if the origin firm is shrinking. So, we sum the effect of leaving a shrinking and entering a growing firm and remove the excess turnover-related hires because gross hiring has a much smaller association with earnings growth than net employment growth. We find that job-to-job transitions with the cross-firm job flow have 23% more earnings growth than average.View Full Paper PDF
-
Working PaperEarnings Measurement Error, Nonresponse and Administrative Mismatch in the CPS
July 2025
Working Paper Number:
CES-25-48
Using the Current Population Survey Annual Social and Economic Supplement matched to Social Security Administration Detailed Earnings Records, we link observations across consecutive years to investigate a relationship between item nonresponse and measurement error in the earnings questions. Linking individuals across consecutive years allows us to observe switching from response to nonresponse and vice versa. We estimate OLS, IV, and finite mixture models that allow for various assumptions separately for men and women. We find that those who respond in both years of the survey exhibit less measurement error than those who respond in one year. Our findings suggest a trade-off between survey response and data quality that should be considered by survey designers, data collectors, and data users.View Full Paper PDF
