USING THE PARETO DISTRIBUTION TO IMPROVE ESTIMATES OF TOPCODED EARNINGS
April 2014
Working Paper Number:
CES-14-21
Abstract
Document Tags and Keywords
Keywords
Keywords are automatically generated using KeyBERT, a powerful and innovative
keyword extraction tool that utilizes BERT embeddings to ensure high-quality and contextually relevant
keywords.
By analyzing the content of working papers, KeyBERT identifies terms and phrases that capture the essence of the
text, highlighting the most significant topics and trends. This approach not only enhances searchability but
provides connections that go beyond potentially domain-specific author-defined keywords.
:
estimating,
estimation,
census research,
estimator,
earnings,
labor,
average,
trend,
worker,
salary,
percentile,
household,
tax,
workers earnings,
ssa,
earn,
earner,
wage earnings,
employment earnings,
income year,
earnings age,
earnings growth
Tags
Tags are automatically generated using a pretrained language model from spaCy, which excels at
several tasks, including entity tagging.
The model is able to label words and phrases by part-of-speech,
including "organizations." By filtering for frequent words and phrases labeled as "organizations", papers are
identified to contain references to specific institutions, datasets, and other organizations.
:
National Science Foundation,
Social Security Administration,
Current Population Survey,
Chicago Census Research Data Center,
Cornell University,
Social Security,
CDF
Similar Working Papers
Similarity between working papers are determined by an unsupervised neural
network model
know as Doc2Vec.
Doc2Vec is a model that represents entire documents as fixed-length vectors, allowing for the
capture of semantic meaning in a way that relates to the context of words within the document. The model learns to
associate a unique vector with each document while simultaneously learning word vectors, enabling tasks such as
document classification, clustering, and similarity detection by preserving the order and structure of words. The
document vectors are compared using cosine similarity/distance to determine the most similar working papers.
Papers identified with 🔥 are in the top 20% of similarity.
The 10 most similar working papers to the working paper 'USING THE PARETO DISTRIBUTION TO IMPROVE ESTIMATES OF TOPCODED EARNINGS' are listed below in order of similarity.
-
Working PaperMeasuring Labor Earnings Inequality Using Public-Use March Current Population Survey Data: The Value of Including Variances and Cell Means When Imputing Topcoded Values🔥
November 2008
Working Paper Number:
CES-08-38
Using the Census Bureau's internal March Current Population Surveys (CPS) file, we construct and make available variances and cell means for all topcoded income values in the publicuse version of these data. We then provide a procedure that allows researchers with access only to the public-use March CPS data to take advantage of this added information when imputing its topcoded income values. As an example of its value we show how our new procedure improves on existing imputation methods in the labor earnings inequality literature.View Full Paper PDF
-
Working PaperUsing Internal Current Population Survey Data to Reevaluate Trends in Labor Earnings Gaps by Gender, Race, and Education Level🔥
July 2008
Working Paper Number:
CES-08-18
Most empirical studies of trends in labor earnings gaps by gender, race or education level are based on data from the public use March Current Population Survey (CPS). Using the internal March CPS, we show that inconsistent topcoding in the public use data will understate these gaps and inaccurately capture their trends. We create a cell mean series beginning in 1975 that provides the mean of all values above the topcode for each income source in the public use March CPS and better approximate earnings gaps found in the internal March CPS than was previously possible using publically available data.View Full Paper PDF
-
Working PaperUsing the P90/P10 Index to Measure U.S. Inequality Trends with Current Population Survey Data: A View From Inside the Census Bureau Vaults🔥
June 2007
Working Paper Number:
CES-07-17
The March Current Population Survey (CPS) is the primary data source for estimation of levels and trends in labor earnings and income inequality in the USA. Time-inconsistency problems related to top coding in theses data have led many researchers to use the ratio of the 90th and 10th percentiles of these distributions (P90/P10) rather than a more traditional summary measure of inequality. With access to public use and restricted-access internal CPS data, and bounding methods, we show that using P90/P10 does not completely obviate time inconsistency problems, especially for household income inequality trends. Using internal data, we create consistent cell mean values for all top-coded public use values that, when used with public use data, closely track inequality trends in labor earnings and household income using internal data. But estimates of longer-term inequality trends with these corrected data based on P90/P10 differ from those based on the Gini coefficient. The choice of inequality measure matters.View Full Paper PDF
-
Working PaperMeasuring Inequality Using Censored Data: A Multiple Imputation Approach🔥
April 2009
Working Paper Number:
CES-09-05
To measure income inequality with right censored (topcoded) data, we propose multiple imputation for censored observations using draws from Generalized Beta of the Second Kind distributions to provide partially synthetic datasets analyzed using complete data methods. Estimation and inference uses Reiter's (Survey Methodology 2003) formulae. Using Current Population Survey (CPS) internal data, we find few statistically significant differences in income inequality for pairs of years between 1995 and 2004. We also show that using CPS public use data with cell mean imputations may lead to incorrect inferences about inequality differences. Multiply-imputed public use data provide an intermediate solution.View Full Paper PDF
-
Working PaperConsistent Cell Means for Topcoded Incomes in the Public Use March CPS (1976-2007)🔥
March 2008
Working Paper Number:
CES-08-06
Using the internal March CPS, we create and in this paper distribute to the larger research community a cell mean series that provides the mean of all income values above the topcode for any income source of any individual in the public use March CPS that has been topcoded since 1976. We also describe our construction of this series. When we use this series together with the public use March CPS, we closely match the yearly mean income levels and income inequalities of the U.S. population found using the internal March CPS data.View Full Paper PDF
-
Working PaperEstimating Trends in U.S. Income Inequality Using the Current Population Survey: The Importance of Controlling for Censoring🔥
August 2008
Working Paper Number:
CES-08-25
Using internal and public use March Current Population Survey (CPS) data, we analyze trends in US income inequality (1975'2004). We find that the upward trend in income inequality prior to 1993 significantly slowed thereafter once we control for top coding in the public use data and censoring in the internal data. Because both series do not capture trends at the very top of the income distribution, we use a multiple imputation approach in which values for censored observations are imputed using draws from a Generalized Beta distribution of the Second Kind (GB2) fitted to internal data. Doing so, we find income inequality trends similar to those derived from unadjusted internal data. Our trend results are generally robust to the choice of inequality index, whether Gini coefficient or other commonly-used indices. When we compare our best estimates of the income shares held by the richest tenth with those reported by Piketty and Saez (2003), our trends fairly closely match their trends, except for the top 1 percent of the distribution. Thus, we argue that if United States income inequality has been substantially increasing since 1993, such increases are confined to this very high income group.View Full Paper PDF
-
Working PaperRecent Trends in Top Income Shares in the USA: Reconciling Estimates from March CPS and IRS Tax Return Data🔥
September 2009
Working Paper Number:
CES-09-26
Although the vast majority of US research on trends in the inequality of family income is based on public-use March Current Population Survey (CPS) data, a new wave of research based on Internal Revenue Service (IRS) tax return data reports substantially higher levels of inequality and faster growing trends. We show that these apparently inconsistent estimates can largely be reconciled once one uses internal CPS data (which better captures the top of the income distribution than public-use CPS data) and defines the income distribution in the same way. Using internal CPS data for 1967'2006, we closely match the IRS data-based estimates of top income shares reported by Piketty and Saez (2003), with the exception of the share of the top 1 percent of the distribution during 1993'2000. Our results imply that, if inequality has increased substantially since 1993, the increase is confined to income changes for those in the top 1 percent of the distribution.View Full Paper PDF
-
Working PaperTrends in the Relative Household Income of Working-Age Men with Work Limitations: Correcting the Record Using Internal Current Population Survey Data🔥
March 2008
Working Paper Number:
CES-08-05
Previous research measuring the economic well-being of working-age men with work limitations relative to such men without work limitations in the public use March Current Population Survey (CPS) systematically understates the mean household income of both groups; overstates the relative household income of those with work limitations; and understates the decline in their relative household income over time. Using the internal March CPS, we demonstrate this by creating a cell mean series beginning in 1975 that provides the mean reported income of all topcoded persons for each source of income in the public use March CPS data. Using our cell mean series with the public use March CPS, we closely match the yearly mean income of working-age men with and without work limitations over the period 1987-2004 in the internal data and show that this match is superior to ones using alternative methods of correcting for topcoding currently used in the disability literature. We then provide levels and trends in the relative income of working-age men with work limitations from 1980-2006, the earliest year in the March CPS that such comparisons can be made.View Full Paper PDF
-
Working PaperLabor Market Segmentation and the Distribution of Income: New Evidence from Internal Census Bureau Data
August 2023
Working Paper Number:
CES-23-41
In this paper, we present new findings that validate earlier literature on the apparent segmentation of the US earnings distribution. Previous contributions posited that the observed distribution of earnings combined two or three distinct signals and was thus appropriately modeled as a finite mixture of distributions. Furthermore, each component in the mixture appeared to have distinct distributional features hinting at qualitatively distinct generating mechanisms behind each component, providing strong evidence for some form of labor market segmentation. This paper presents new findings that support these earlier conclusions using internal CPS ASEC data spanning a much longer study period from 1974 to 2016. The restricted-access internal data is not subject to the same level of top-coding as the public-use data that earlier contributions to the literature were based on. The evolution of the mixture components provides new insights about changes in the earnings distribution including earnings inequality. In addition, we correlate component membership with worker type to provide a tacit link to various theoretical explanations for labor market segmentation, while solving the problem of assigning observations to labor market segments a priori.View Full Paper PDF
-
Working PaperTrends in Earnings Volatility using Linked Administrative and Survey Data
August 2020
Working Paper Number:
CES-20-24
We document trends in earnings volatility separately by gender in combination with other characteristics such as race, educational attainment, and employment status using unique linked survey and administrative data for the tax years spanning 1995-2015. We also decompose the variance of trend volatility into within- and between-group contributions, as well as transitory and permanent shocks. Our results for continuously working men suggest that trend earnings volatility was stable over our period in both survey and tax data, though with a substantial countercyclical business-cycle component. Trend earnings volatility among women declined over the period in both survey and administrative data, but unlike for men, there was no change over the Great Recession. The variance decompositions indicate that nonresponders, low-educated, racial minorities, and part-year workers have the greatest group specific earnings volatility, but with the exception of part-year workers, they contribute least to the level and trend of volatility owing to their small share of the population. There is evidence of stable transitory volatility, but rising permanent volatility over the past two decades in male and female earnings.View Full Paper PDF