CREAT: Census Research Exploration and Analysis Tool

Papers written by Author(s): 'John M. Abowd'

The following papers contain search terms that you selected. From the papers listed below, you can navigate to the PDF, the profile page for that working paper, or see all the working papers written by an author. You can also explore tags, keywords, and authors that occur frequently within these papers.
Click here to search again

Frequently Occurring Concepts within this Search

Longitudinal Employer Household Dynamics - 30

National Science Foundation - 30

Cornell University - 25

Alfred P Sloan Foundation - 25

Bureau of Labor Statistics - 18

Quarterly Workforce Indicators - 17

American Community Survey - 16

Social Security Administration - 15

Unemployment Insurance - 15

Social Security Number - 14

Current Population Survey - 14

Survey of Income and Program Participation - 14

National Institute on Aging - 14

LEHD Program - 14

Census Bureau Disclosure Review Board - 13

National Bureau of Economic Research - 13

Internal Revenue Service - 12

Cornell Institute for Social and Economic Research - 12

Quarterly Census of Employment and Wages - 11

North American Industry Classification System - 11

Economic Census - 11

Research Data Center - 11

Employer Identification Numbers - 10

Disclosure Review Board - 9

Center for Economic Studies - 9

AKM - 9

Social Security - 9

Business Register - 9

Sloan Foundation - 8

Census Bureau Business Register - 8

Service Annual Survey - 8

Decennial Census - 7

2010 Census - 7

International Trade Research Report - 7

Standard Industrial Classification - 7

Protected Identification Key - 6

Federal Statistical Research Data Center - 6

Statistics Canada - 5

Longitudinal Business Database - 5

MIT Press - 5

Ordinary Least Squares - 5

University of Michigan - 5

Local Employment Dynamics - 5

Employer Characteristics File - 5

American Economic Review - 5

Department of Labor - 5

Office of Personnel Management - 4

Public Use Micro Sample - 4

National Academy of Sciences - 4

Person Validation System - 4

Census Edited File - 4

University of Chicago - 4

Journal of Labor Economics - 4

Health and Retirement Study - 4

PSID - 4

Bureau of Economic Analysis - 4

American Statistical Association - 4

Federal Reserve Bank - 4

Chicago Census Research Data Center - 4

Special Sworn Status - 4

Census Numident - 3

Some Other Race - 3

Office of Management and Budget - 3

1940 Census - 3

United States Census Bureau - 3

Personally Identifiable Information - 3

Department of Economics - 3

Department of Justice - 3

Metropolitan Statistical Area - 3

Longitudinal Research Database - 3

National Center for Health Statistics - 3

National Institutes of Health - 3

County Business Patterns - 3

Detailed Earnings Records - 3

Quarterly Journal of Economics - 3

Journal of Econometrics - 3

W-2 - 3

IZA - 3

Employment History File - 3

Individual Characteristics File - 3

Financial, Insurance and Real Estate Industries - 3

Viewing papers 11 through 20 of 43


  • Working Paper

    United States Earnings Dynamics: Inequality, Mobility, and Volatility

    September 2020

    Working Paper Number:

    CES-20-29

    Using data from the Census Bureau's Longitudinal Employer-Household Dynamics (LEHD) infrastructure files, we study changes over time and across sub-national populations in the distribution of real labor earnings. We consider four large MSAs (Detroit, Los Angeles, New York, and San Francisco) for the period 1998 to 2017, with particular attention paid to the subperiods before, during, and after the Great Recession. For the four large MSAs we analyze, there are clear national trends represented in each of the local areas, the most prominent of which is the increase in the share of earnings accruing to workers at the top of the earnings distribution in 2017 compared with 1998. However, the magnitude of these trends varies across MSAs, with New York and San Francisco showing relatively large increases and Los Angeles somewhere in the middle relative to Detroit whose total real earnings distribution is relatively stable over the period. Our results contribute to the emerging literature on differences between national and regional economic outcomes, exemplifying what will be possible with a new data exploration tool'the Earnings and Mobility Statistics (EAMS) web application'currently under development at the U.S. Census Bureau.
    View Full Paper PDF
  • Working Paper

    Why the Economics Profession Must Actively Participate in the Privacy Protection Debate

    March 2019

    Working Paper Number:

    CES-19-09

    When Google or the U.S. Census Bureau publish detailed statistics on browsing habits or neighborhood characteristics, some privacy is lost for everybody while supplying public information. To date, economists have not focused on the privacy loss inherent in data publication. In their stead, these issues have been advanced almost exclusively by computer scientists who are primarily interested in technical problems associated with protecting privacy. Economists should join the discussion, first, to determine where to balance privacy protection against data quality; a social choice problem. Furthermore, economists must ensure new privacy models preserve the validity of public data for economic research.
    View Full Paper PDF
  • Working Paper

    Optimal Probabilistic Record Linkage: Best Practice for Linking Employers in Survey and Administrative Data

    March 2019

    Working Paper Number:

    CES-19-08

    This paper illustrates an application of record linkage between a household-level survey and an establishment-level frame in the absence of unique identifiers. Linkage between frames in this setting is challenging because the distribution of employment across firms is highly asymmetric. To address these difficulties, this paper uses a supervised machine learning model to probabilistically link survey respondents in the Health and Retirement Study (HRS) with employers and establishments in the Census Business Register (BR) to create a new data source which we call the CenHRS. Multiple imputation is used to propagate uncertainty from the linkage step into subsequent analyses of the linked data. The linked data reveal new evidence that survey respondents' misreporting and selective nonresponse about employer characteristics are systematically correlated with wages.
    View Full Paper PDF
  • Working Paper

    An Economic Analysis of Privacy Protection and Statistical Accuracy as Social Choices

    August 2018

    Working Paper Number:

    CES-18-35

    Statistical agencies face a dual mandate to publish accurate statistics while protecting respondent privacy. Increasing privacy protection requires decreased accuracy. Recognizing this as a resource allocation problem, we propose an economic solution: operate where the marginal cost of increasing privacy equals the marginal benefit. Our model of production, from computer science, assumes data are published using an efficient differentially private algorithm. Optimal choice weighs the demand for accurate statistics against the demand for privacy. Examples from U.S. statistical programs show how our framework can guide decision-making. Further progress requires a better understanding of willingness-to-pay for privacy and statistical accuracy.
    View Full Paper PDF
  • Working Paper

    Disclosure Limitation and Confidentiality Protection in Linked Data

    January 2018

    Working Paper Number:

    CES-18-07

    Confidentiality protection for linked administrative data is a combination of access modalities and statistical disclosure limitation. We review traditional statistical disclosure limitation methods and newer methods based on synthetic data, input noise infusion and formal privacy. We discuss how these methods are integrated with access modalities by providing three detailed examples. The first example is the linkages in the Health and Retirement Study to Social Security Administration data. The second example is the linkage of the Survey of Income and Program Participation to administrative data from the Internal Revenue Service and the Social Security Administration. The third example is the Longitudinal Employer-Household Dynamics data, which links state unemployment insurance records for workers and firms to a wide variety of censuses and surveys at the U.S. Census Bureau. For examples, we discuss access modalities, disclosure limitation methods, the effectiveness of those methods, and the resulting analytical validity. The final sections discuss recent advances in access modalities for linked administrative data.
    View Full Paper PDF
  • Working Paper

    Total Error and Variability Measures with Integrated Disclosure Limitation for Quarterly Workforce Indicators and LEHD Origin Destination Employment Statistics in On The Map

    January 2017

    Working Paper Number:

    CES-17-71

    We report results from the rst comprehensive total quality evaluation of five major indicators in the U.S. Census Bureau's Longitudinal Employer-Household Dynamics (LEHD) Program Quarterly Workforce Indicators (QWI): total employment, beginning-of-quarter employment, full-quarter employment, total payroll, and average monthly earnings of full-quarter employees. Beginning-of-quarter employment is also the main tabulation variable in the LEHD Origin-Destination Employment Statistics (LODES) workplace reports as displayed in OnTheMap (OTM). The evaluation is conducted by generating multiple threads of the edit and imputation models used in the LEHD Infrastructure File System. These threads conform to the Rubin (1987) multiple imputation model, with each thread or implicate being the output of formal probability models that address coverage, edit, and imputation errors. Design-based sampling variability and nite population corrections are also included in the evaluation. We derive special formulas for the Rubin total variability and its components that are consistent with the disclosure avoidance system used for QWI and LODES/OTM workplace reports. These formulas allow us to publish the complete set of detailed total quality measures for QWI and LODES. The analysis reveals that the five publication variables under study are estimated very accurately for tabulations involving at least 10 jobs. Tabulations involving three to nine jobs have quality in the range generally deemed acceptable. Tabulations involving zero, one or two jobs, which are generally suppressed in the QWI and synthesized in LODES, have substantial total variability but their publication in LODES allows the formation of larger custom aggregations, which will in general have the accuracy estimated for tabulations in the QWI based on a similar number of workers.
    View Full Paper PDF
  • Working Paper

    Effects of a Government-Academic Partnership: Has the NSF-Census Bureau Research Network Helped Improve the U.S. Statistical System?

    January 2017

    Working Paper Number:

    CES-17-59R

    The National Science Foundation-Census Bureau Research Network (NCRN) was established in 2011 to create interdisciplinary research nodes on methodological questions of interest and significance to the broader research community and to the Federal Statistical System (FSS), particularly the Census Bureau. The activities to date have covered both fundamental and applied statistical research and have focused at least in part on the training of current and future generations of researchers in skills of relevance to surveys and alternative measurement of economic units, households, and persons. This paper discusses some of the key research findings of the eight nodes, organized into six topics: (1) Improving census and survey data collection methods; (2) Using alternative sources of data; (3) Protecting privacy and confidentiality by improving disclosure avoidance; (4) Using spatial and spatio-temporal statistical modeling to improve estimates; (5) Assessing data cost and quality tradeoffs; and (6) Combining information from multiple sources. It also reports on collaborations across nodes and with federal agencies, new software developed, and educational activities and outcomes. The paper concludes with an evaluation of the ability of the FSS to apply the NCRN's research outcomes and suggests some next steps, as well as the implications of this research-network model for future federal government renewal initiatives.
    View Full Paper PDF
  • Working Paper

    Sorting Between and Within Industries: A Testable Model of Assortative Matching

    January 2017

    Working Paper Number:

    CES-17-43

    We test Shimer's (2005) theory of the sorting of workers between and within industrial sectors based on directed search with coordination frictions, deliberately maintaining its static general equilibrium framework. We fit the model to sector-specific wage, vacancy and output data, including publicly-available statistics that characterize the distribution of worker and employer wage heterogeneity across sectors. Our empirical method is general and can be applied to a broad class of assignment models. The results indicate that industries are the loci of sorting-more productive workers are employed in more productive industries. The evidence confirm that strong assortative matching can be present even when worker and employer components of wage heterogeneity are weakly correlated.
    View Full Paper PDF
  • Working Paper

    Revisiting the Economics of Privacy: Population Statistics and Confidentiality Protection as Public Goods

    January 2017

    Working Paper Number:

    CES-17-37

    We consider the problem of determining the optimal accuracy of public statistics when increased accuracy requires a loss of privacy. To formalize this allocation problem, we use tools from statistics and computer science to model the publication technology used by a public statistical agency. We derive the demand for accurate statistics from first principles to generate interdependent preferences that account for the public-good nature of both data accuracy and privacy loss. We first show data accuracy is inefficiently undersupplied by a private provider. Solving the appropriate social planner's problem produces an implementable publication strategy. We implement the socially optimal publication plan for statistics on income and health status using data from the American Community Survey, National Health Interview Survey, Federal Statistical System Public Opinion Survey and Cornell National Social Survey. Our analysis indicates that welfare losses from providing too much privacy protection and, therefore, too little accuracy can be substantial.
    View Full Paper PDF
  • Working Paper

    Earnings Inequality and Mobility Trends in the United States: Nationally Representative Estimates from Longitudinally Linked Employer-Employee Data

    January 2017

    Working Paper Number:

    CES-17-24

    Using earnings data from the U.S. Census Bureau, this paper analyzes the role of the employer in explaining the rise in earnings inequality in the United States. We first establish a consistent frame of analysis appropriate for administrative data used to study earnings inequality. We show that the trends in earnings inequality in the administrative data from the Longitudinal Employer-Household Dynamics Program are inconsistent with other data sources when we do not correct for the presence of misused SSNs. After this correction to the worker frame, we analyze how the earnings distribution has changed in the last decade. We present a decomposition of the year-to-year changes in the earnings distribution from 2004-2013. Even when simplifying these flows to movements between the bottom 20%, the middle 60% and the top 20% of the earnings distribution, about 20.5 million workers undergo a transition each year. Another 19.9 million move between employment and nonemployment. To understand the role of the firm in these transitions, we estimate a model for log earnings with additive fixed worker and firm effects using all jobs held by eligible workers from 2004-2013. We construct a composite log earnings firm component across all jobs for a worker in a given year and a non-firm component. We also construct a skill-type index. We show that, while the difference between working at a low-or middle-paying firm are relatively small, the gains from working at a top-paying firm are large. Specifically, the benefits of working for a high-paying firm are not only realized today, through higher earnings paid to the worker, but also persist through an increase in the probability of upward mobility. High-paying firms facilitate moving workers to the top of the earnings distribution and keeping them there.
    View Full Paper PDF