An Analysis of Key Differences in Micro Data: Results from the Business List Comparison Project
September 2008
Working Paper Number:
CES-08-28
Abstract
The Bureau of Labor Statistics and the Bureau of the Census each maintain a business register, a universe of all U.S. business establishments and their characteristics, created from independent sources. Both registers serve critical functions such as supplying aggregate data inputs for certain national statistics generated by the Bureau of Economic Analysis. This paper examines key micro-level differences across these two business registers.
Document Tags and Keywords
Keywords
Keywords are automatically generated using KeyBERT, a powerful and innovative
keyword extraction tool that utilizes BERT embeddings to ensure high-quality and contextually relevant
keywords.
By analyzing the content of working papers, KeyBERT identifies terms and phrases that capture the essence of the
text, highlighting the most significant topics and trends. This approach not only enhances searchability but
provides connections that go beyond potentially domain-specific author-defined keywords.
:
payroll,
statistical,
report,
microdata,
survey,
agency,
employee,
organizational,
labor,
surveys censuses,
establishment,
department,
economic census,
workforce,
worker,
salary,
federal,
labor statistics,
census bureau,
census employment
Tags
Tags are automatically generated using a pretrained language model from spaCy, which excels at
several tasks, including entity tagging.
The model is able to label words and phrases by part-of-speech,
including "organizations." By filtering for frequent words and phrases labeled as "organizations", papers are
identified to contain references to specific institutions, datasets, and other organizations.
:
Internal Revenue Service,
Bureau of Labor Statistics,
Social Security Administration,
Bureau of Economic Analysis,
County Business Patterns,
Employer Identification Numbers,
Business Master File,
Economic Census,
Wholesale Trade,
Department of Labor,
North American Industry Classification System,
Business Register,
Quarterly Census of Employment and Wages,
Multiple Worksite Report
Similar Working Papers
Similarity between working papers are determined by an unsupervised neural
network model
know as Doc2Vec.
Doc2Vec is a model that represents entire documents as fixed-length vectors, allowing for the
capture of semantic meaning in a way that relates to the context of words within the document. The model learns to
associate a unique vector with each document while simultaneously learning word vectors, enabling tasks such as
document classification, clustering, and similarity detection by preserving the order and structure of words. The
document vectors are compared using cosine similarity/distance to determine the most similar working papers.
Papers identified with 🔥 are in the top 20% of similarity.
The 10 most similar working papers to the working paper 'An Analysis of Key Differences in Micro Data: Results from the Business List Comparison Project' are listed below in order of similarity.
-
Working PaperLongitudinal Establishment And Enterprise Microdata (LEEM) Documentation
May 1998
Working Paper Number:
CES-98-09
This paper introduces and documents the new Longitudinal Enterprise and Establishment Microdata (LEEM) database, which has been constructed by Census' Economic Planning and Coordination Division under contract to the Office of Advocacy of the U.S. Small Business Administration. The LEEM links three years (1990, 1994, and 1995) of basic data for each private sector establishment with payroll in any of those years, along with data on the firm to which the establishment belongs each year. The LEEM data will facilitate both broader and more detailed analysis of patterns of job creation and destruction in the U.S., as well as research on the structure and dynamics of U.S. businesses. This paper provides documentation of the construction of LEEM data, summary data on most variables in the database, comparisons of the annual data with that of the nearly identical County Business Patterns, and distributions of establishments and their employment by the size of their firms. This is followed by a simple analysis of changes over time in the attributes of surviving establishments, and a brief discussion of turnover (business births and deaths) in the population and gross changes in employment associated with both establishment turnover and with surviving establishments. It concludes with a summary of the strengths and weaknesses of the LEEM.View Full Paper PDF
-
Working PaperNEW DATA FOR DYNAMIC ANALYSIS: THE LONGITUDINAL ESTABLISHMENT AND ENTERPRISE MICRODATA (LEEM) FILE
December 1999
Working Paper Number:
CES-99-18
Until now, research on U.S. business activities over time has been hindered by the lack of accurate and comprehensive longitudinal data. The new Longitudinal Establishment and Enterprise Microdata (LEEM) are tremendously rich data that open up numerous possibilities for dynamic analyses of businesses in the U.S. economy. It is the first nationwide high-quality longitudinal database that covers the majority of employer businesses from all sectors of the economy. Due to the confidential nature of these data, the file is located at the Center for Economic Studies in the U.S. Bureau of the Census. To access the data, researchers must submit an acceptable proposal to CES and become sworn Census researchers. This paper describes the LEEM file, the variables contained on the file, and current uses of the data.View Full Paper PDF
-
Working PaperDocumenting the Business Register and Related Economic Business Data
March 2016
Working Paper Number:
CES-16-17
The Business Register (BR) is a comprehensive database of business establishments in the United States and provides resources for the U.S. Census Bureau's economic programs for sample selection, research, and survey operations. It is maintained using information from several federal agencies including the Census Bureau, Internal Revenue Service, Bureau of Labor Statistics, and the Social Security Administration. This paper provides a detailed description of the sources and functions of the BR. An overview of the BR as a linking tool and bridge to other Census Bureau data for additional business characteristics is also given.View Full Paper PDF
-
Working PaperMatching Compustat Data to the Longitudinal Business Database, 1976-2020
September 2025
Working Paper Number:
CES-25-65
This paper details the methodology for creating an updated Compustat-Longitudinal Business Database (LBD) bridge, facilitating linkage between company identifiers in Compustat and firm identifiers in the LBD. In addition to data from Compustat, we incorporate historical data on public companies from various public and private sources, including information on executive names. Our methodology involves a series of stages using fuzzy name and address matching, including EIN, telephone number, and industry code matching. Qualified researchers with approved proposals can access this bridge though the Federal Statistical Research Data Centers. The Compustat-SSL bridge serves as a crucial resource for longitudinal studies on U.S. businesses, corporate governance, and executive compensation.View Full Paper PDF
-
Working PaperPublished Versus Sample Statistics From The ASM: Implications For The LRD
January 1991
Working Paper Number:
CES-91-01
In principle, the Longitudinal Research Database ( LRD ) which links the establishments in the Annual Survey of Manufactures (ASM) is ideal for examining the dynamics of firm and aggregate behavior. However, the published ASM aggregates are not simply the appropriately weighted sums of establishment data in the LRD . Instead, the published data equal the sum of LRD-based sample estimates and nonsample estimates. The latter reflect adjustments related to sampling error and the imputation of small-establishment data. Differences between the LRD and the ASM raise questions for users of both data sets. For ASM users, time-series variation in the difference indicates potential problems in consistently and reliably estimating the nonsample portion of the ASM. For LRD users, potential sample selection problems arise due to the systematic exclusion of data from small establishments. Microeconomic studies based on the LRD can yield misleading inferences to the extent that small establishments behave differently. Similarly, new economic aggregates constructed from the LRD can yield incorrect estimates of levels and growth rates. This paper documents cross-sectional and time-series differences between ASM and LRD estimates of levels and growth rates of total employment, and compares them with employment estimates provided by Bureau of Labor Statistics and County Business Patterns data. In addition, this paper explores potential adjustments to economic aggregates constructed from the LRD. In particular, the paper reports the results of adjusting LRD-based estimates of gross job creation and destruction to be consistent with net job changes implied by the published ASM figures.View Full Paper PDF
-
Working PaperIdentifying U.S. Merchandise Traders: Integrating Customs Transactions with Business Administrative Data
September 2020
Working Paper Number:
CES-20-28
This paper describes the construction of the Longitudinal Firm Trade Transactions Database (LFTTD) enabling the identification of merchandise traders - exporters and importers - in the U.S. Census Bureau's Business Register (BR). The LFTTD links merchandise export and import transactions from customs declaration forms to the BR beginning in 1992 through the present. We employ a combination of deterministic and probabilistic matching algorithms to assign a unique firm identifier in the BR to a merchandise export or import transaction record. On average, we match 89 percent of export and import values to a firm identifier. In 1992, we match 79 (88) percent of export (import) value; in 2017, we match 92 (96) percent of export (import) value. Trade transactions in year t are matched to years between 1976 and t+1 of the BR. On average, 94 percent of the trade value matches to a firm in year t of the BR. The LFTTD provides the most comprehensive identification of and the foundation for the analysis of goods trading firms in the U.S. economy.View Full Paper PDF
-
Working PaperRedesigning the Longitudinal Business Database
May 2021
Working Paper Number:
CES-21-08
In this paper we describe the U.S. Census Bureau's redesign and production implementation of the Longitudinal Business Database (LBD) first introduced by Jarmin and Miranda (2002). The LBD is used to create the Business Dynamics Statistics (BDS), tabulations describing the entry, exit, expansion, and contraction of businesses. The new LBD and BDS also incorporate information formerly provided by the Statistics of U.S. Businesses program, which produced similar year-to-year measures of employment and establishment flows. We describe in detail how the LBD is created from curation of the input administrative data, longitudinal matching, retiming of economic census-year births and deaths, creation of vintage consistent industry codes and noise factors, and the creation and cleaning of each year of LBD data. This documentation is intended to facilitate the proper use and understanding of the data by both researchers with approved projects accessing the LBD microdata and those using the BDS tabulations.View Full Paper PDF
-
Working PaperComparing Measures of Earnings Instability Based on Survey and Adminstrative Reports
August 2010
Working Paper Number:
CES-10-15
In Celik, Juhn, McCue, and Thompson (2009), we found that estimated levels of earnings instability based on data from the Current Population Survey (CPS) and the Survey of Income and Program Participation (SIPP) were reasonably close to each other and to others' estimates from the Panel Study of Income Dynamics (PSID), but estimates from unemployment insurance (UI) earnings were much larger. Given that the UI data are from administrative records which are often posited to be more accurate than survey reports, this raises concerns that measures based on survey data understate true earnings instability. To address this, we use links between survey samples from the SIPP and UI earnings records in the LEHD database to identify sources of differences in work history and earnings information. Substantial work has been done comparing earnings levels from administrative records to those collected in the SIPP and CPS, but our understanding of earnings instability would benefit from further examination of differences across sources in the properties of changes in earnings. We first compare characteristics of the overall and matched samples to address issues of selection in the matching process. We then compare earnings levels and jobs in the SIPP and LEHD data to identify differences between them. Finally we begin to examine how such differences affect estimates of earnings instability. Our preliminary findings suggest that differences in earnings changes for those in the lower tail of the earnings distribution account for much of the difference in instability estimates.View Full Paper PDF
-
Working PaperNew U.S. Business Establishments: Surging or Stalling?
June 2026
Working Paper Number:
CES-26-36
Since the 1990s, the Bureau of Labor Statistics (BLS) has reported much more rapid growth in U.S. private sector employer establishments than has the Census Bureau' the gap reached roughly 1.6 million by 2023. Using linked BLS-Census microdata, we document two main drivers. First, a large and growing number of employers providing services to the elderly and persons with disabilities are in scope for the BLS frame but not the Census Bureau's. Second, many firms appear with substantially more establishments in the BLS frame. These discrepancies substantially affect the measured establishment size distribution and quantitative policy analysis.View Full Paper PDF
-
Working PaperThe Impact of Hurricanes Katrina, Rita and Wilma on Business Establishments: A GIS Approach
August 2006
Working Paper Number:
CES-06-23
We use Geographic Information System tools to develop estimates of the economic impact of disaster events such as Hurricane Katrina. Our methodology relies on mapping establishments from the Census Bureau's Business Register into damage zones defined by remote sensing information provided by FEMA. The identification of damaged establishments by precisely locating them on a map provides a far more accurate characterization of affected businesses than those typically reported from readily available county level data. The need for prompt estimates is critical since they are more valuable the sooner they are released after a catastrophic event. Our methodology is based on pre-storm data. Therefore, estimates can be made available very quickly to inform the public as well as policy makers. Robustness tests using data from after the storms indicate our GIS estimates, while much smaller than those based on publicly available county-level data, still overstate actual observed losses. We discuss ways to refine and augment the GIS approach to provide even more accurate estimates of the impact of disasters on businesses.View Full Paper PDF
