Measuring Cross-Country Differences in Misallocation
January 2016
Working Paper Number:
CES-16-50R
Abstract
We describe differences between the commonly used version of the U.S. Census of Manufactures available at the RDCs and what establishments themselves report. The originally reported data has substantially more dispersion in measured establishment productivity. Measured allocative efficiency is substantially higher in the cleaned data than the raw data: 4x higher in 2002, 20x in 2007, and 80x in 2012. Many of the important editing strategies at the Census, including industry analysts' manual edits and edits using tax records, are infeasible in non-U.S. datasets. We describe a new Bayesian approach for editing and imputation that can be used across contexts.
Document Tags and Keywords
Keywords
Keywords are automatically generated using KeyBERT, a powerful and innovative
keyword extraction tool that utilizes BERT embeddings to ensure high-quality and contextually relevant
keywords.
By analyzing the content of working papers, KeyBERT identifies terms and phrases that capture the essence of the
text, highlighting the most significant topics and trends. This approach not only enhances searchability but
provides connections that go beyond potentially domain-specific author-defined keywords.
:
estimating,
statistical,
data census,
report,
analyst,
agency,
respondent,
employed,
imputation,
reporting,
revenue,
record,
irs,
use census,
datasets,
employed census
Tags
Tags are automatically generated using a pretrained language model from spaCy, which excels at
several tasks, including entity tagging.
The model is able to label words and phrases by part-of-speech,
including "organizations." By filtering for frequent words and phrases labeled as "organizations", papers are
identified to contain references to specific institutions, datasets, and other organizations.
:
Census of Manufactures,
Annual Survey of Manufactures,
Internal Revenue Service,
Center for Economic Studies,
Total Factor Productivity,
Cobb-Douglas,
Census Bureau Longitudinal Business Database,
IQR,
TFPR,
TFPQ,
Census Bureau Disclosure Review Board,
Disclosure Review Board,
Federal Statistical Research Data Center
Similar Working Papers
Similarity between working papers are determined by an unsupervised neural
network model
know as Doc2Vec.
Doc2Vec is a model that represents entire documents as fixed-length vectors, allowing for the
capture of semantic meaning in a way that relates to the context of words within the document. The model learns to
associate a unique vector with each document while simultaneously learning word vectors, enabling tasks such as
document classification, clustering, and similarity detection by preserving the order and structure of words. The
document vectors are compared using cosine similarity/distance to determine the most similar working papers.
Papers identified with 🔥 are in the top 20% of similarity.
The 10 most similar working papers to the working paper 'Measuring Cross-Country Differences in Misallocation' are listed below in order of similarity.
-
Working PaperManufacturing Dispersion: How Data Cleaning Choices Affect Measured Misallocation and Productivity Growth in the Annual Survey of Manufactures🔥
September 2025
Working Paper Number:
CES-25-67
Measurement of dispersion of productivity levels and productivity growth rates across businesses is a key input for answering a variety of important economic questions, such as understanding the allocation of economic inputs across businesses and over time. While item nonresponse is a readily quantifiable issue, we show there is also misreporting by respondents in the Annual Survey of Manufactures (ASM). Aware of these measurement issues, the Census Bureau edits and imputes survey responses before tabulation and dissemination. However, edit and imputation methods that are suitable for publishing aggregate totals may not be suitable for estimating other measures from the microdata. We show that the methods used dramatically affect estimates of productivity dispersion, allocative efficiency, and aggregate productivity growth. Using a Bayesian approach for editing and imputation, we model the joint distributions of all variables needed to estimate these measures, and we quantify the degree of uncertainty in the estimates due to imputations for faulty or missing data.View Full Paper PDF
-
Working PaperMisallocation or Mismeasurement?🔥
February 2020
Working Paper Number:
CES-20-07
The ratio of revenue to inputs differs greatly across plants within countries such as the U.S. and India. Such gaps may reflect misallocation which hinders aggregate productivity. But differences in measured average products need not reflect differences in true marginal products. We propose a way to estimate the gaps in true marginal products in the presence of measurement error. Our method exploits how revenue growth is less sensitive to input growth when a plant's average products are overstated by measurement error. For Indian manufacturing from 1985'2013, our correction lowers potential gains from reallocation by 20%. For the U.S. the effect is even more dramatic, reducing potential gains by 60% and eliminating 2/3 of a severe downward trend in allocative efficiency over 1978'2013.View Full Paper PDF
-
Working PaperSimultaneous Edit-Imputation for Continuous Microdata🔥
December 2015
Working Paper Number:
CES-15-44
Many statistical organizations collect data that are expected to satisfy linear constraints; as examples, component variables should sum to total variables, and ratios of pairs of variables should be bounded by expert-specified constants. When reported data violate constraints, organizations identify and replace values potentially in error in a process known as edit-imputation. To date, most approaches separate the error localization and imputation steps, typically using optimization methods to identify the variables to change followed by hot deck imputation. We present an approach that fully integrates editing and imputation for continuous microdata under linear constraints. Our approach relies on a Bayesian hierarchical model that includes (i) a flexible joint probability model for the underlying true values of the data with support only on the set of values that satisfy all editing constraints, (ii) a model for latent indicators of the variables that are in error, and (iii) a model for the reported responses for variables in error. We illustrate the potential advantages of the Bayesian editing approach over existing approaches using simulation studies. We apply the model to edit faulty data from the 2007 U.S. Census of Manufactures. Supplementary materials for this article are available online.View Full Paper PDF
-
Working PaperAre We Undercounting Reallocation's Contribution to Growth?
January 2013
Working Paper Number:
CES-13-55R
There has been a strong surge in aggregate productivity growth in India since 1990, following significant economic reforms. Three recent studies have used two distinct methodologies to decompose the sources of growth, and all conclude that it has been driven by within-plant increases in technical efficiency and not between-plant reallocation of inputs. Given the nature of the reforms, where many barriers to input reallocation were removed, this finding has surprised researchers and been dubbed 'India's Mysterious Manufacturing Miracle.' In this paper, we show that the methodologies used may artificially understate the extent of reallocation. One approach, using growth in value added, counts all reallocation growth arising from the movement of intermediate inputs as technical efficiency growth. The second approach, using the Olley-Pakes decomposition, uses estimates of plant-level total factor productivity (TFP) as a proxy for the marginal product of inputs. However, in equilibrium, TFP and the marginal product of inputs are unrelated. Using microdata on manufacturing from five countries ' India, the U.S., Chile, Colombia, and Slovenia ' we show that both approaches significantly understate the true role of reallocation in economic growth. In particular, reallocation of materials is responsible for over half of aggregate Indian manufacturing productivity growth since 2000, substantially larger than either the contribution of primary inputs or the change in the covariance of productivity and size.View Full Paper PDF
-
Working PaperMisallocation and Manufacturing TFP in China and India
February 2009
Working Paper Number:
CES-09-04
Resource misallocation can lower aggregate total factor productivity (TFP). We use micro data on manufacturing establishments to quantify the potential extent of misallocation in China and India compared to the U.S. Compared to the U.S., we measure sizable gaps in marginal products of labor and capital across plants within narrowly-defined industries in China and India. When capital and labor are hypothetically reallocated to equalize marginal products to the extent observed in the U.S., we calculate manufacturing TFP gains of 30-50% in China and 40-60% in India.View Full Paper PDF
-
Working PaperMissing Growth from Creative Destruction
April 2018
Working Paper Number:
CES-18-18
Statistical agencies typically impute inflation for disappearing products based on surviving products, which may result in overstated inflation and understated growth. Using U.S. Census data, we apply two ways of assessing the magnitude of 'missing growth' for private nonfarm businesses from 1983'2013. The first approach exploits information on the market share of surviving plants. The second approach applies indirect inference to firm-level data. We find: (i) missing growth from imputation is substantial ' at least 0.6 percentage points per year; and (ii) most of the missing growth is due to creative destruction (as opposed to new varieties).View Full Paper PDF
-
Working PaperEstimating market power Evidence from the US Brewing Industry
January 2017
Working Paper Number:
CES-17-06R
While inferring markups from demand data is common practice, estimation relies on difficult-to-test assumptions, including a specific model of how firms compete. Alternatively, markups can be inferred from production data, again relying on a set of difficult-to-test assumptions, but a wholly different set, including the assumption that firms minimize costs using a variable input. Relying on data from the US brewing industry, we directly compare markup estimates from the two approaches. After implementing each approach for a broad set of assumptions and specifications, we find that both approaches provide similar and plausible markup estimates in most cases. The results illustrate how using the two strategies together can allow researchers to evaluate structural models and identify problematic assumptions.View Full Paper PDF
-
Working PaperAre We Overstating the Economic Costs of Environmental Protection?
May 1997
Working Paper Number:
CES-97-12
Reported expenditures for environmental protection in the U.S. are estimated to exceed $150 billion annually or about 2% of GDP. This estimate is often used as an assessment of the burden of current regulatory efforts and a standard against which the associated benefits are measured. This makes it a key statistic in the debate surrounding both current and future environmental regulation. Little is known, however, about how well reported expenditures relate to true economic cost. True economic cost depends on whether reported environmental expenditures generate incidental savings, involve uncounted burdens, or accurately reflect the total cost of environmental protection. This paper explores the relationship between reported expenditures and economic cost in a number of major manufacturing industries. Previous research has suggested that an incremental $1 of reported environmental expenditures increases total production costs by anywhere from $1 to $12, i.e., increases in reported costs probably understate the actual increase in economic cost. Surprisingly, our results suggest the reverse, that increases in reported costs may overstate the actual increase in economic cost. Our results are based a large plant-level data set for eleven four-digit SIC industries. We employ a cost-function modeling approach that involves three basic steps. First, we treat real environmental expenditures as a second output of the plant, reflecting perceived environmental abatement efforts. Second, we model the joint production of conventional output and environmental effort as a cost-minimization problem. Third, we calculate the effect of an incremental dollar of reported environmental expenditures at the plant, industry, and manufacturing sector levels. Our approach differs from previous work with similar data by considering a large number of industries, using a cost-function modeling approach, and paying particular attention to plant-specific effects. Our preferred, fixed-effects model obtains an aggregate estimate of thirteen cents in increased costs for every dollar of reported incremental pollution control expenditures, with a standard error of sixty-one cents. This single estimate, however, conceals the wide range of values observed at the industry and plant level. We also find that estimates using an alternative, random-effects model are uniformly higher. Although the higher, random-effects estimates are more consistent with previous work, we believe they are biased by omitted variables characterizing differences among plants. While further research is needed, our results suggest that previous estimates of the economic cost associated with environmental expenditures have been biased upward and that the possibility of overstatement is quite real. Key words: environmental costs, fixed-effects, translog cost modelView Full Paper PDF
-
Working PaperAllocating Misallocation: Decomposing Measures of Aggregate Allocative Efficiency
April 2026
Working Paper Number:
CES-26-26
We explore sources of measured misallocation using establishment data from U.S. manufacturing industries. We decompose standard revenue productivity dispersion statistics into contributions by dispersion in revenue margins over costs and dispersion in input cost shares across plants. We establish a formal link between these components and measured allocative efficiency. The results indicate the components contribute similarly to apparent rising misallocation in US manufacturing. We use the mapping between distortions that influence these distinct components to explore the relationship between inferred distortions and mechanisms that influence one or both sources of revenue productivity dispersion. Finally, we show rising misallocation in the US manufacturing sector in the last several decades is pervasive, and yet a few industries account for over half of the aggregate decline.View Full Paper PDF
-
Working PaperRECOVERING THE ITEM-LEVEL EDIT AND IMPUTATION FLAGS IN THE 1977-1997 CENSUSES OF MANUFACTURES
September 2014
Working Paper Number:
CES-14-37
As part of processing the Census of Manufactures, the Census Bureau edits some data items and imputes for missing data and some data that is deemed erroneous. Until recently it was difficult for researchers using the plant-level microdata to determine which data items were changed or imputed during the editing and imputation process, because the edit/imputation processing flags were not available to researchers. This paper describes the process of reconstructing the edit/imputation flags for variables in the 1977, 1982, 1987, 1992, and 1997 Censuses of Manufactures using recently recovered Census Bureau files. Thepaper also reports summary statistics for the percentage of cases that are imputed for key variables. Excluding plants with fewer than 5 employees, imputation rates for several key variables range from 8% to 54% for the manufacturing sector as a whole, and from 1% to 72% at the 2-digit SIC industry level.View Full Paper PDF
