Industry Shakeouts after an Innovation Breakthrough
November 2024
Working Paper Number:
CES-24-70
Abstract
Conventional wisdom suggests that after a technological breakthrough, the number of active firms first surges, and then sharply declines, in what is known as a 'shakeout'. This paper challenges that notion with new empirical evidence from across the U.S. economy, revealing that shakeouts are the exception, not the rule. I develop a statistical strategy to detect breakthroughs by isolating sustained anomalies in net firm entry rates, offering a robust alternative to narrative-driven approaches that can be applied to all industries. The results of this strategy, which reliably align with well-documented breakthroughs and remain consistent across various validation tests, uncover a novel trend: the number of entry-driven breakthroughs has been declining over time. The variability and frequent absence of shakeouts across breakthrough industries are consistent with breakthroughs primarily occurring in industries with low returns to scale and with modest learning curves, shifting the narrative on the nature of innovation over the past forty years in the U.S.
Document Tags and Keywords
Keywords
Keywords are automatically generated using KeyBERT, a powerful and innovative
keyword extraction tool that utilizes BERT embeddings to ensure high-quality and contextually relevant
keywords.
By analyzing the content of working papers, KeyBERT identifies terms and phrases that capture the essence of the
text, highlighting the most significant topics and trends. This approach not only enhances searchability but
provides connections that go beyond potentially domain-specific author-defined keywords.
:
market,
production,
enterprise,
industrial,
company,
growth,
financial,
finance,
sector,
trend,
innovation,
impact,
sectoral
Tags
Tags are automatically generated using a pretrained language model from spaCy, which excels at
several tasks, including entity tagging.
The model is able to label words and phrases by part-of-speech,
including "organizations." By filtering for frequent words and phrases labeled as "organizations", papers are
identified to contain references to specific institutions, datasets, and other organizations.
:
Center for Economic Studies,
IBM,
Insurance Information Institute,
Longitudinal Business Database,
North American Industry Classification System,
Census Bureau Disclosure Review Board,
Business Dynamics Statistics,
Federal Statistical Research Data Center
Similar Working Papers
Similarity between working papers are determined by an unsupervised neural
network model
know as Doc2Vec.
Doc2Vec is a model that represents entire documents as fixed-length vectors, allowing for the
capture of semantic meaning in a way that relates to the context of words within the document. The model learns to
associate a unique vector with each document while simultaneously learning word vectors, enabling tasks such as
document classification, clustering, and similarity detection by preserving the order and structure of words. The
document vectors are compared using cosine similarity/distance to determine the most similar working papers.
Papers identified with 🔥 are in the top 20% of similarity.
The 10 most similar working papers to the working paper 'Industry Shakeouts after an Innovation Breakthrough' are listed below in order of similarity.
-
Working PaperTechnology-Driven Market Concentration through Idea Allocation
December 2025
Working Paper Number:
CES-25-78
Using a newly-created measure of technology novelty, this paper identifies periods with and without technology breakthroughs from the 1980s to the 2020s in the US. It is found that market concentration decreases at the advent of revolutionary technologies. We establish a theory addressing inventors' decisions to establish new firms or join incumbents of selected sizes, yielding two key predictions: (1) A higher share of inventors opt for new firms during periods of heightened technology novelty. (2). There is positive assortative matching between idea quality and firm size if inventors join incumbents. Both predictions align with empirical findings and collectively contribute to a reduction in market concentration when groundbreaking technologies occur. Quantitative analysis shows the overall slowdown in technological breakthroughs can capture 95.9% of the rising trend in market concentration and the correlation between the model-generated and the actual detrended market concentration is 0.910.View Full Paper PDF
-
Working PaperHigh-Growth Firms in the United States: Key Trends and New Data Opportunities
March 2024
Working Paper Number:
CES-24-11
Using administrative data from the U.S. Census Bureau, we introduce a new public-use database that tracks activities across firm growth distributions over time and by firm and establishment characteristics. With these new data, we uncover several key trends on high-growth firms'critical engines of innovation and economic growth. First, the share of firms that are high-growth has steadily decreased over the past four decades, driven not only by falling firm entry rates but also languishing growth among existing firms. Second, this decline is particularly pronounced among young and small firms, while the share of high-growth firms has been relatively stable among large and old firms. Third, the decline in high-growth firms is found in all sectors, but the information sector has shown a modest rebound beginning in 2010. Fourth, there is significant variation in high-growth firm activity across states, with California, Texas, and Florida having high shares of high-growth firms. We highlight several areas for future research enabled by these new data.View Full Paper PDF
-
Working PaperPatents, Innovation, and Market Entry
September 2023
Working Paper Number:
CES-23-45
Do patents facilitate market entry and job creation? Using a 2014 Supreme Court decision that limited patent eligibility and natural language processing methods to identify invalid patents, I find that large treated firms reduce job creation and create fewer new establishments in response, with no effect on new firm entry. Moreover, companies shift toward innovation aimed at improving existing products consistent with the view that patents incentivize creative destruction.View Full Paper PDF
-
Working PaperThe Impact of Vintage and Survival on Productivity: Evidence from Cohorts of U.S. Manufacturing Plants
May 2000
Working Paper Number:
CES-00-06
This paper examines the evolution of productivity in U.S. manufacturing plants from 1963 to 1992. We define a 'vintage effect' as the change in productivity of recent cohorts of new plants relative to earlier cohorts of new plants, and a 'survival effect' as the change in productivity of a particular cohort of surviving plants as it ages. The data show that both factors contribute to industry productivity growth, but play offsetting roles in determining a cohort's relative position in the productivity distribution. Recent cohorts enter with significantly higher productivity than earlier entrants did, while surviving cohorts show significant increases in productivity as they age. These two effects roughly offset each other, however, so there is a rough convergence in productivity across cohorts in 1992 and 1987. (JEL Code: D24, L6)View Full Paper PDF
-
Working PaperAutomation and the Workforce: A Firm-Level View from the 2019 Annual Business Survey
April 2022
Working Paper Number:
CES-22-12R
This paper describes the adoption of automation technologies by US firms across all economic sectors by leveraging a new module introduced in the 2019 Annual Business Survey, conducted by the US Census Bureau in partnership with the National Center for Science and Engineering Statistics (NCSES). The module collects data from over 300,000 firms on the use of five advanced technologies: AI, robotics, dedicated equipment, specialized software, and cloud computing. The adoption of these technologies remains low (especially for AI and robotics), varies substantially across industries, and concentrates on large and young firms. However, because larger firms are much more likely to adopt them, 12-64% of US workers and 22-72% of manufacturing workers are exposed to these technologies. Firms report a variety of motivations for adoption, including automating tasks previously performed by labor. Consistent with the use of these technologies for automation, adopters have higher labor productivity and lower labor shares. In particular, the use of these technologies is associated with a 11.4% higher labor productivity, which accounts for 20'30% of the difference in labor productivity between large firms and the median firm in an industry. Adopters report that these technologies raised skill requirements and led to greater demand for skilled labor, but brought limited or ambiguous effects to their employment levels.View Full Paper PDF
-
Working PaperMarket Structure and Productivity: A Concrete Example
June 2001
Working Paper Number:
CES-01-06
This paper shows that imperfect output substitutability explains part of the observed persistent plant-level productivity dispersion. Specifically, as substitutability in a market increases, the market's productivity distribution exhibits falling dispersion and higher central tendency. The proposed mechanism behind this result is truncation of the distribution from below as increased substitutability shifts demand to lower-cost plants and drives inefficient plants out of business. In a case study of the ready-mixed concrete industry, I examine the impact of one manifestation of this effect, driven by geographic market segmentation resulting from transport costs. A theoretical foundation is presented characterizing how differences in the density of local demand impact the number of producers and the ability of customers to choose between suppliers, and through this, the equilibrium productivity and output levels across regions. I also introduce a new method of obtaining plant-level productivity estimates that is well suited to this application and avoids potential shortfalls of commonly used procedures. I use these estimates to empirically test the presented theory, and the results support the predictions of the model. Local demand density has a significant influence on the shape of plant-level productivity distributions, and accounts for part of the observed intra-industry variation in productivity, both between and within given market areas.View Full Paper PDF
-
Working PaperSame Shock, Separate Channels: House Prices and Firm Performance in the Great Recession
January 2026
Working Paper Number:
CES-26-03
Combining confidential business-level microdata with housing and banking data, I document large and persistent effects of local house prices on employment at small businesses, and particularly young businesses, during the Great Recession. I show that the effect on entry is important for explaining the disproportionate effect on young businesses, while young firm exit is also disproportionately affected. I then explore the channels through which house prices affect business outcomes. I use survey data to show that reliance on either personal assets or home equity is associated with increased sensitivity to house prices. I then use local bank balance sheet information to show both young and old firms are sensitive to local credit shocks, with some evidence of a larger effect on young businesses. I develop a macroeconomic model that is consistent with these findings where house prices work through two channels: a bank credit supply channel and a housing collateral channel.View Full Paper PDF
-
Working PaperHow Firms Respond to Business Cycles: The Role of Firm Age and Firm Size
June 2013
Working Paper Number:
CES-13-30
There remains considerable debate in the theoretical and empirical literature about the differences in the cyclical dynamics of firms by firm size. This paper contributes to the debate in two ways. First, the key distinction between firm size and firm age is introduced. The evidence presented in this paper shows that young businesses (that are typically small) exhibit very different cyclical dynamics than small/older businesses. The second contribution is to present evidence and explore explanations for the finding that young/small businesses were hit especially hard in the Great Recession. The collapse in housing prices accounts for a significant part of the large decline of young/small businesses in the Great Recession.View Full Paper PDF
-
Working PaperBusiness Dynamics Statistics of High Tech Industries
January 2016
Working Paper Number:
CES-16-55
Modern market economies are characterized by the reallocation of resources from less productive, less valuable activities to more productive, more valuable ones. Businesses in the High Technology sector play a particularly important role in this reallocation by introducing new products and services that impact the entire economy. Tracking the performance of this sector is therefore of primary importance, especially in light of recent evidence that suggests a slowdown in business dynamism in High Tech industries. The Census Bureau produces the Business Dynamics Statistics (BDS), a suite of data products that track job creation, job destruction, startups, and exits by firm and establishment characteristics including sector, firm age, and firm size. In this paper we describe the methodologies used to produce a new extension to the BDS focused on businesses in High Technology industries.View Full Paper PDF
-
Working PaperEntry, Exit, and the Determinants of Market Structure
September 2009
Working Paper Number:
CES-09-23
Market structure is determined by the entry and exit decisions of individual producers. These decisions are driven by expectations of future profits which, in turn, depend on the nature of competition within the market. In this paper we estimate a dynamic, structural model of entry and exit in an oligopolistic industry and use it to quantify the determinants of market structure and long-run firm values for two U.S. service industries, dentists and chiropractors. We find that entry costs faced by potential entrants, fixed costs faced by incumbent producers, and the toughness of short-run price competition are all important determinants of long run firm values and market structure. As the number of firms in the market increases, the value of continuing in the market and the value of entering the market both decline, the probability of exit rises, and the probability of entry declines. The magnitude of these effects differ substantially across markets due to differences in exogenous cost and demand factors and across the dentist and chiropractor industries. Simulations using the estimated model for the dentist industry show that pressure from both potential entrants and incumbent firms discipline long-run profits. We calculate that a seven percent reduction in the mean sunk entry cost would reduce a monopolist's long-run profits by the same amount as if the firm operated in a duopoly.View Full Paper PDF
