CREAT: Census Research Exploration and Analysis Tool

Technology-Driven Market Concentration through Idea Allocation

December 2025

Working Paper Number:

CES-25-78

Abstract

Using a newly-created measure of technology novelty, this paper identifies periods with and without technology breakthroughs from the 1980s to the 2020s in the US. It is found that market concentration decreases at the advent of revolutionary technologies. We establish a theory addressing inventors' decisions to establish new firms or join incumbents of selected sizes, yielding two key predictions: (1) A higher share of inventors opt for new firms during periods of heightened technology novelty. (2). There is positive assortative matching between idea quality and firm size if inventors join incumbents. Both predictions align with empirical findings and collectively contribute to a reduction in market concentration when groundbreaking technologies occur. Quantitative analysis shows the overall slowdown in technological breakthroughs can capture 95.9% of the rising trend in market concentration and the correlation between the model-generated and the actual detrended market concentration is 0.910.

Document Tags and Keywords

Keywords Keywords are automatically generated using KeyBERT, a powerful and innovative keyword extraction tool that utilizes BERT embeddings to ensure high-quality and contextually relevant keywords.

By analyzing the content of working papers, KeyBERT identifies terms and phrases that capture the essence of the text, highlighting the most significant topics and trends. This approach not only enhances searchability but provides connections that go beyond potentially domain-specific author-defined keywords.
:
technology, growth, technological, tech, venture, monopolistic, trend, innovation, inventory, patent, innovate, patenting, innovative

Tags Tags are automatically generated using a pretrained language model from spaCy, which excels at several tasks, including entity tagging.

The model is able to label words and phrases by part-of-speech, including "organizations." By filtering for frequent words and phrases labeled as "organizations", papers are identified to contain references to specific institutions, datasets, and other organizations.
:
Internal Revenue Service, Center for Economic Studies, National Bureau of Economic Research, Census Bureau Longitudinal Business Database, Longitudinal Business Database, Center for Research in Security Prices, Patent and Trademark Office, Herfindahl Hirschman Index, Census Bureau Disclosure Review Board, Herfindahl-Hirschman, Disclosure Review Board, Business Dynamics Statistics, Federal Statistical Research Data Center, Maximum Likelihood Estimation

Similar Working Papers Similarity between working papers are determined by an unsupervised neural network model know as Doc2Vec.

Doc2Vec is a model that represents entire documents as fixed-length vectors, allowing for the capture of semantic meaning in a way that relates to the context of words within the document. The model learns to associate a unique vector with each document while simultaneously learning word vectors, enabling tasks such as document classification, clustering, and similarity detection by preserving the order and structure of words. The document vectors are compared using cosine similarity/distance to determine the most similar working papers. Papers identified with 🔥 are in the top 20% of similarity.

The 10 most similar working papers to the working paper 'Technology-Driven Market Concentration through Idea Allocation' are listed below in order of similarity.