Measuring the Impact of COVID-19 on Businesses and People: Lessons from the Census Bureau's Experience
January 2021
Working Paper Number:
CES-21-02
Abstract
We provide an overview of Census Bureau activities to enhance the consistency, timeliness, and relevance of our data products in response to the COVID-19 pandemic. We highlight new data products designed to provide timely and granular information on the pandemic's impact: the Small Business Pulse Survey, weekly Business Formation Statistics, the Household Pulse Survey, and Community Resilience Estimates. We describe pandemic-related content introduced to existing surveys such as the Annual Business Survey and the Current Population Survey. We discuss adaptations to ensure the continuity and consistency of existing data products such as principal economic indicators and the American Community Survey.
Document Tags and Keywords
Keywords
Keywords are automatically generated using KeyBERT, a powerful and innovative
keyword extraction tool that utilizes BERT embeddings to ensure high-quality and contextually relevant
keywords.
By analyzing the content of working papers, KeyBERT identifies terms and phrases that capture the essence of the
text, highlighting the most significant topics and trends. This approach not only enhances searchability but
provides connections that go beyond potentially domain-specific author-defined keywords.
:
data,
statistical,
quarterly,
survey,
agency,
respondent,
surveys censuses,
policymakers,
insurance,
population,
census years,
enrollment,
census bureau,
household surveys,
health,
home,
hurricane,
public,
pandemic
Tags
Tags are automatically generated using a pretrained language model from spaCy, which excels at
several tasks, including entity tagging.
The model is able to label words and phrases by part-of-speech,
including "organizations." By filtering for frequent words and phrases labeled as "organizations", papers are
identified to contain references to specific institutions, datasets, and other organizations.
:
Metropolitan Statistical Area,
Internal Revenue Service,
Bureau of Labor Statistics,
Social Security Administration,
Service Annual Survey,
Small Business Administration,
Office of Management and Budget,
Bureau of Economic Analysis,
Current Population Survey,
Employer Identification Numbers,
Survey of Income and Program Participation,
Economic Census,
Department of Housing and Urban Development,
American Community Survey,
National Health Interview Survey,
National Center for Health Statistics,
Computer Assisted Personal Interview,
Master Address File,
Census Bureau Disclosure Review Board,
Annual Business Survey,
Business Formation Statistics,
COVID-19
Similar Working Papers
Similarity between working papers are determined by an unsupervised neural
network model
know as Doc2Vec.
Doc2Vec is a model that represents entire documents as fixed-length vectors, allowing for the
capture of semantic meaning in a way that relates to the context of words within the document. The model learns to
associate a unique vector with each document while simultaneously learning word vectors, enabling tasks such as
document classification, clustering, and similarity detection by preserving the order and structure of words. The
document vectors are compared using cosine similarity/distance to determine the most similar working papers.
Papers identified with 🔥 are in the top 20% of similarity.
The 10 most similar working papers to the working paper 'Measuring the Impact of COVID-19 on Businesses and People: Lessons from the Census Bureau's Experience' are listed below in order of similarity.
-
Working PaperMeasuring the Effect of COVID-19 on U.S. Small Businesses: The Small Business Pulse Survey🔥
May 2020
Working Paper Number:
CES-20-16
In response to the novel coronavirus (COVID-19) pandemic, the Census Bureau developed and fielded an entirely new survey intended to measure the effect on small businesses. The Small Business Pulse Survey (SBPS) will run weekly from April 26 to June 27, 2020. Results from the SBPS will be published weekly through a visualization tool with downloadable data. We describe the motivation for SBPS, summarize how the content for the survey was developed, and discuss some of the initial results from the survey. We also describe future plans for the SBPS collections and for our research using the SBPS data. Estimates from the first week of the SBPS indicate large to moderate negative effects of COVID-19 on small businesses, and yet the majority expect to return to usual level of operations within the next six months. Reflecting the Census Bureau's commitment to scientific inquiry and transparency, the micro data from the SBPS will be available to qualified researchers on approved projects in the Federal Statistical Research Data Center network.View Full Paper PDF
-
Working PaperHigh Frequency Business Dynamics in the United States During the COVID-19 Pandemic🔥
March 2021
Working Paper Number:
CES-21-06
Existing small businesses experienced very sharp declines in activity, business sentiment, and expectations early in the pandemic. While there has been some recovery since the early days of the pandemic, small businesses continued to exhibit indicators of negative growth, business sentiment, and expectations through the first week of January 2021. These findings are from a unique high frequency, real time survey of small employer businesses, the Census Bureau's Small Business Pulse Survey (SBPS). Findings from the SBPS show substantial variation across sectors in the outcomes for small businesses. Small businesses in Accommodation and Food Services have been hit especially hard relative to those Finance and Insurance. However, even in Finance and Insurance small businesses exhibit indicators of negative growth, business sentiment, and expectations for all weeks from late April 2020 through the first week of 2021. While existing small businesses have fared poorly, after an initial decline, there has been a surge in new business applications based on the high frequency, real time Business Formation Statistics (BFS). Most of these applications are for likely nonemployers that are out of scope for the SBPS. However, there has also been a surge in new applications for likely employers. The surge in applications has been especially apparent in Retail Trade (and especially Non-store Retailers). We compare and contrast the patterns from these two new high frequency data products that provide novel insights into the distinct patterns of dynamics for existing small businesses relative to new business formations.View Full Paper PDF
-
Working PaperSmall Business Pulse Survey Estimates by Owner Characteristics and Rural/Urban Designation🔥
September 2021
Working Paper Number:
CES-21-24
In response to requests from policymakers for additional context for Small Business Pulse Survey (SBPS) measures of the impact of COVID-19 on small businesses, we researched developing estimates by owner characteristics and rural/urban locations. Leveraging geographic coding on the Business Register, we create estimates of the effect of the pandemic on small businesses by urban and rural designations. A more challenging exercise entails linking micro-level data from the SBPS with ownership data from the Annual Business Survey (ABS) to create estimates of the effect of the pandemic on small businesses by owner race, sex, ethnicity, and veteran status. Given important differences in survey design and concerns about nonresponse bias, we face significant challenges in producing estimates for owner demographics. We discuss our attempts to meet these challenges and provide discussion about caution that must be used in interpreting the results. The estimates produced for this paper are available for download. Reflecting the Census Bureau's commitment to scientific inquiry and transparency, the micro data from the SBPS will be available to qualified researchers on approved projects in the Federal Statistical Research Data Center network.View Full Paper PDF
-
Working PaperThe Annual Survey of Entrepreneurs: An Introduction
November 2015
Working Paper Number:
CES-15-40R
The Census Bureau continually seeks to improve its measures of the U.S. economy as part of its mission. In some cases this means expanding or updating the content of its existing surveys, expanding the use of administrative data, and/or exploring the use of privately collected data. When these options cannot provide the needed data, the Census Bureau may consider fielding a new survey to fill the gap. This paper describes one such new survey, the Annual Survey of Entrepreneurs (ASE). Innovations in content, format, and process are designed to provide high-quality, timely, frequent information on the activities of one of the important drivers of economic growth: entrepreneurship. The ASE is collected through a partnership of the Census Bureau with the Kauffman Foundation and the Minority Business Development Agency. The first wave of the ASE collection started in fall of 2015 (for reference period 2014) and results will be released in summer 2016. Qualified researchers on approved projects will be able to access micro data from the ASE through the Federal Statistical Research Data Center (FSRDC) network.View Full Paper PDF
-
Working PaperNonresponse and Coverage Bias in the Household Pulse Survey: Evidence from Administrative Data
October 2024
Working Paper Number:
CES-24-60
The Household Pulse Survey (HPS) conducted by the U.S. Census Bureau is a unique survey that provided timely data on the effects of the COVID-19 Pandemic on American households and continues to provide data on other emergent social and economic issues. Because the survey has a response rate in the single digits and only has an online response mode, there are concerns about nonresponse and coverage bias. In this paper, we match administrative data from government agencies and third-party data to HPS respondents to examine how representative they are of the U.S. population. For comparison, we create a benchmark of American Community Survey (ACS) respondents and nonrespondents and include the ACS respondents as another point of reference. Overall, we find that the HPS is less representative of the U.S. population than the ACS. However, performance varies across administrative variables, and the existing weighting adjustments appear to greatly improve the representativeness of the HPS. Additionally, we look at household characteristics by their email domain to examine the effects on coverage from limiting email messages in 2023 to addresses from the contact frame with at least 90% deliverability rates, finding no clear change in the representativeness of the HPS afterwards.View Full Paper PDF
-
Working PaperThe Annual Survey of Entrepreneurs: An Update
January 2017
Working Paper Number:
CES-17-46
We provide an update on the Annual Survey of Entrepreneurs (ASE), which is a relatively new Census Bureau business survey. About 290,000 employer firms in the private, non-agricultural U.S. economy are in the ASE sample. Its content is relatively constant over collections, allowing for comparability over time; however, each year there are approximately ten new questions in a changing topical module. Earlier topical modules covered innovation (2014) and management practices (2015). The topical module for reference year 2016 covers business advice and planning, finance, and regulations. The ASE is collected through a partnership of the Census Bureau with the Kauffman Foundation and the Minority Business Development Agency. Qualified researchers on approved projects may request access to the ASE micro data through the Federal Statistical Research Data Center (FSRDC) network.View Full Paper PDF
-
Working PaperIncorporating Administrative Data in Survey Weights for the 2018-2022 Survey of Income and Program Participation
October 2024
Working Paper Number:
CES-24-58
Response rates to the Survey of Income and Program Participation (SIPP) have declined over time, raising the potential for nonresponse bias in survey estimates. A potential solution is to leverage administrative data from government agencies and third-party data providers when constructing survey weights. In this paper, we modify various parts of the SIPP weighting algorithm to incorporate such data. We create these new weights for the 2018 through 2022 SIPP panels and examine how the new weights affect survey estimates. Our results show that before weighting adjustments, SIPP respondents in these panels have higher socioeconomic status than the general population. Existing weighting procedures reduce many of these differences. Comparing SIPP estimates between the production weights and the administrative data-based weights yields changes that are not uniform across the joint income and program participation distribution. Unlike other Census Bureau household surveys, there is no large increase in nonresponse bias in SIPP due to the COVID-19 Pandemic. In summary, the magnitude and sign of nonresponse bias in SIPP is complicated, and the existing weighting procedures may change the sign of nonresponse bias for households with certain incomes and program benefit statuses.View Full Paper PDF
-
Working PaperMeasuring the Electronic Economy: Current Status and Next Steps
June 2000
Working Paper Number:
CES-00-10
The recent growth of consumer retailing over the Internet draws attention to the electronic economy. However, businesses also conduct other business processes over computer networks, and many have been doing so for some time. Uses of computer networks attract attention because of assertions that they lead to new products and services, new delivery methods, streamlined or re-engineered business processes, new business structures, and enhanced business performance. These changes, in turn, potentially affect the performance of the entire economy, including economic growth, productivity, prices, employment, trade, and the structures of businesses, regions, and markets. Evaluating these assertions, and their effects on economic performance, requires solid statistical information about the electronic economy. This paper develops principles for identifying information critical to measuring the size and evaluating the potential effects of the electronic economy, relates that information to current data collection programs, and notes relevant measurement issues. Some of the required information about the electronic economy can be collected by adding questions to existing surveys, making the scope of existing surveys consistent, or developing new surveys. However, many key pieces of information pose significant challenges to economic measurement. While some of those challenges are specific to the electronic economy, others are long-standing ones. Interest in the electronic economy highlights the importance of continuing attempts to address these challenges. Improving and enhancing the statistical system to provide information about the electronic economy, therefore, would also substantially improve the baseline information available for evaluating the performance of the entire economy.View Full Paper PDF
-
Working PaperIncorporating Administrative Data in Survey Weights for the Basic Monthly Current Population Survey
January 2024
Working Paper Number:
CES-24-02
Response rates to the Current Population Survey (CPS) have declined over time, raising the potential for nonresponse bias in key population statistics. A potential solution is to leverage administrative data from government agencies and third-party data providers when constructing survey weights. In this paper, we take two approaches. First, we use administrative data to build a non-parametric nonresponse adjustment step while leaving the calibration to population estimates unchanged. Second, we use administratively linked data in the calibration process, matching income data from the Internal Return Service and state agencies, demographic data from the Social Security Administration and the decennial census, and industry data from the Census Bureau's Business Register to both responding and nonresponding households. We use the matched data in the household nonresponse adjustment of the CPS weighting algorithm, which changes the weights of respondents to account for differential nonresponse rates among subpopulations. After running the experimental weighting algorithm, we compare estimates of the unemployment rate and labor force participation rate between the experimental weights and the production weights. Before March 2020, estimates of the labor force participation rates using the experimental weights are 0.2 percentage points higher than the original estimates, with minimal effect on unemployment rate. After March 2020, the new labor force participation rates are similar, but the unemployment rate is about 0.2 percentage points higher in some months during the height of COVID-related interviewing restrictions. These results are suggestive that if there is any nonresponse bias present in the CPS, the magnitude is comparable to the typical margin of error of the unemployment rate estimate. Additionally, the results are overall similar across demographic groups and states, as well as using alternative weighting methodology. Finally, we discuss how our estimates compare to those from earlier papers that calculate estimates of bias in key CPS labor force statistics. This paper is for research purposes only. No changes to production are being implemented at this time.View Full Paper PDF
-
Working PaperSome Open Questions on Multiple-Source Extensions of Adaptive-Survey Design Concepts and Methods
February 2023
Working Paper Number:
CES-23-03
Adaptive survey design is a framework for making data-driven decisions about survey data collection operations. This paper discusses open questions related to the extension of adaptive principles and capabilities when capturing data from multiple data sources. Here, the concept of 'design' encompasses the focused allocation of resources required for the production of high-quality statistical information in a sustainable and cost-effective way. This conceptual framework leads to a discussion of six groups of issues including: (i) the goals for improvement through adaptation; (ii) the design features that are available for adaptation; (iii) the auxiliary data that may be available for informing adaptation; (iv) the decision rules that could guide adaptation; (v) the necessary systems to operationalize adaptation; and (vi) the quality, cost, and risk profiles of the proposed adaptations (and how to evaluate them). A multiple data source environment creates significant opportunities, but also introduces complexities that are a challenge in the production of high-quality statistical information.View Full Paper PDF
