This paper attempts to quantify the difference in performance, of 'treated' (program participant) and 'non-treated' (non-participant) firms in SBA's Scale-Up initiative. I combine data from the SBA with administrative data housed at Census using a combination of numeric and name and address matching techniques. My results show that after controlling for available observable characteristics, a positive correlation exists between participation in the Scale-Up initiative and firm growth. However, publicly available survey results have shown that entrepreneurs have a variety of goals in-mind when they start their businesses. Two prominent, and potentially contradictory ones are work-life balance and greater income. That means that not all firms may want to grow and I am unable to completely control for owner motivations. Finally, I do not find a statistically significant relationship between participation in Scale-Up and firm survival once other business characteristics are accounted for.
-
Statistics on the International Trade Administration's Global Markets Program
September 2015
Working Paper Number:
CES-15-17
Recent mandates for evidence-based policy choices from both the Executive and Legislative branches of the federal government underscore the importance of understanding the relationship between program participation and business outcomes. In this paper, we examine the correlations between participation in an export-promotion program and business outcomes. We use this experience to provide more general lessons learned about combining program data on treatments with Census Bureau micro data that can be used as a control. Note this paper does not evaluate a program, but instead provides critical information about a program.
The mission of the Commercial Service/Global Markets program is to help companies either start or increase their exports of goods and services. It pursues this mission through advocacy, events, and counseling. This study looks at a very small part of the overall program. While we cannot rule-out several sources of bias in our results, we do observe several consistent patterns across our models. In particular, program participation is positively correlated with export growth and change and, for small businesses, also with positive employment growth. However, overall, and for large firms in particular, there is a negative correlation with employment growth and counseling. The paper concludes with a 'Lessons Learned' section that highlights areas where measurement can be improved.
View Full
Paper PDF
-
Job Creation, Small vs. Large vs. Young, and the SBA
September 2015
Working Paper Number:
CES-15-24
Analyzing a list of all Small Business Administration (SBA) loans in 1991 to 2009 linked with annual information on all U.S. employers from 1976 to 2012, we apply detailed matching and regression methods to estimate the variation in SBA loan effects on job creation and firm survival across firm age and size groups. The estimated number of jobs created per million dollars of loans within the small business sector generally increases with size and decreases in age. The results suggest that the growth of small, mature firms is least financially constrained, and that faster growing firms experience the greatest financial constraints to growth. The estimated association between survival and loan amount is larger for younger and smaller firms facing the 'valley of death.'
View Full
Paper PDF
-
Do SBA Loans Create Jobs? Estimates from Universal Panel Data and Longitudinal Matching Methods
September 2012
Working Paper Number:
CES-12-27
This pape reports estimates of the effects of the Small Business Administration (SBA) 7(a) and 504 loan programs on employment. The database links a complete list of all SBA loans in these programs to universal data on all employers in the U.S. economy from 1976 to 2010. Our method is to estimate firm fixed effect regressions using matched control groups for the SBA loan recipients we have constructed by matching exactly on firm age, industry, year, and pre-loan size, plus kernel-based matching on propensity scores estimated as a function of four years of employment history and other variables. The results imply positive average effects on loan recipient employment of about 25 percent or 3 jobs at the mean. Including loan amount, we find little or no impact of loan receipt per se, but an increase of about 5.4 jobs for each million dollars of loans. When focusing on loan recipients and control firms located in high-growth counties (average growth of 22 percent), places where most small firms should have excellent growth potential, we find similar effects, implying that the estimates are not driven by differential demand conditions across firms. Results are also similar regardless of distance of control from recipient firms, suggesting only a very small role for displacement effects. In all these cases, the results pass a "pre-program" specification test, where controls and treated firms look similar in the pre-loan period. Other specifications, such as those using only matching or only regression imply somewhat higher effects, but they fail the pre-program test.
View Full
Paper PDF
-
Past Experience and Future Success: New Evidence on Owner Characteristics and Firm Performance
September 2010
Working Paper Number:
CES-10-24
Because the ability of entrepreneurs to start their own businesses is key to the success of the U.S. economy and to the economic mobility of many disadvantaged demographic groups, understanding why entrepreneurship activity varies across groups and geography is an increasingly important issue. As a step in this direction we employ a novel set of metrics of business success to the growing literature and find great variation across groups and metrics. For example, we find that black-owned firms grow slower than white or Asian-owned firms. However, once we condition on firm survival, the differences disappear. Interestingly, we also find differences across groups in their start-up histories. For example, Asian-owned firms are less likely than white-owned firms to have started-out as nonemployers but firms owned by all other minority groups, as well as women-owned firms, are more likely to start-out without employees.
View Full
Paper PDF
-
Evaluating the Impact of MEP Services on Establishment Performance: A Preliminary Empirical Investigation
July 2012
Working Paper Number:
CES-12-15
This work examines the impact of manufacturing extension services on establishment productivity. It builds on an earlier study conducted by Jarmin in the 1990s, by matching the Census of Manufacturers (CMF) with the Manufacturing Extension Partnership (MEP) customer and activity datasets to generate treatment and comparison groups for analysis. The scope of the study is the period 1997 to 2002, which was a period of economic downturn in the manufacturing sector and budgetary challenges for the MEP. The paper presents some preliminary findings from this analysis. Both lagged dependent variable (LDV) and difference in difference (DiD) models are employed to estimate the relationship between manufacturing extension and labor productivity. The results presented are inconclusive and paint a mixed picture as they demonstrate the benefits and limitations of using Census microdata in program evaluation. They also point to the need to conduct analyses that could help to better understand the dynamic impact of MEP services.
View Full
Paper PDF
-
Measuring the Impact of the Manufacturing Extension Partnership
September 1996
Working Paper Number:
CES-96-08
In this paper, I measure the impact of the Manufacturing Extension Partnership (MEP) on productivity and sales growth at manufacturing plants. To do this, I match MEP client data to the Census Bureau's Longitudinal Research Database (LRD). The LRD contains data for all manufacturing establishments in the U.S. and provides a number of measures of plant performance and characteristics that are measured consistently across plants and time. This facilitates valid comparisons between both client and non-client plants and among clients served by different MEP centers. The National Institute of Standards and Technology (NIST) administers the MEP as part of their effort to improve the competitiveness of U.S. manufacturing. The program provides business and technical assistance to small and medium sized manufacturers much as agricultural extension does for farmers. The goal of the paper is to see if measures of plant performance (e.g., productivity and sales growth) are systematically related to participation in the MEP, while controlling for other factors that are known or thought to influence performance. Selection bias is often a problem in evaluation studies so I specify an econometric model that controls for selection. I estimate the model with data from 8 manufacturing extension centers in 2 states. The control group includes all plants from each state in the LRD. Preliminary results indicate that MEP participation is systematically related to productivity growth but not to sales growth.
View Full
Paper PDF
-
Evaluating the Long-Term Effect of NIST MEP Services on Establishment Performance
March 2015
Working Paper Number:
CES-15-09
This work examines the effects of receipt of business assistance services from the Manufacturing Extension Partnership (MEP) on manufacturing establishment performance. Several measures of performance are considered: (1) change in value-added per employee (a measure of productivity); (2) change in sales per worker; (3) change in employment; and (4) establishment survival. To analyze these relationships, we merged program records from the MEP's client and project information files with administrative records from the Census of Manufacturers and other Census databases over the periods 1997'2002 and 2002'2007 to compare the outcomes and performance of 'served' and 'unserved' manufacturing establishments. The approach builds on, updates, and expands upon earlier studies comparing matched MEP client and non-client performance over time periods ending in 1992 and 2002. Our results generally indicate that MEP services had positive and significant impacts on establishment productivity and sales per worker for the 2002'2007 period with some exceptions based on employment size, industry, and type of service provided. MEP services also increased the probability of establishment survival for the 1997'2007 period. Regardless of econometric model specification, MEP clients with 1'19 employees have statistically significant and higher levels of labor productivity growth. We also observed significant productivity differences associated with MEP services by broad sector, with higher impacts over the 2002'2007 time period in the durable goods manufacturing sector. The study further finds that establishments receiving MEP assistance are more likely to survive than those that do not receive MEP assistance. Detailed findings of the study, as well as caveats and limitations, are discussed in the paper.
View Full
Paper PDF
-
Using Matched Client And Census Data To Evaluate The Performance Of The Manufacturing Extension Partnership
April 1995
Working Paper Number:
CES-95-07
This paper proposes a framework for evaluating the Manufacturing Extension Partnership (MEP). The MEP is administered by the National Institute of Standards and Technology (NIST) as part of its effort to improve the global competitiveness of U.S. manufacturing industries. As the name implies, the MEP is modelled after agricultural extension. Rather than farmers the MEP's target population is small and medium sized manufacturers, generally those with less than 500 employees. The MEP currently supports 44 manufacturing extension centers around the country. These centers provide technical and business assistance for manufacturers much as county extension agents do for farmers. The goal of evaluation is to see if MEP engagements lead to positive outcomes from the view of important MEP stakeholders (e.g., MEP clients, MEP centers, NIST, state and local governments and Congress). These outcomes are discussed in McGuckin and Redman (1995) and include: Process Outcomes (e.g., adoption of a new technology by a client); Intermediate Outcomes (e.g., reduction in the clients defect rate); Business Outcomes (e.g., survival and profits) and Policy Outcomes (increases in employment,wages and/or exports). The evaluation framework described in this paper has two components. The first component is an evaluation dataset which contains measures of many of the program outcomes listed above for both MEP clients and a representative control group of non- clients. This dataset will be constructed by linking MEP client records with plant level Census data housed at the Center for Economic Studies of the Census Bureau. The Census data provides measures of several outcome and control variables which are comparable across both plants and time. The Census data include observations for all manufacturing plants in the U.S. from which representative control groups can be constructed. The MEP client records provide data on the type and intensity of extension engagements. Linking these rich sources of information yields a comprehensive and powerful dataset for MEP evaluation. The second component is an evaluation methodology which exploits this rich dataset to make statistical inferences about the impact of MEP services, while carefully controlling for other influences. By using this methodology, we can address many of the shortcomings which plagued previous attempts to evaluate extension services. In addition to evaluation, the dataset described in this paper may be used to profile the characteristics of MEP clients and compare them to non-clients. The Census data contain the complete universe of manufacturing establishments in the U.S.
View Full
Paper PDF
-
Taking the Leap: The Determinants of Entrepreneurs Hiring their First Employee
January 2016
Working Paper Number:
CES-16-48
Job creation is one of the most important aspects of entrepreneurship, but we know relatively little about the hiring patterns and decisions of startups. Longitudinal data from the Integrated Longitudinal Business Database (iLBD), Kauffman Firm Survey (KFS), and the Growing America through Entrepreneurship (GATE) experiment are used to provide some of the first evidence in the literature on the determinants of taking the leap from a non-employer to employer firm among startups. Several interesting patterns emerge regarding the dynamics of non-employer startups hiring their first employee. Hiring rates among the universe of non-employer startups are very low, but increase when the population of non-employers is focused on more growth-oriented businesses such as incorporated and EIN businesses. If non-employer startups hire, the bulk of hiring occurs in the first few years of existence. After this point in time relatively few non-employer startups hire an employee. Focusing on more growth- and employment-oriented startups in the KFS, we find that Asian-owned and Hispanic-owned startups have higher rates of hiring their first employee than white-owned startups. Female-owned startups are roughly 10 percentage points less likely to hire their first employee by the first, second and seventh years after startup. The education level of the owner, however, is not found to be associated with the probability of hiring an employee. Among business characteristics, we find evidence that business assets and intellectual property are associated with hiring the first employee. Using data from the largest random experiment providing entrepreneurship training in the United States ever conducted, we do not find evidence that entrepreneurship training increases the likelihood that non-employers hire their first employee.
View Full
Paper PDF
-
GOVERNMENT TECHNICAL ASSISTANCE PROGRAMS* AND PLANT SURVIVAL: THE ROLE OF PLANT OWNERSHIP TYPE
February 1999
Working Paper Number:
CES-99-02
This paper compares the survival rates of plants participating in manufacturing extension programs to nonparticipating plants. Participating plants receive technical and business assistance from one of a nationwide network of extension centers intended to assist smaller manufacturers. Results suggest that plant survival is related to plant size, age, productivity, capital intensity and ownership type. Importantly, the impact of extension services differs across ownership types. Participating in extension increases the probability of survival for single unit plants, but not for multi units. This result is consistent with the notion that single unit plants have less access to information on new technologies and would, therefore, benefit more from technical assistance programs such as manufacturing extension.
View Full
Paper PDF