Research Projects
The Economics of Advice: Evidence from Startup Mentoring
Files: [Main Paper][Appendices][Supplemental Material]
Forthcoming in Mangement Science
ABSTRACT: Advice is a key input to early firm development, but our understanding of it is limited. Using detailed data from a global entrepreneurship program, I present a series of empirical insights that shed light on the foundations of advice and motivate new hypotheses for entrepreneurship research. Leveraging idiosyncratic variation in mentors' personal schedules that influenced the amount of advice startups received, I find that mentoring has a large and positive effect on future market performance of startups. I then develop a typology of entrepreneurial activity for measuring the nature of advice and codify 7,914 mentoring decisions to analyze the provision of advice by different mentors. I find that the characteristic element of advice is to do less and learn more. While mentors are quite aligned in this message, I find significant differences between angel investors and venture capitalists in the provision of advice. Angels are more likely than VCs to help founders design and execute product market experiments, while VCs provide more support on business analysis and planning tasks. I find evidence consistent with the hypothesis that experimentation is a skill developed via learning-by-doing, and angels have a skill advantage in that domain due to having more operational experience.
Information Frictions and Employee Sorting Between Startups
w/ Kevin Bryan and Mitchell Hoffman
Files: [Main Paper][AEA RCT Registry][Appendices][RCT Screenshots][Supplemental Material]
ABSTRACT: Would workers apply to better firms if they were more informed about firm quality? Collaborating with 26 science-based startups, we create a custom job board and invite business school alumni to apply. The job board randomizes across applicants to show coarse expert ratings of all startups' science and/or business model quality. Making this information visible strongly reallocates applications toward better firms. This reallocation holds even when restricting to high-quality workers. The treatments operate in part by shifting worker beliefs about firms' right-tail outcomes. Despite these benefits, workers make post-treatment bets indicating highly overoptimistic beliefs about startup success, suggesting a problem of broader informational deficits.
How does Industry Affiliation of Academic Scientists Affect the Rate and Direction of Research?
(manuscript ready for conference presentation)
ABSTRACT: The implications of academic collaborations with industry have long been the nexus of contentious debate. The prevailing concern is that industry causes research to lose its fundamental depth and become commercially driven. This paper presents evidence that these concerns are misplaced for areas of research that have commercial value--that is, the specific domains for which these concerns are raised. The empirical analysis uses large-scale, manually improved bibliometric data from artificial intelligence research. For identification, I use the unexpected and significant success of the neural network techniques revealed at the ImageNet 2012 benchmark competition, which sharply increased the industry's demand for AI scientists, but more so for scientists with higher expertise in the breakthrough field. While industry affiliation significantly increases the usefulness of research, it does not diminish its novelty. In addition, industry affiliation raises both the publication and the quality of science produced by academic scientists. Results are consistent with the explanation that, at least in the medium term, academics in short supply can negotiate higher academic freedom while utilizing commercial resources for their research.
Media Mentions: The Economist (Million Dollar Babies and Battle of the Brains)
Learning vs. Doing: The Effect of Business Uncertainty on Entrepreneurial Activities
(preparing manuscript for conference presentations)
ABSTRACT: Over the past decade, public and private startup mentorship programs have proliferated. Yet the empirical investigation of this phenomenon is scant. I examine advice in the context of change in startup activities. Resource-constrained entrepreneurs trade off prioritizing between learning about and evaluating their options versus implementing them. In a setting where mentorship advice regulates this trade-off, I show that, relative to mentors, entrepreneurs under-prioritize simple search and planning activities—a form of entrepreneurial learning that is broadly termed “analysis.” Mentors’ call for more learning through analysis is precisely at the expense of de-emphasizing the implementation of ideas in the short term. I show that this result is driven by mentors’ perceived uncertainty of the startup’s quality, where perceived uncertainty is proxied from mentors’ expectation error dispersion and sentiment variation.
Activity Sequencing in Startups
(preparing manuscript for conference presentations)
ABSTRACT: In this paper, I investigate the sequence of startup activities over time to understand the mechanisms underlying the prioritization of activities in startups. I develop a novel typology of startup activities using a database of 371 early-stage, science-based startups. I show that entrepreneurs, particularly first-time founders, under-prioritize learning. Using Latent Markov Models I show that the sequence of activities in early-stage startups from learning to implementation of ideas and acquisition of resources increases startups’ success in accessing capital.
Other Work in Progress
The Effect of Noisy Learning on Startup Performance, with Joshua Gans, Erin Scott, Scott Stern (data collection and empirical analysis)
Database Development
Database, Methodological Tools, and Research Opportunities: Creative Destruction Lab and Early-Stage Technology Ventures
w/ Evgenia Gatov, Kyle Robinson, Sonia Sennik, Michael Vertolli, Avi Goldfarb
The early stages of startup formation remain one of the least understood aspects of firm development and growth. Decisions made during these formative periods often have irreversible consequences, shaping the trajectory and potential success of new ventures. However, these formative periods are also the most challenging to observe in a systematic way that allows rigorous empirical analysis. In this data collection project, we introduce new data built from Creative Destruction Lab (CDL), a global non-profit mentoring program for early-stage high-technology startups. We believe that the nature of this program and the richness of data we collected from its operations are particularly suited for investigating open questions in the economics and management of advice, entrepreneurial strategy, entrepreneurial finance, and the complex process of technology transfer.
As of 2024, there are 15 research projects that use these data by 18 scholars across Purdue University, University of Toronto, Harvard University, University of Chicago, HEC Montreal, HEC Paris, Dalhousie University, University of British Columbia, University of Calgary, and MIT. The projects that are published so far are:
Amir Sariri; The Economics of Advice: Evidence from Startup Mentoring; Management Science, Forthcoming
Álvaro Parra, Ralph A. Winter; Early-stage venture financing; Journal of Corporate Finance, 2022
Per Davidsson, Denis Gregoire, Maike Lex; Venture Idea Assessment (VIA): Development of a needed concept, measure, and research agenda; Journal of Business Venturing, 2021
This data collection project was a part of my doctoral dissertation research and was tremendously supported by guidance from my advisors Ajay Agrawal, Joshua Gans, and Avi Goldfarb. I also received funding and support from Creative Destruction Lab, the Strategic Innovation Fund of the Federal Government of Canada, and the RBC Royal Bank’s Borealis AI Foundation.
The Rate and Direction of Academic Research in Artificial Intelligence
Ajay Agrawal and I collected data on a decade of conference proceedings of major AI conferences to understand how the state of the labor market for AI scientists and the distribution of scientific productivity has changed since the 2012 ImageNet Competition.
Findings from these data were presented to world leaders from government, industry, and the scientific community at the 2015 Future of Life Institute conference. For an overview on this conference see this Washington Post article.