The Ongoing Role of Machine Learning Engineers and Data Scientists in Industry's Lucas Critique
A Theory of Growing Demand for Causal Inference in Industry
Introduction
The demand for “data workers” has expanded dramatically in recent years. Machine learning engineers, for instance, were the fourth fastest growing job over the last five years according to a report by Linkedin. Data science continues its own steady march of growth as well. But while ML engineering and data science are distinct, they overlap to varying degrees around the core problems of leveraging insights out of datasets through programming and usually statistical modeling. That these jobs are handsomely rewarded with total compensation packages among the highest in the country which is both a reflection of their perceived importance but also a sign that we will continue to see students flow into programs that train them.
There are now several roads into these types of data work, including graduate training in computer science, mathematics, statistics, data science, economics and other quantitative social sciences, as well as some of the physical sciences like physics …
Keep reading with a 7-day free trial
Subscribe to Scott's Substack to keep reading this post and get 7 days of free access to the full post archives.