In 2015, we asked KDnuggets readers “When will most expert-level Data Science/Machine Learning tasks – currently done by human Data Scientists – be automated?”.
51% of respondents in 2015 poll expected this to happen in 10 years or less.
We asked the same question in the last KDnuggets poll (Feb-Mar 2020), and based on the results from 636 participants, this future is still 5-10 years away.
Fig.
1: When will most expert-level Data Science/Machine Learning tasks – currently done by human Data Scientists – be automated?58% of readers expect this to happen in 10 years or less, and the median answer is about 8-9 years.
We also asked KDnuggets readers how many projects they have done:We compared the predictions of “When DS/ML tasks will be automated” from those who had zero AutoML projects with those who have done at least one – see Fig.
2a.
Fig.
2a: “When will most expert-level Data Science/Machine Learning tasks be automated?”, comparing No AutoML projects with one or more AutoML projects.
We note that, overall, the curves for no AutoML (black) and one or more AutoML (red) are quite similar.
If we look at differences, the people with AutoML experience are more positive about AutoML abilities, and 36% of them predict that AutoML will reach expert level in less than 5 years (vs 30% for people with no AutoML experience).
44% of people with AutoML experience think it will take 5 or more years for AutoML to reach expert level, vs 49% of people with no AutoML experience.
Interestingly, a little higher percentage (19.
1% vs 17.
6%) of people with AutoML experience think that AutoML will NEVER reach human expert level.
These differences are even more pronounced if we compare people with zero AutoML project experience vs those with 2 or more AutoML projects (Fig.
2b).
Fig.
2b: “When will most expert-level Data Science/Machine Learning tasks be automated?”, comparing people with No (zero) AutoML projects and those with 2+ AutoML projectsFull data is in Table 1.
Table 1.
When will most expert-level Data Science/Machine Learning tasks be automated?” vs “Number of AutoML projects”We also asked an open-response question: “Which AutoML tools have you used”, and there were about 100 different answers given.
Of course, there were lots spelling variations, especially for H2O, but the top 10 most frequent answers are below.
We also asked respondents their employment type, and the breakdown wasComparing predictions from Industry vs next 2 largest groups Students and Academia/Govt, we see similar curves.
Some notable differences is that larger fraction of students (14%) think that AutoML has already reached expert level, and a lot fewer students think that AutoML will never reach expert level.
Fig.
3: “When will most expert-level Data Science/Machine Learning tasks be automated?”, comparing predictions from Industry, Students, and Academia/Govt.
Finally, the regional breakdown wasWe plotted the predictions for the three largest regions – see Fig.
5.
Fig.
4: “When will most expert-level Data Science/Machine Learning tasks be automated?”, comparing predictions from US/Canada, Europe, and Asia.
We note that Europe and US/Canada have very similar prediction curves, while Asian responders are more optimistic about AutoML capabilities.
More of them (14%) think AutoML has already reached expert level, and fewer (9%) think it will never reach them.
73% of Asian responders think AutoML will reach expert level in 10 years, vs 57% of European responders and 53% of US/Canada responders.
Related: var disqus_shortname = kdnuggets; (function() { var dsq = document.
createElement(script); dsq.
type = text/javascript; dsq.
async = true; dsq.
src = https://kdnuggets.
disqus.
com/embed.
js; (document.
getElementsByTagName(head)[0] || document.
getElementsByTagName(body)[0]).
appendChild(dsq); })();.