An approach to automating most of the rest of the process of big-data analysis
From a system that automated a
crucial step in big-data analysis (the selection of aspects of the data that are useful for making predictions),
presented last year, to this week, in a pair of papers at the IEEE
International Conference on Data Science and Advanced Analytics, the MIT
researchers described an approach to
automating most of the rest of the process of big-data analysis: the
preparation of the data for analysis and even the specification of problems
that the analysis might be able to solve.
In fact, the researchers believe that, again, their systems could perform
in days, tasks that used to take data scientists months.
I can observe that, the stakes focus
on interesting stuff to the data scientists, time-varying data, observations made over time, the ability to produce
a probabilistic model that will predict future events on the basis of current
observations.