Data science is at the core our ever-connected digital world. The algorithms that power this disciple are increasingly sophisticated with cognitive capabilities.
The AI (Artificial Intelligence) is streamlining each step combining a set of technologies and approaches including Deep Learning, Machine Learning, Computer Vision, to name a few.
Apache Spark in this momentum provides a lot of valuable tools for data science. The release of Apache Spark 1.3.1 Technical Preview as an interesting Data Frame API available on HDP, can help many among you.