Azure Databricks is fast, easy to use and scalable big data collaboration platform. Based on Apache Spark brings high performance and benefits of spark without need of having high technical knowledge. You just write Python/Scala scripts and you are ready to go.
In this video I will cover basics of Databricks and show common Blob Storage JSON to Blob Storage CSV transformation scenario.
Today we will cover
- Azure Databricks and Databricks platform Overview
- Key Features of Databricks
- Demo of Blob ingestion using Python and Spark SQL script and data visualisation
- Demo of Blob to Blob tranfromation using Scala and Spark SQL
Azure Databricks is a one of those hot topics right now. This introduction is seond in the series of data transformation in Azure. Stay tuned to see more.Source Code