Highlight

Data Lake Storage Gen 2 is the best storage solution for big data analytics in Azure. With its Hadoop compatible access, it is a perfect fit for existing platforms like Databricks, Cloudera, Hortonworks, Hadoop, HDInsight and many more. Take advantage of both blob storage and data lake in one service!

Intro

In this episode I give you introduction to what Azure Data Lake Storage is, how it works and how can you leverage it in your big data workloads. I will also explain the differences between Blob and ADLS.

Agenda

In a short demo I will show you

  • What is Data Lake Storage and how it works and why is it called Gen2?
  • What does it mean being designed for big data analytical workloads?
  • How does multi-protocol access work?
  • What are key differences between ADLS and Blob Storage?
  • Quick demo of creating ADLS in portal
  • Quick demo of connecting from Power BI and using multi-protocol access
  • How to use storage explorer with ADLS
  • How do Access Control Lists work and how to manage them
  • Demo with Databricks and ADLS

Sample code from demo: https://pastebin.com/ee7ULpwx

Video

Next steps for you after watching the video

  1. Azure Data Lake Storage documentation
  2. https://docs.microsoft.com/en-us/azure/storage/blobs/data-lake-storage-introduction
  3. Transform data using Databricks and ADLS demo tutorial
  4. https://docs.microsoft.com/en-us/azure/azure-databricks/databricks-extract-load-sql-data-warehouse
  5. More on multi-protocol access
  6. https://docs.microsoft.com/en-us/azure/storage/blobs/data-lake-storage-multi-protocol-access
  7. Read more on ACL
  8. https://docs.microsoft.com/en-us/azure/storage/blobs/data-lake-storage-access-control

Adam Marczak

Programmer, architect, trainer, blogger, evangelist are just few of many titles. What I really am, is just passionate technology enthusiast. I take great pleasure in learning new technologies and finding ways it can aid people every day. My latest passion is running Azure 4 Everyone YouTube channel where I show that Azure is really for everyone!

Did you enjoy the article?

Share it!

More tagged posts