Databricks CI/CD: Intro to Databricks Asset Bundles (DABs)
Databricks Asset Bundles provide a way to use the command line to deploy and run a set of Databricks assets - like notebooks, Python code, Delta Live Tables pipelines, and workflows. This is useful both for running jobs that are being developed locally and for automating CI/CD processes that will deploy and test code changes. In this video I explain why Databricks Asset Bundles are a good option for CI/CD and demo how to initialize a project and setup your first GitHub Action using DABs.
Blog post with extra examples: https://dustinvannoy.com/2023/10/03/d...
All thoughts and opinions are my own *
References:
Datakickstart DABs repo: https://github.com/datakickstart/data...
Data & AI Summit Presentation: https://www.databricks.com/dataaisumm...
Data & AI Summit Repo: https://github.com/databricks/databri...
DABs Advanced Examples: • Databricks Asset Bundles: Advanced Ex...
More from Dustin:
Website: https://dustinvannoy.com
LinkedIn: / dustinvannoy
Github: https://github.com/datakickstart
CHAPTERS
00:00 Intro
02:10 Why use Asset Bundles?
5:45 Get started with Bundle Init
10:58 GitHub Action deploy and run
19:09 Outro
