Using the Terraform Databricks provider within Azure Databricks Workspace
We have moved our infrastructure to the Azure cloud, as mentioned in previous posts . With this move, we also started the practice of infrastructure as code. Our preferred method of deploying our infrastructure is using Terraform. Recently I updated our Terraform code to use the Terraform Databrick provider to automate the creation of the clusters and not just the Azure Databrick Workspace. This post covers some of my lessons learned while deploying our Databricks solution with Terraform. Configuring the Databricks provider When running the apply action of our terraform code, the first problem was trying to configure the Databricks provider and start the deployment of the cluster resource before Azure Databrick Workspace was fully operational. Even with the implied and explicitly dependence on the azurerm_databricks_workspace resource. My method to resolve this early start off configuring Databricks provider objects was to use the data.azurerm_databricks_workspace object. Unfortu