DataOps Consultant and Azure Wizard.
In ♥ with Kubernetes, Golang, Scala, Spark, CyberSec, and also Graphic Design.
This article is about a new project I started to work on lately. Please welcome Azure Databricks SDK Python. As it’s shining through the name 🦄, It is a high-quality Python SDK for Azure Databricks REST API 2.0.
This article will present the project, the current progress, release plan, some design choices, and at final dev process/tools.
If you ever need to access the Azure Databricks API, you will wonder about the best way to authenticate. Depending on the use-case, there are two ways to access the API: through personal access tokens or Azure AD tokens. Besides, there are also two methods for generating Azure AD tokens, either by impersonating a user or via a service principal. So which way to choose?
This article will give you insight on which method to choose for your use-case and also give you a fast track to implementing SP based auth (backed by links to Microsoft docs for further details).