We recently replaced an old Kubernetes cluster in Azure AKS with a new set of notebook jobs in Azure Databricks. Overall the migration was a success but we definitely had to live through some growing pains. Databricks is a for profit company founded by the creators of Apache Spark. They offer a distributed compute platform … Avoid join() in Azure Databricks, save $$$$ Read More »
