Deploy JAR to Azure Databricks from Local Machine

Goal

Deploy a fat JAR file to Azure Databricks DBFS from your local machine using Databricks CLI.

Configure Databricks CLI

Generate a PAT token in Databricks workspace (User Settings), then configure:

databricks configure --token

When prompted, enter your workspace URL:

https://adb-3772194496043630.10.azuredatabricks.net/

Build and Deploy

Build the JAR:

cd [ProjectRoot]
sbt assembly

Push to DBFS (remove existing file first if needed):

dbfs rm dbfs:/lib/jars/Arch.Pocs.Databricks.Application.jar
dbfs cp ./target/scala-2.12/Arch.Pocs.Databricks.Application.jar dbfs:/lib/jars/Arch.Pocs.Databricks.Application.jar