Databricks Runtime 19 (Beta): June 26, 2026

Behavioral changes Environment variable availability restricted in standard access mode : In standard access mode , only a predefined set of environment variables is available to the Spark engine and init scripts. This set includes common configuration variables, such as proxy settings ( HTTP_PROXY ), cloud credentials ( AWS_ACCESS_KEY_ID , AZURE_CLIENT_ID ), and catalog variables ( CATALOG ). Other variables that you set on a cluster remain available to your user code, including UDFs, but are not available to the Spark engine or init scripts. Previously, all cluster environment variables were available to the Spark engine and init scripts. See Environment variable limitations . Restricted Spark configurations in standard access mode : In standard access mode , you can no longer set certain Spark configuration properties. Creating or editing a cluster that sets a restricted property (matched by prefix) fails with an error. Restricted properties include spark.driver.extraJavaOptions , spark.executor.extraJavaOptions , spark.jars , spark.files , spark.executorEnv.* , and spark.kubernetes.* , among others. Previously, you could set these properties in standard access mode. Remove them from your cluster configuration before upgrading. For the complete list, see Spark configuration limitations .