Databricks Runtime 18: June 10, 2026

Databricks Runtime 18 is now generally available (GA). For lifecycle details, see Databricks Runtime support lifecycles . New features and improvements The following features and improvements are available in this release. Lakeflow Spark Declarative Pipelines streaming query ID : Lakeflow Spark Declarative Pipelines pipelines can now set the streaming query ID on demand. New IP address functions (Public Preview) : New SQL functions are available for working with IPv4 and IPv6 addresses and CIDR blocks, including ip_host , ip_cidr , ip_version , ip_prefix_length , ip_network , ip_network_last , ip_cidr_contains , ip_as_binary , ip_as_string , and try_* variants for null-safe behavior. See ip_host and related functions. On-demand state repartitioning (Public Preview) : Structured Streaming now supports changing the number of shuffle partitions for stateful queries without losing checkpoint state. See On-demand state repartitioning for stateful streaming queries . Apache Spark fixes and improvements This release includes the following bug fixes and improvements made to Spark: Fixed incorrect null handling in LEFT OUTER JOIN LATERAL expressions that contain EXPLODE . Previously, certain inputs produced incorrect null values in results. Photon now defers duplicate field_id errors in Parquet schema resolution until the affected field is accessed. Queries that don't reference the duplicate field now succeed rather than failing at schema resolution time.