Databricks launches OpenSharing protocol as Linux Foundation project for AI model and data sharing
By
Frederic Lardinois
Pure flour-power. Hearty enough to carry you through lunch.
Summary
Databricks launched OpenSharing, the successor to its open-source Delta Sharing protocol, now a standalone Linux Foundation project. OpenSharing adds support for Apache Iceberg REST Catalog clients and brings on-premises storage vendors (Everpure/Pure Storage, MinIO, Qumulo) into the ecosystem. It extends zero-copy sharing beyond tables to include agent skills, AI models, and unstructured data, aiming to solve the "email me a file" problem for AI agent skills by enabling standardized data sharing across the AI stack.
Key quotes
· 3 pulledOpenSharing is now a standalone Linux Foundation project and extends Delta Sharing's zero-copy sharing beyond tables to include agent skills, AI models, and unstructured data.
Databricks on Wednesday launched OpenSharing, the successor to its open-source Delta Sharing protocol.
This updated protocol adds support for Apache Iceberg REST Catalog clients and brings on-premises storage vendors into the ecosystem, starting with Everpure (previously Pure Storage), MinIO, and Qumulo.
You might also wanna read
Databricks Launches LTAP Architecture Unifying OLAP and OLTP on a Single Data Lake Copy
Databricks has launched LTAP (Lake Transactional/Analytical Processing), a new data architecture that unifies OLAP and OLTP workloads on a s
databricks.com·4h ago
The Role of Apache Iceberg in Modern Data Infrastructure and the Equality Delete Problem
The article discusses the growing significance of Apache Iceberg in the data infrastructure landscape, highlighting major acquisitions by Da
blog.dataengineerthings.org·10mo ago
Snowflake, Databricks, and Azure Ship Postgres-Compatible Databases with Custom Storage Engines
Three major cloud data platforms — Snowflake, Databricks, and Microsoft Azure — have all recently shipped Postgres-compatible databases with
Databricks Secures Series K Funding at $100+ Billion Valuation to Expand AI Products
Databricks, a data and AI company, has signed a term sheet for its Series K funding round that values the company at over $100 billion. The
databricks.com·10mo ago
Databricks Open Sources Dicer Auto-Sharding System for Scalable Services
Databricks announces the open sourcing of Dicer, their auto-sharding system that dynamically manages sharding assignments to enable low late
databricks.com·5mo ago
Performance Benchmark: Polars vs DuckDB vs Daft vs Spark on 650GB Delta Lake Dataset
The article presents a performance comparison benchmark of four data processing frameworks (Polars, DuckDB, Daft, and Spark) on a 650GB Delt
dataengineeringcentral.substack.com·7mo ago