R2 - R2 Data Catalog now supports compaction
9mo ago
Source
CloudflareR2 - R2 Data Catalog now supports compactioncloudflare.comYou can now enable automatic compaction for Apache Iceberg tables in R2 Data Catalog to improve query performance. Compaction is the process of taking a group of small files and combining them into fewer larger files. This is an important maintenance operation as it helps ensure that query performance remains consistent by reducing the number of files that needs to be scanned. To enable automatic compaction in R2 Data Catalog, find it under R2 Data Catalog in your R2 bucket settings in the dashboard. Or with Wrangler , run: npx wrangler r2 bucket catalog compaction enable --target-size 128 --token To get started with compaction, check out manage catalogs . For best practices and limitations, refer to about compaction .
You might also wanna read
Key Enhancements in Apache Iceberg V3 for Data Lake Efficiency
The article discusses the new features in Apache Iceberg V3, focusing on improvements like more efficient row-level transactions with deleti
opensource.googleblog.com·10mo ago
Cloudflare Launches Fully-Managed Data Platform for Analytical Data on Global Infrastructure
Cloudflare announced the Cloudflare Data Platform, a fully-managed suite of products for ingesting, storing, and querying analytical data. B
blog.cloudflare.com·9mo ago
The Role of Apache Iceberg in Modern Data Infrastructure and the Equality Delete Problem
The article discusses the growing significance of Apache Iceberg in the data infrastructure landscape, highlighting major acquisitions by Da
blog.dataengineerthings.org·10mo ago
Critique of the Iceberg Specification for Data Lake Metadata
The article critiques the Iceberg specification, arguing it fails to effectively address the metadata challenges of large Data Lakes. The au
database-doctor.com·11mo ago
RX: Embedded Data Store for JSON with In-Place Querying and Automatic Deduplication
RX is an embedded data store for JSON-shaped data that enables querying encoded documents in place without parsing. It functions as a 'no-SQ
github.com·3mo agoVersion 18.2
Microsoft·1mo ago
Comments
Sign in to join the conversation.
No comments yet. Be the first.