Serverless Data Pipelines with Kestra, Modal, dbt, and BigQuery

Kestra: An open-source orchestration platform for ops automation beyond traditional CI/CD

This article discusses Kestra, an open-source orchestration platform that goes beyond traditional CI/CD pipelines. It highlights how Kestra

How Modal built ultra-low-latency serverless routing with Pingora, Envoy, and Spanner

Modal introduces "Servers" — a new ultra-low-latency primitive for running HTTP, WebSocket, and gRPC workloads on their serverless platform.

Connect Google BigQuery to Dremio Cloud: Cross-Cloud Analytics Without Data Movement

How Mindbox replaced PySpark with YAML-based pipelines using dlt, dbt, and Trino

Data engineer Kiril Kazlou describes how Mindbox replaced PySpark-based data pipelines with a stack using dlt, dbt, and Trino, configured th

Pipelines - Pipelines now supports SQL transformations and Apache Iceberg

Kore: A New High-Performance Columnar File Format for Big Data Analytics

Kore is a new high-performance binary file format for analytical workloads, claiming superior compression (38% vs 63% for Parquet), 131x que