Artie

Artie Transfer provides real‑time replication between transactional (OLTP) databases and analytical (OLAP) warehouses or data lakes using change data capture and stream processing. By continuously reading database changes, it delivers sub‑minute latency, keeping downstream stores up‑to‑date without the batch windows typical of ETL pipelines.

The tool is configured through a single file that defines source and destination endpoints; it automatically detects schemas, creates tables, and merges schema changes. Built‑in retries and idempotent processing ensure reliability, while telemetry and error reporting give visibility into replication health. It scales from a few gigabytes to hundreds of terabytes and supports a range of sources (e.g., MySQL, PostgreSQL, MongoDB, Oracle, DynamoDB) and destinations (e.g., BigQuery, Snowflake, Redshift, S3, ClickHouse).

Artie Transfer is written in Go, distributed as compiled binaries and Docker images, and released under the Apache 2.0 license. It targets developers and data engineers who need low‑latency, low‑cost data pipelines without managing complex scheduler‑based workflows.