Apache Airflow - A platform to programmatically author, schedule, and monitor workflows
-
Updated
Jun 11, 2024 - Python
Apache Airflow - A platform to programmatically author, schedule, and monitor workflows
Apache DolphinScheduler is the modern data orchestration platform. Agile to create high performance workflow with low-code
AWS Summit 2022 ASEAN --- COM203 Using IaC with Terraform to provision Big Data Platform on Amazon EMR
Production Grade Terraform for Provisioning Infrastructure
Workflow Engine for Kubernetes
Run your dbt Core projects as Apache Airflow DAGs and Task Groups with a few lines of code
A dbt data pipeline capstone project.
ETL pipeline utilizing Apache Airflow, PySpark and ClickHouse
Data Engineering Workbook (Notes, Exercises, Projects, etc...)
Optimus is an easy-to-use, reliable, and performant workflow orchestrator for data transformation, data modeling, pipelines, and data quality management.
This project demonstrates how to build and automate an ETL pipeline written in Python and schedule it using open source Apache Airflow orchestration tool on AWS EC2 instance.
Apply Data Engineering to Personal Finance
Collaborative and hybrid recommendation systems
I²C bus differential pressure sensor with IMU and Magnetometer.
A plugin for Apache Airflow that allows you to edit DAGs in browser
ELTL pipeline to monitor air quality in the Paris Île-de-France area
Add a description, image, and links to the airflow topic page so that developers can more easily learn about it.
To associate your repository with the airflow topic, visit your repo's landing page and select "manage topics."