Author: Felix Wagner
-
From Airflow to API: Data Orchestration with Flask and PostgreSQL
—
by
1. Project Overview Data is the lifeblood of modern decision-making. In my previous project, I built an ETL-pipeline using Airflow, PostgreSQL, Redis, and Docker. Now, I’ve taken it one step further by adding a REST API built with Flask. This new layer not only provides on-demand data access but also enriches the existing pipeline by…
-
ETL – Pipeline Project
—
by
1. Project Overview Objective: Create an expandable framework for an ETL (Extract, Transform, Load) pipeline, which can be leveraged for future projects. Outcome: Built a framework using Docker and Apache Airflow to extract, transform, and load data. The pipeline sends data to an Amazon Web Service (AWS) database, which powers a website that displays continuously…