Pinned Loading

1. api-development api-development Public

   Api development practice using Fast Api, Postgres

   Python

2. data_pipeline data_pipeline Public

   A repo for pulling data from different sources using Apache Spark written in Scala and Python. Apache Airflow is used to schedule the task on Google DataProc

   Python

3. elt-pipeline elt-pipeline Public

   This is a repository for an elt pipeline. Data is moved from a postgres database to s3 and from s3 to redshift.

   Python

4. realtime-pipeline realtime-pipeline Public

   This is a repository for a realtime analytics pipeline using Clickhouse, Kafka, Spark and Superset

   Python