Hi there, I'm Shafiq 👋
With almost 4 of experience as a data engineer, I have honed my skills in designing, constructing, and managing robust data pipelines and infrastructure. My expertise caters to a wide range of analytical and business intelligence requirements. Proficient in various technologies and tools, including SQL, Python, ETL frameworks, and big data technologies like Hadoop and Spark, I ensure efficient and effective data processing.
To showcase my proficiency in data engineering, my GitHub account houses a diverse collection of projects and code samples. These projects not only highlight my ability to extract, transform, and load data from multiple sources but also exemplify my expertise in data modeling, visualization, and reporting.
Committed to continuous learning and personal growth, I am eager to collaborate with other professionals in the field. I warmly invite you to connect with me on GitHub, where we can explore my work, exchange ideas, and share knowledge.
Let's connect and make meaningful contributions together!
- My old projects
- Machine Learning
- Data Engineering
- Kubernetes
Nifi | Airflow | Postgres | SQL | Python | Google Cloud : Bigquery & Instances | AWS : S3, Redshift & EC2 | Hadoop | Streamlit | Pandas | Kafka | Spark | Shell | Terraform | Docker | Selenium Scrapper | dbt | | No SQL : Mongo Db | Data Modelling | Data Integration | Data Governance : Open MetaData | Zookeeper | API | Git source control | Data Warehouse | Data Lake