About

Data Engineer | Lisbon, Portugal

Biography

I am an experienced Data Engineer specializing in building scalable data pipelines, optimizing workflows, and driving actionable insights. My expertise spans cloud technologies like AWS (Lambda, S3, Glue, ECS), infrastructure as code with Terraform, and real-time data processing using PySpark and Spark. I thrive in cloud and big data environments, consistently improving efficiency and delivering innovative solutions.

Key Technical Skills

  • Cloud Platforms: AWS (Lambda, S3, Glue, ECS)
  • Infrastructure as Code: Terraform
  • Programming: Python, PySpark, SQL
  • Data Engineering: ETL/ELT, Spark, Real-Time Processing
  • DevOps: Docker, GitHub Actions
  • Data Visualization: Tableau, QuickSight

Professional Experience

Data Engineer & ScrumMaster

Critical Techworks - BMW Group (March 2022 – Present)

  • Enhanced team efficiency and alignment with BMW’s data initiatives.
  • Developed scalable data pipelines in AWS, leveraging Lambda, Glue, and S3.
  • Automated deployments using Terraform, significantly reducing deployment time.

Data Engineer

Critical Techworks - BMW Group (May 2021 – March 2022)

  • Built real-time data ingestion and processing pipelines.
  • Designed a CI/CD pipeline with GitHub Actions for robust testing and deployment.

Data Analyst / Engineer

BNP Paribas (November 2019 – May 2021)

  • Designed ETL/ELT processes for credit risk datasets in HDFS.
  • Analyzed large datasets using PySpark and HiveSQL for regulatory frameworks.
  • Developed interactive dashboards in Tableau to monitor risk metrics.

Software Developer Intern

Celfinet (July 2018 – September 2018)

  • Created an object-oriented Python application for automated testing on iOS/Android, reducing testing time by 20%.

Education

M.Sc. in Electrical and Computer Engineering
Instituto Superior Técnico, Lisbon, Portugal (2014 – 2019)

  • Major: Control and Automation | Minor: Computer Science
  • Thesis: Time Series Analysis Using Restricted Boltzmann Machines and Dynamic Bayesian Networks (Grade: 18/20)

Certifications

  • Professional ScrumMaster I & II – Scrum.org (Sep 2023)
  • Neural Networks and Deep Learning – Coursera (Dec 2022)
  • Azure Data Fundamentals – Microsoft (Apr 2021)
  • Spark and Python for Big Data with PySpark – Udemy (Mar 2021)

Feel free to explore my projects, photography, and blog posts on this site!