Real-time ETL: MongoDB → BigQuery
Python multiprocessing pipeline with automatic schema detection from the MongoDB OpLog, containerised for deployment.
Projects
A selection of professional and academic work across data engineering, scientific computing and machine learning.
Work projects
Cloud microservices for real-time ETL
FastAPI back-end integrated with the data warehouse, built on a modular worker architecture.
Academic projects
Oxygen exchange in cardiac muscle
Finite-element modelling in C++, with simulations run on an HPC cluster.
Topology optimization of lattice materials
Optimal control and inverse homogenization techniques implemented in FreeFem++.
Myelodysplastic syndrome — data analysis
Survival analysis and neural networks; ranked in the top 5 of 33 groups.
Face-mask classification CNN
Transfer learning and ensemble methods, reaching 95% test accuracy (top 20% of the leaderboard).