Projects

• 

  Real-time Stock Tracker Pipeline

  Real-time data streaming pipeline for stock market data using Kafka, Spark, Cassandra. This project showcases the build of an end-to-end containerised data streaming pipeline that is highly scalable using a message queue pattern with Spark.

• 

  Full Stack File Upload Demo

  Full stack file upload portal I built for a company technical challenge. PHP Laravel Vue JS AWS S3 MySQL.

• 

  Job Market Data Aggregator & Predictive ML Models

  The Salary Prediction system was built using a deep neural network trained on over 1 million data points. It utilises deep learning and NLP to produce salary estimation figures that provide important insight to job seekers and job advertisers on the CareerOne website.

• 

  Modern Data Stack Data Warehouse

  Lead data engineer on a greenfield modern stack DWH platform for a leading Australian e-commerce business.