Shawn Ng

Shawn Ng

Big Data Engineer

I'm Shawn Ng. I am a Big Data Engineer from Singapore. I am currently working at a PropTech startup. For my day-to-day job, I make sure all data assets and infrastructures runs perfectly. I am condition to shipping data product at neck-breaking speed after working with multiple startups in various industries.

I start this website to keep track of my data and software projects. I realized that writing helps me organized my thoughts. I hope that you find something useful here.

View Projects View Resume

What I do

Here is an overview of my technical skill sets

Data Engineering / Science

Python
Apache (Spark, Airflow)
Database & SQL (PostgreSQL, MySQL, Oracle)
Web Scraping
Machine Learning
Natural Language Processing
Data Visualizations (Tableau, Qlik, D3.js)

Cloud Engineering

AWS (Amazon Web Service)
GCP (Google Cloud Platform)
Linux
Heroku

Backend Engineering

Django
Ruby on Rails
Express.js

Frontend Engineering

Bootstrap
JavaScript
AngularJS

Featured Projects

Asia Pacific Startups Analysis

In this project, I scraped and analyzed Asia Pacific startups. I am interested to identify startups distribution in APAC and outliers.

Published: 2019-06-09

View Case Study

Y Combinator Startups Analysis

In this project, I scraped and analysed 1317 Y Combinator Startups and share my insights.

Published: 2017-10-24

View Case Study

Latest Blog Posts

Windows VS Mac OS VS Linux

My thoughts on operating systems.

Published: 2020-08-05

Data Science Journey

My data science journey.

Published: 2020-07-05

Coronavirus (COVID-19)

My thoughts on Coronavirus.

Published: 2020-05-27