Pandemic brought us a lot of opportunities to spend time with our loved ones, and also with our home computer. If you are interested in data, and comfortable working in Linux, setting up an infrastructure for big data similar to those used in big tech companies is easier than you think. Follow this tutorial for how to get your toes wet in a home-build data lake and data warehouse.

Photo by Taylor Vick on Unsplash

Overview

MySQL is often used to store structured data, and serve real time traffic (show your facebook profile). This is what we call “online data”. Companies usually take a snapshot of all…

xddd

An engineer working in bay area

Get the Medium app

A button that says 'Download on the App Store', and if clicked it will lead you to the iOS App store
A button that says 'Get it on, Google Play', and if clicked it will lead you to the Google Play store