Data Engineering Bootcamp

Projects I made at Istanbul Data Science Academy

Education Curriculum Overview

Part 1 | 3 Weeks

• Linux ✅
• Bash Shell ✅
• Docker ✅
• Scala

Part 2 | 2 Weeks

• SQL ✅
• Analytical SQL (on Oracle and Postgredb) ✅
• Data Lake ✅
• DWH ✅

Part 3 | 3 Weeks

• NoSQL ✅
• Cassandra
• MongoDB ✅
• Druid
• Redis ✅
• Elastic Search ✅
• Superset

Project: Writing API with Spring boot

Part 4 | 4 Weeks

• Google Cloud Data Engineering
• BigQuery ✅
• CloudSQL
• Running Spark Job Dataproc ✅
• Cloud Composer
• AirFlow ✅
• Pub/Sub
• Data Flow pipeline (Python, Java)
• Beam
• Stream Analytics Dashboard
• ML pipelines on KubeFlow
• Architecting with Google Kubernetes Engine
• CI/CD

Chapter 5 | 4 Weeks

• Big Data, HDFS, Yarn, Sqoop
• Khiva, Presto
• Nifi ✅
• Kafka
• Spark, Spark RDD , Spark SQL
• Spark Streaming ✅

3 Big Projects

• API project ✅
• Kubernetes Deploy End to End
• Spark Streaming End To End