Echo Kanak
Echo Kanak
This blog is a work in progress ⌛🛠️ where I keep track of things that I learn whether it be from books or tech of any kind.
.gitkeep
Quick notes on Git from basics to concepts like rebase, cherrypicking and stashing
Databricks notes
A rough collection of notes on Databricks and data engineering concepts
Consuming and Visualizing Real-Time Event Streams
Processing and visualizing with Spark, Minio, PostgreSQL & Grafana
Simulating Real-Time User Journeys with Python and Kafka
Simulate clickstream and transaction data for users
Airflow XComs 101
When building pipelines in Apache Airflow, tasks often need to share data with each other.
That’s where XComs (cross-communication) XComs enable tasks in your Airflow DAGs to exchange small amounts of data. :Every task instance in Airflow gets its
Airflow DAGs 101
Defining airflow dags and task dependencies
Kafka basics with Docker
Run kafka using docker and publish subscribe to a kafka topic
Docker commands cheatsheet
Quick reference for common Docker + Docker Compose commands.
Data Warehousing, Business Intelligence, and Dimensional Modeling Primer
Chapter 1 of The Data Warehouse Toolkit by Ralph Kimball
Data Models and Query Languages
Chapter 2 notes for Designing Data Intensive Applications By Martin Kleppmann
Reliable, Scalable and Maintainable Applications
Chapter 1 notes for Designing Data Intensive Applications By Martin Kleppmann