Derived Data

The final part explores how to derive datasets from others, combining batch and stream processing to build systems that are both robust and scalable. This is where everything comes together.

Chapters

10+

Interactive Demos

~2hr

Estimated Time

Prerequisite: Parts I & II

These chapters synthesize concepts from both previous parts. Understanding data foundations and distributed systems is essential before exploring derived data.

Review Part I →Review Part II →

Chapters

Batch Processing

Learn how to process large datasets efficiently using batch processing.

Unix philosophyMapReduceHadoopSpark

Coming Soon

Stream Processing

Understand how to process data as it arrives with stream processing.

Message queuesKafkaChange data captureEvent sourcing

Coming Soon

The Future of Data Systems

Explore how to combine different technologies to build robust systems.

Data integrationLambda architecture correctnessPrivacy

Coming Soon