Streaming Databases - Helion

ebook

Autor: Hubert Dulay, Ralph Matthias Debusmann
ISBN: 9781098154790
stron: 260, Format: ebook
Data wydania: 2024-08-08
Księgarnia: Helion

Cena książki: 212,40 zł (poprzednio: 275,84 zł)
Oszczędzasz: 23% (-63,44 zł)

Osoby, które kupiły tę książkę, wybierały także »

Tagi: Inne

Real-time applications are becoming the norm today. But building a model that works properly requires real-time data from the source, in-flight stream processing, and low latency serving of its analytics. With this practical book, data engineers, data architects, and data analysts will learn how to use streaming databases to build real-time solutions.

Authors Hubert Dulay and Ralph M. Debusmann take you through streaming database fundamentals, including how these databases reduce infrastructure for real-time solutions. You'll learn the difference between streaming databases, stream processing, and real-time online analytical processing (OLAP) databases. And you'll discover when to use push queries versus pull queries, and how to serve synchronous and asynchronous data emanating from streaming databases.

This guide helps you:

Explore stream processing and streaming databases
Learn how to build a real-time solution with a streaming database
Understand how to construct materialized views from any number of streams
Learn how to serve synchronous and asynchronous data
Get started building low-complexity streaming solutions with minimal setup

Osoby które kupowały "Streaming Databases", wybierały także:

Windows Media Center. Domowe centrum rozrywki 66,67 zł, (8,00 zł -88%)
Przywództwo w świecie VUCA. Jak być skutecznym liderem w niepewnym środowisku 58,64 zł, (12,90 zł -78%)
Mapa Agile & Scrum. Jak si 57,69 zł, (15,00 zł -74%)
Sztuka podst 53,46 zł, (13,90 zł -74%)
Lean dla bystrzaków. Wydanie II 49,62 zł, (12,90 zł -74%)

Spis treści

Streaming Databases eBook -- spis treści

Foreword
Preface
- Conventions Used in This Book
- Using Code Examples
- OReilly Online Learning
- How to Contact Us
- Huberts Acknowledgements
- Ralphs Acknowledgments
1. Streaming Foundations
- Turning the Database Inside Out
- Externalizing Database Features
  - Write-Ahead Log
  - Streaming Platforms
  - Materialized Views
- Use Case: Clickstream Analysis
  - Understanding Transactions and Events
  - Domain-Driven Design
- Context Enrichment
- Change Data Capture
- Connectors
  - Connector Middleware
  - Embedded
  - Custom-Built
- Summary
2. Stream Processing Platforms
- Stateful Transformations
- Data Pipelines
  - ELT Limitations
  - Stream Processing with ELT
- Stream Processors
  - Popular Stream Processors
  - Newer Stream Processors
- Emulating Materialized Views in Apache Spark
- Two Types of Streams
  - Append Stream
  - Debezium Change Data
  - Materialized Views
- Summary
3. Serving Real-Time Data
- Real-Time Expectations
- Choosing an Analytical Data Store
- Sourcing from a Topic
- Ingestion Transformations
- OLTP Versus OLAP
  - ACID
  - Row- Versus Column-Based Optimization
- Queries Per Second and Concurrency
- Indexing
- Serving Analytical Results
  - Synchronous Queries
  - Asynchronous Queries
  - Push Versus Pull Queries
- Summary
4. Materialized Views
- Views, Materialized Views, and Incremental Updates
- Change Data Capture
- Push Versus Pull Queries
- CDC and Upsert
- Joining Streams
  - Apache Calcite
  - Clickstream Use Case
- Summary
5. Introduction to Streaming Databases
- Identifying the Streaming Database
  - Column-Based Streaming Database
  - Row-Based Streaming Database
  - Edge Streaming-Like Databases
- SQL Expressivity
- Streaming Debuggability
  - Advantages of Debugging in Streaming Databases
  - SQL Is Not a Silver Bullet
- Streaming Database Implementations
- Streaming Database Architecture
- ELT with Streaming Databases
- Summary
6. Consistency
- A Toy Example
  - Transactions
  - Analyzing the Transactions
- Comparing Consistency Across Stream Processing Systems
  - Flink SQL
  - ksqlDB
  - Proton (Timeplus)
  - RisingWave
  - Materialize
  - Pathway
  - Out-of-Order Messages
- Going Beyond Eventual Consistency
  - Why Do Eventually Consistent Stream Processors Fail the Toy Example?
    - Early emission from nonmonotonic operators
    - Combining streams without synchronization
  - How Do Internally Consistent Stream Processing Systems Pass the Toy Example?
    - RisingWave
    - Materialize
    - Pathway
  - How Can We Fix Eventually Consistent Stream Processing Systems to Pass the Toy Example?
    - How Flink SQL can pass the toy example
    - Why this fix can be problematic
    - MiniBatch in Flink 1.19+
- Consistency Versus Latency
- Summary
7. Emergence of Other Hybrid Data Systems
- Data Planes
- Hybrid Transactional/Analytical Database
- Other Hybrid Databases
- Motivations for Hybrid Systems
- The Influence of PostgreSQL on Hybrid Databases
- Near-Edge Analytics
- Next-Generation Hybrid Databases
  - Next-Generation Streaming OLTP Databases
  - Next-Generation Streaming RTOLAP Databases
  - Next-Generation HTAP Databases
- Summary
8. Zero-ETL or Near-Zero-ETL
- ETL Model
- Zero-ETL
- Near-Zero-ETL
  - PeerDB
  - Proton
  - Embedded OLAP
    - DuckDB
    - chDB
  - Data Gravity and Replication
  - Analytical Data Reduction
- Lambda Architecture
  - Apache Pinot Hybrid Tables
  - Pipeline Configurations
- Summary
9. The Streaming Plane
- Data Gravity
- Components of the Streaming Plane
- Streaming Plane Infrastructure
- Operational Analytics
- Data Mesh
  - Pillars of a Data Mesh
  - Challenge of a Data Mesh
- Streaming Data Mesh with Streaming Plane and Streaming Databases
  - Data Locality
  - Data Replication
- Summary
10. Deployment Models
- Consistent Streaming Database
- Consistent Streaming Processor and RTOLAP
- Eventually Consistent OLAP Streaming Database
- Eventually Consistent Stream Processor and RTOLAP
- Eventually Consistent Stream Processor and HTAP
- ksqlDB
- Incremental View Maintenance
- Postgres Multicorn Foreign Data Wrapper
- When to Use Code-Based Stream Processors
- When to Use Lakehouse/Streamhouse Technologies
- Caching Technologies
- Where to Do Processing and Querying in General?
  - The Four Where Questions
  - An Analytical Use Case
  - Consequences
- Summary
11. Future State of Real-Time Data
- The Convergence of the Data Planes
- Graph Databases
  - Memgraph
  - thatDot/Quine
- Vector Databases
  - Milvus 2.x: Streaming as the Central Backbone
  - RTOLAP Databases: Adding Vector Search
    - ClickHouse
    - Rockset
- Incremental View Maintenance
  - pg_ivm
  - Hydra
  - Epsio
  - Feldera
  - PeerDB
- Data Wrapping and Postgres Multicorn
- Classical Databases
- Data Warehouses
  - BigQuery
  - Redshift
  - Snowflake
- Lakehouse
  - Delta Lake
  - Apache Paimon
  - Apache Iceberg
  - Apache Hudi
  - OneTable or XTable
  - The Relationship of Streaming and Lakehouses
- Conclusion
Index