Processing big data in real time is challenging due to scalability, information consistency, and fault-tolerance. This book teaches you how to use Spark to make your overall analytical workflow faster and more efficient. You'll explore all core concepts and tools within the Spark ecosystem, such as Spark Streaming, the Spark Streaming API, machine learning extension, and structured streaming.
You'll begin by learning data processing fundamentals using Resilient Distributed Datasets (RDDs), SQL, Datasets, and Dataframes APIs. After grasping these fundamentals, you'll move on to using Spark Streaming APIs to consume data in real time from TCP sockets, and integrate Amazon Web Services (AWS) for stream consumption.
By the end of this book, you’ll not only have understood how to use machine learning extensions and structured streams but you’ll also be able to apply Spark in your own upcoming big data projects.

Osoby które kupowały "Big Data Processing with Apache Spark. Efficiently tackle large datasets and big data analysis with Spark and Python", wybierały także:

• Biologika Sukcesji Pokoleniowej. Sezon 3. Konflikty na terytorium 126,36 zÅ‚, (13,90 zÅ‚ -89%)
• Windows Media Center. Domowe centrum rozrywki 66,67 zÅ‚, (8,00 zÅ‚ -88%)
• PodrÄ™cznik startupu. Budowa wielkiej firmy krok po kroku 92,67 zÅ‚, (13,90 zÅ‚ -85%)
• Ruby on Rails. Ćwiczenia 18,75 zÅ‚, (3,00 zÅ‚ -84%)
• Scrum. O zwinnym zarz 77,22 zÅ‚, (13,90 zÅ‚ -82%)

Spis treści

Big Data Processing with Apache Spark. Efficiently tackle large datasets and big data analysis with Spark and Python eBook -- spis treści

• 1. Introduction to Spark Distributed Processing
• 2. Introduction to Spark Streaming
• 3. Spark Streaming Integration with AWS
• 4. Spark Streaming, ML, and Windowing Operations