Building Machine Learning Pipelines - Helion

ebook

Autor: Hannes Hapke, Catherine Nelson
ISBN: 978-14-920-5314-9
stron: 366, Format: ebook
Data wydania: 2020-07-13
Księgarnia: Helion

Cena książki: 211,65 zł (poprzednio: 246,10 zł)
Oszczędzasz: 14% (-34,45 zł)

Osoby, które kupiły tę książkę, wybierały także »

Companies are spending billions on machine learning projects, but it’s money wasted if the models can’t be deployed effectively. In this practical guide, Hannes Hapke and Catherine Nelson walk you through the steps of automating a machine learning pipeline using the TensorFlow ecosystem. You’ll learn the techniques and tools that will cut deployment time from days to minutes, so that you can focus on developing new models rather than maintaining legacy systems.

Data scientists, machine learning engineers, and DevOps engineers will discover how to go beyond model development to successfully productize their data science projects, while managers will better understand the role they play in helping to accelerate these projects.

Understand the steps to build a machine learning pipeline
Build your pipeline using components from TensorFlow Extended
Orchestrate your machine learning pipeline with Apache Beam, Apache Airflow, and Kubeflow Pipelines
Work with data using TensorFlow Data Validation and TensorFlow Transform
Analyze a model in detail using TensorFlow Model Analysis
Examine fairness and bias in your model performance
Deploy models with TensorFlow Serving or TensorFlow Lite for mobile devices
Learn privacy-preserving machine learning techniques

Osoby które kupowały "Building Machine Learning Pipelines", wybierały także:

Windows Media Center. Domowe centrum rozrywki 66,67 zł, (8,00 zł -88%)
Ruby on Rails. Ćwiczenia 18,75 zł, (3,00 zł -84%)
DevOps w praktyce. Kurs video. Jenkins, Ansible, Terraform i Docker 190,00 zł, (39,90 zł -79%)
Przywództwo w świecie VUCA. Jak być skutecznym liderem w niepewnym środowisku 58,64 zł, (12,90 zł -78%)
Scrum. O zwinnym zarządzaniu projektami. Wydanie II rozszerzone 58,64 zł, (12,90 zł -78%)

Spis treści

Building Machine Learning Pipelines eBook -- spis treści

Foreword
Preface
- What Are Machine Learning Pipelines?
- Who Is This Book For?
- Why TensorFlow and TensorFlow Extended?
- Overview of the Chapters
- Conventions Used in This Book
- Using Code Examples
- OReilly Online Learning
- How to Contact Us
- Acknowledgments
1. Introduction
- Why Machine Learning Pipelines?
- When to Think About Machine Learning Pipelines
- Overview of the Steps in a Machine Learning Pipeline
  - Data Ingestion and Data Versioning
  - Data Validation
  - Data Preprocessing
  - Model Training and Tuning
  - Model Analysis
  - Model Versioning
  - Model Deployment
  - Feedback Loops
  - Data Privacy
- Pipeline Orchestration
  - Why Pipeline Orchestration?
  - Directed Acyclic Graphs
- Our Example Project
  - Project Structure
  - Our Machine Learning Model
  - Goal of the Example Project
- Summary
2. Introduction to TensorFlow Extended
- What Is TFX?
- Installing TFX
- Overview of TFX Components
- What Is ML Metadata?
- Interactive Pipelines
- Alternatives to TFX
- Introduction to Apache Beam
  - Setup
  - Basic Data Pipeline
    - Basic collection example
    - Basic transformation example
    - Putting it all together
  - Executing Your Basic Pipeline
- Summary
3. Data Ingestion
- Concepts for Data Ingestion
  - Ingesting Local Data Files
    - Converting comma-separated data to tf.Example
    - Importing existing TFRecord Files
    - Converting Parquet-serialized data to tf.Example
    - Converting Avro-serialized data to tf.Example
    - Converting your custom data to TFRecord data structures
  - Ingesting Remote Data Files
  - Ingesting Data Directly from Databases
    - Google Cloud BigQuery
    - Presto databases
- Data Preparation
  - Splitting Datasets
    - Splitting one dataset into subsets
    - Preserving existing splits
  - Spanning Datasets
  - Versioning Datasets
- Ingestion Strategies
  - Structured Data
  - Text Data for Natural Language Problems
  - Image Data for Computer Vision Problems
- Summary
4. Data Validation
- Why Data Validation?
- TFDV
  - Installation
  - Generating Statistics from Your Data
  - Generating Schema from Your Data
- Recognizing Problems in Your Data
  - Comparing Datasets
  - Updating the Schema
  - Data Skew and Drift
  - Biased Datasets
  - Slicing Data in TFDV
- Processing Large Datasets with GCP
- Integrating TFDV into Your Machine Learning Pipeline
- Summary
5. Data Preprocessing
- Why Data Preprocessing?
  - Preprocessing the Data in the Context of the Entire Dataset
  - Scaling the Preprocessing Steps
  - Avoiding a Training-Serving Skew
  - Deploying Preprocessing Steps and the ML Model as One Artifact
  - Checking Your Preprocessing Results in Your Pipeline
- Data Preprocessing with TFT
  - Installation
  - Preprocessing Strategies
  - Best Practices
  - TFT Functions
    - Text data for natural language problems
    - Image data for computer vision problems
  - Standalone Execution of TFT
  - Integrate TFT into Your Machine Learning Pipeline
- Summary
6. Model Training
- Defining the Model for Our Example Project
- The TFX Trainer Component
  - run_fn() Function
    - Load the data
    - Compile and train the model
    - Model export
  - Running the Trainer Component
  - Other Trainer Component Considerations
    - Using the Trainer component with an Estimator model
    - Using the SavedModel outside a pipeline
- Using TensorBoard in an Interactive Pipeline
- Distribution Strategies
- Model Tuning
  - Strategies for Hyperparameter Tuning
  - Hyperparameter Tuning in TFX Pipelines
- Summary
7. Model Analysis and Validation
- How to Analyze Your Model
  - Classification Metrics
  - Regression Metrics
- TensorFlow Model Analysis
  - Analyzing a Single Model in TFMA
  - Analyzing Multiple Models in TFMA
- Model Analysis for Fairness
  - Slicing Model Predictions in TFMA
  - Checking Decision Thresholds with Fairness Indicators
  - Going Deeper with the What-If Tool
- Model Explainability
  - Generating Explanations with the WIT
  - Other Explainability Techniques
- Analysis and Validation in TFX
  - ResolverNode
  - Evaluator Component
  - Validation in the Evaluator Component
  - TFX Pusher Component
- Summary
8. Model Deployment with TensorFlow Serving
- A Simple Model Server
- The Downside of Model Deployments with Python-Based APIs
  - Lack of Code Separation
  - Lack of Model Version Control
  - Inefficient Model Inference
- TensorFlow Serving
- TensorFlow Architecture Overview
- Exporting Models for TensorFlow Serving
- Model Signatures
- Inspecting Exported Models
- Setting Up TensorFlow Serving
  - Docker Installation
  - Native Ubuntu Installation
  - Building TensorFlow Serving from Source
- Configuring a TensorFlow Server
- REST Versus gRPC
- Making Predictions from the Model Server
  - Getting Model Predictions via REST
    - URL structure
    - Payloads
  - Using TensorFlow Serving via gRPC
    - Getting predictions from classification and regression models
    - Payloads
- Model A/B Testing with TensorFlow Serving
- Requesting Model Metadata from the Model Server
  - REST Requests for Model Metadata
  - gRPC Requests for Model Metadata
- Batching Inference Requests
- Configuring Batch Predictions
- Other TensorFlow Serving Optimizations
- TensorFlow Serving Alternatives
  - BentoML
  - Seldon
  - GraphPipe
  - Simple TensorFlow Serving
  - MLflow
  - Ray Serve
- Deploying with Cloud Providers
  - Use Cases
  - Example Deployment with GCP
    - Model deployment
    - Model inference
- Model Deployment with TFX Pipelines
- Summary
9. Advanced Model Deployments with TensorFlow Serving
- Decoupling Deployment Cycles
  - Workflow Overview
    - Accessing private models from AWS S3
    - Accessing private models from GCP Buckets
  - Optimization of Remote Model Loading
- Model Optimizations for Deployments
  - Quantization
  - Pruning
  - Distillation
- Using TensorRT with TensorFlow Serving
- TFLite
  - Steps to Optimize Your Model with TFLite
  - Serving TFLite Models with TensorFlow Serving
- Monitoring Your TensorFlow Serving Instances
  - Prometheus Setup
  - TensorFlow Serving Configuration
- Simple Scaling with TensorFlow Serving and Kubernetes
- Summary
10. Advanced TensorFlow Extended
- Advanced Pipeline Concepts
  - Training Multiple Models Simultaneously
  - Exporting TFLite Models
  - Warm Starting Model Training
- Human in the Loop
  - Slack Component Setup
  - How to Use the Slack Component
- Custom TFX Components
  - Use Cases of Custom Components
  - Writing a Custom Component from Scratch
    - Component specifications
    - Component channels
    - Component executors
    - Component drivers
    - Assembling the custom component
    - Using our basic custom component
    - Implementation review
  - Reusing Existing Components
    - Using our custom executor
- Summary
11. Pipelines Part 1: Apache Beam and Apache Airflow
- Which Orchestration Tool to Choose?
  - Apache Beam
  - Apache Airflow
  - Kubeflow Pipelines
  - Kubeflow Pipelines on AI Platform
- Converting Your Interactive TFX Pipeline to a Production Pipeline
- Simple Interactive Pipeline Conversion for Beam and Airflow
- Introduction to Apache Beam
- Orchestrating TFX Pipelines with Apache Beam
- Introduction to Apache Airflow
  - Installation and Initial Setup
  - Basic Airflow Example
    - Project-specific configurations
    - Task definitions
    - Task dependencies
    - Putting it all together
- Orchestrating TFX Pipelines with Apache Airflow
  - Pipeline Setup
  - Pipeline Execution
- Summary
12. Pipelines Part 2: Kubeflow Pipelines
- Introduction to Kubeflow Pipelines
  - Installation and Initial Setup
  - Accessing Your Kubeflow Pipelines Installation
- Orchestrating TFX Pipelines with Kubeflow Pipelines
  - Pipeline Setup
  - Executing the Pipeline
  - Useful Features of Kubeflow Pipelines
    - Restart failed pipelines
    - Recurring runs
    - Collaborating and reviewing pipeline runs
    - Auditing the pipeline lineage
- Pipelines Based on Google Cloud AI Platform
  - Pipeline Setup
  - TFX Pipeline Setup
    - Use Cloud Storage buckets for data exchange
    - Training models with an AI Platform job
    - Serving models through AI Platform endpoints
    - Scaling with Googles Dataflow
  - Pipeline Execution
- Summary
13. Feedback Loops
- Explicit and Implicit Feedback
  - The Data Flywheel
  - Feedback Loops in the Real World
- Design Patterns for Collecting Feedback
  - Users Take Some Action as a Result of the Prediction
  - Users Rate the Quality of the Prediction
  - Users Correct the Prediction
  - Crowdsourcing the Annotations
  - Expert Annotations
  - Producing Feedback Automatically
- How to Track Feedback Loops
  - Tracking Explicit Feedback
  - Tracking Implicit Feedback
- Summary
14. Data Privacy for Machine Learning
- Data Privacy Issues
  - Why Do We Care About Data Privacy?
  - The Simplest Way to Increase Privacy
  - What Data Needs to Be Kept Private?
- Differential Privacy
  - Local and Global Differential Privacy
  - Epsilon, Delta, and the Privacy Budget
  - Differential Privacy for Machine Learning
- Introduction to TensorFlow Privacy
  - Training with a Differentially Private Optimizer
  - Calculating Epsilon
- Federated Learning
  - Federated Learning in TensorFlow
- Encrypted Machine Learning
  - Encrypted Model Training
  - Converting a Trained Model to Serve Encrypted Predictions
- Other Methods for Data Privacy
- Summary
15. The Future of Pipelines and Next Steps
- Model Experiment Tracking
- Thoughts on Model Release Management
- Future Pipeline Capabilities
- TFX with Other Machine Learning Frameworks
- Testing Machine Learning Models
- CI/CD Systems for Machine Learning
- Machine Learning Engineering Community
- Summary
A. Introduction to Infrastructure for Machine Learning
- What Is a Container?
- Introduction to Docker
  - Introduction to Docker Images
  - Building Your First Docker Image
  - Diving into the Docker CLI
- Introduction to Kubernetes
  - Some Kubernetes Definitions
  - Getting Started with Minikube and kubectl
  - Interacting with the Kubernetes CLI
  - Defining a Kubernetes Resource
- Deploying Applications to Kubernetes
B. Setting Up a Kubernetes Cluster on Google Cloud
- Before You Get Started
- Kubernetes on Google Cloud
  - Selecting a Google Cloud Project
  - Setting Up Your Google Cloud Project
  - Creating a Kubernetes Cluster
  - Accessing Your Kubernetes Cluster with kubectl
  - Using Your Kubernetes Cluster with kubectl
- Persistent Volume Setups for Kubeflow Pipelines
C. Tips for Operating Kubeflow Pipelines
- Custom TFX Images
- Exchange Data Through Persistent Volumes
- TFX Command-Line Interface
  - TFX and Its Dependencies
  - TFX Templates
  - Publishing Your Pipeline with TFX CLI
Index