Kedro Airflow K8S Plugin
0.8.2

Contents:

  • Introduction
    • What is Airflow?
    • What is Kubernetes?
    • Why to integrate Kedro project with Airflow and Kubernetes?
  • Installation
    • Plugin installation
      • Kedro setup
      • Plugin installation
        • Install from PyPI
        • Install from sources
      • Available commands
        • compile
        • init
        • list-pipelines
        • run-once
        • schedule
        • ui
        • upload-pipeline
    • Configuration parameters
      • Indicate resources in pipeline nodes
      • Custom kubernetes pod templates
      • Spark on Kubernetes configuration
      • Dynamic configuration support
  • Getting Started
    • Quickstart
      • Preprequisites
      • Install the toy project with Kedro Airflow K8S support
      • Build the docker image to be used on Airflow K8S runs
      • Setup GIT repository
      • Compile DAG
      • Diagnose execution
    • Google Cloud Platform support
      • Using kedro with AI Platform Notebooks
    • Mlflow support
    • Authentication to MLflow API
      • GoogleOAuth2
      • Vars
    • Authentication to Airflow API
    • Spark integration
      • Project handling
      • Configuration
        • Google Dataproc
        • Kubernetes
        • Custom configuration
        • Custom initialization script
      • Detection of spark nodes
Kedro Airflow K8S Plugin
  • Installation
  • Edit on GitHub

Installation

  • Plugin installation
    • Kedro setup
    • Plugin installation
      • Install from PyPI
      • Install from sources
    • Available commands
      • compile
      • init
      • list-pipelines
      • run-once
      • schedule
      • ui
      • upload-pipeline
  • Configuration parameters
    • Indicate resources in pipeline nodes
    • Custom kubernetes pod templates
    • Spark on Kubernetes configuration
    • Dynamic configuration support
Previous Next

© Copyright 2021, GetInData. Revision 62743718.

Built with Sphinx using a theme provided by Read the Docs.