Kedro Airflow K8S Plugin
0.8.2

Contents:

  • Introduction
    • What is Airflow?
    • What is Kubernetes?
    • Why to integrate Kedro project with Airflow and Kubernetes?
  • Installation
    • Plugin installation
      • Kedro setup
      • Plugin installation
        • Install from PyPI
        • Install from sources
      • Available commands
        • compile
        • init
        • list-pipelines
        • run-once
        • schedule
        • ui
        • upload-pipeline
    • Configuration parameters
      • Indicate resources in pipeline nodes
      • Custom kubernetes pod templates
      • Spark on Kubernetes configuration
      • Dynamic configuration support
  • Getting Started
    • Quickstart
      • Preprequisites
      • Install the toy project with Kedro Airflow K8S support
      • Build the docker image to be used on Airflow K8S runs
      • Setup GIT repository
      • Compile DAG
      • Diagnose execution
    • Google Cloud Platform support
      • Using kedro with AI Platform Notebooks
    • Mlflow support
    • Authentication to MLflow API
      • GoogleOAuth2
      • Vars
    • Authentication to Airflow API
    • Spark integration
      • Project handling
      • Configuration
        • Google Dataproc
        • Kubernetes
        • Custom configuration
        • Custom initialization script
      • Detection of spark nodes
Kedro Airflow K8S Plugin
  • Welcome to Kedro Airflow K8S Plugin’s documentation!
  • Edit on GitHub

Welcome to Kedro Airflow K8S Plugin’s documentation!

Contents:

  • Introduction
    • What is Airflow?
    • What is Kubernetes?
    • Why to integrate Kedro project with Airflow and Kubernetes?
  • Installation
    • Plugin installation
    • Configuration parameters
  • Getting Started
    • Quickstart
    • Google Cloud Platform support
    • Mlflow support
    • Authentication to MLflow API
    • Authentication to Airflow API
    • Spark integration

Indices and tables

  • Index

  • Module Index

  • Search Page

Next

© Copyright 2021, GetInData. Revision 62743718.

Built with Sphinx using a theme provided by Read the Docs.