Kedro Airflow K8S Plugin
0.8.0

Contents:

  • Introduction
    • What is Airflow?
    • What is Kubernetes?
    • Why to integrate Kedro project with Airflow nad Kubernetes?
  • Installation
    • Plugin installation
      • Kedro setup
      • Plugin installation
        • Install from PyPI
        • Install from sources
      • Available commands
        • compile
        • init
        • list-pipelines
        • run-once
        • schedule
        • ui
        • upload-pipeline
    • Configuration parameters
      • Indicate resources in pipeline nodes
      • Custom kubernetes pod templates
      • Spark on Kubernetes configuration
      • Dynamic configuration support
  • Getting Started
    • Quickstart
      • Preprequisites
      • Install the toy project with Kedro Airflow K8S support
      • Build the docker image to be used on Airflow K8S runs
      • Setup GIT repository
      • Compile DAG
      • Diagnose execution
    • Google Cloud Platform support
      • Using kedro with AI Platform Notebooks
    • Mlflow support
    • Authentication to MLflow API
      • GoogleOAuth2
      • Vars
    • Authentication to Airflow API
    • Spark integration
      • Project handling
      • Configuration
        • Google Dataproc
        • Kubernetes
        • Custom configuration
        • Custom initialization script
      • Detection of spark nodes
Kedro Airflow K8S Plugin
  • »
  • Welcome to Kedro Airflow K8S Plugin’s documentation!
  • Edit on GitHub

Welcome to Kedro Airflow K8S Plugin’s documentation!

Contents:

  • Introduction
    • What is Airflow?
    • What is Kubernetes?
    • Why to integrate Kedro project with Airflow nad Kubernetes?
  • Installation
    • Plugin installation
    • Configuration parameters
  • Getting Started
    • Quickstart
    • Google Cloud Platform support
    • Mlflow support
    • Authentication to MLflow API
    • Authentication to Airflow API
    • Spark integration

Indices and tables

  • Index

  • Module Index

  • Search Page

Next

© Copyright 2021, GetInData. Revision 591cd8d3.

Built with Sphinx using a theme provided by Read the Docs.
Read the Docs v: 0.8.0
Versions
latest
0.8.0
0.7.3
0.7.2
0.7.1
0.7.0
0.6.7
0.6.6
0.6.5
0.6.4
0.6.3
0.6.2
0.6.1
0.6.0
0.5.4
0.5.3
0.5.2
0.5.1
0.5.0
0.4.0
0.3.0
0.2.0
0.1.2
0.1.1
0.1.0
Downloads
On Read the Docs
Project Home
Builds