Kedro Airflow K8S Plugin
0.8.2
Contents:
Introduction
What is Airflow?
What is Kubernetes?
Why to integrate Kedro project with Airflow and Kubernetes?
Installation
Plugin installation
Kedro setup
Plugin installation
Install from PyPI
Install from sources
Available commands
compile
init
list-pipelines
run-once
schedule
ui
upload-pipeline
Configuration parameters
Indicate resources in pipeline nodes
Custom kubernetes pod templates
Spark on Kubernetes configuration
Dynamic configuration support
Getting Started
Quickstart
Preprequisites
Install the toy project with Kedro Airflow K8S support
Build the docker image to be used on Airflow K8S runs
Setup GIT repository
Compile DAG
Diagnose execution
Google Cloud Platform support
Using
kedro
with AI Platform Notebooks
Mlflow support
Authentication to MLflow API
GoogleOAuth2
Vars
Authentication to Airflow API
Spark integration
Project handling
Configuration
Google Dataproc
Kubernetes
Custom configuration
Custom initialization script
Detection of spark nodes
Kedro Airflow K8S Plugin
Installation
Edit on GitHub
Installation
Plugin installation
Kedro setup
Plugin installation
Install from PyPI
Install from sources
Available commands
compile
init
list-pipelines
run-once
schedule
ui
upload-pipeline
Configuration parameters
Indicate resources in pipeline nodes
Custom kubernetes pod templates
Spark on Kubernetes configuration
Dynamic configuration support
Read the Docs
v: 0.8.2
Versions
latest
0.8.2
0.8.1
0.8.0
0.7.3
0.7.2
0.7.1
0.7.0
0.6.7
0.6.6
0.6.5
0.6.4
0.6.3
0.6.2
0.6.1
0.6.0
0.5.4
0.5.3
0.5.2
0.5.1
0.5.0
0.4.0
0.3.0
0.2.0
0.1.2
0.1.1
0.1.0
Downloads
On Read the Docs
Project Home
Builds