Skip to content

Releases: getindata/kedro-airflow-k8s

Release 0.4.0

20 Apr 18:26
76f398d
Compare
Choose a tag to compare

[0.4.0] - 2021-04-20

  • Support of S3 as DAG destination
  • Operators extracted from DAG template as reusable components
  • Selection of specific pipeline by name from CLI

Release 0.3.0

15 Apr 10:56
09cf695
Compare
Choose a tag to compare

[0.3.0] - 2021-04-15

  • Resources configuration added that allows describing cpu and memory resources required in k8s by pods
  • Shared persistent volume can be made optional
  • Pod startup timeout is configurable, with default to 600 seconds

Release 0.2.0

01 Apr 10:20
7f44a50
Compare
Choose a tag to compare

[0.2.0] - 2021-04-01

  • Command list-pipelines allows display of pipelines which were generated with the plugin
  • Command ui opens webbrowser with Apache Airflow
  • Move options to config file and restructure
  • MLflow enabled only if kedro-mlflow present in dependencies and configuration is in place
  • Command init to initialize configuration for the plugin in kedro project

Release 0.1.2

24 Mar 16:44
e64ee8f
Compare
Choose a tag to compare

[0.1.2] - 2021-03-24

  • Allow override image parameter from CLI for upload_pipeline, run_once and compile
  • Conditional SSL verification for Apache Airflow client, via AIRFLOWCLIENTSSL_VERIFY environment variable
  • run-once with wait-for-completion checks for task instance failure as well

Release 0.1.1

19 Mar 10:16
c0e9d22
Compare
Choose a tag to compare

[0.1.1] - 2021-03-19

  • Inits temporary volume with data from image kedro data directory (/home/kedro/data)
  • Increased startup time for pods to 10 minutes

Release 0.1.0

18 Mar 09:46
4f3a587
Compare
Choose a tag to compare

[0.1.0] - 2021-03-17

  • Creates mlflow experiment on pipeline start if it does not exist
  • Temporary persistent volumes generation and removal for pipelines
  • upload-pipeline command that generates DAG to Airflow directory
  • schedule command that generates DAG to Airflow directory with the given schedule
  • run-once command that uploads pipeline to Airflow and creates the DAG run

Release 0.0.4

10 Mar 08:43
Compare
Choose a tag to compare

[0.0.4] - 2021-03-10

Release 0.0.3

09 Mar 14:31
bbcc361
Compare
Choose a tag to compare

[0.0.3] - 2021-03-09

Fixed

  • Drop dependency on airflow

Release 0.0.2

09 Mar 13:36
070efec
Compare
Choose a tag to compare

[0.0.2] - 2021-03-09

Added

  • Initial implementation of kedro_airflow_k8s plugin stub.