Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Airflow2 #48

Open
wants to merge 17 commits into
base: master
Choose a base branch
from
Open

Airflow2 #48

wants to merge 17 commits into from

Conversation

jean-helsinki
Copy link

Airflow 2.x support:

  • airflow.operators.dummy_operator -> airflow.operators.dummy

  • airflow.operators.bash_operator -> airflow.operators.bash

  • airflow.sensors.http_sensor -> airflow.providers.http.sensors.http

  • tests: fix yaml.load warning

    airflow-declarative/tests/test_good_dags.py:49: YAMLLoadWarning: calling yaml.load() without Loader=... is deprecated, as the default Loader is unsafe. Please read https://msg.pyyaml.org/load for full details.
      schema1 = airflow_declarative.schema.ensure_schema(yaml.load(content))
    
  • Test against airflow 2.1

  • compat: update for airflow 2

  • tests: fix datetimes for airflow 2

      assert yml_dag.start_date == datetime.datetime(2017, 7, 27, 0, 0, 0)
    

    E AssertionError: assert DateTime(2017...mezone('UTC')) == datetime.datet..., 7, 27, 0, 0)
    E -DateTime(2017, 7, 27, 0, 0, 0, tzinfo=Timezone('UTC'))
    E +datetime.datetime(2017, 7, 27, 0, 0)

  • Fix broken Operator serialization in airflow 2

    E yaml.representer.RepresenterError: ('cannot represent an object', <class 'airflow.operators.dummy.DummyOperator'>)

  • tests coverage: ignore uncovered branches

  • Drop airflow 1 support (there is no airflow.operators.dummy module in it)

  • Fix deprecation warning about apply_defaults

  • Drop compat (py2.7 + airflow 1)

  • Drop python 2.7 + airflow 1 support

  • Add 2.3.1 patch

  • Remove no longer working .travis.yml

  • Adopt code for py39, drop py2 references, use poetry for package managment, fix linter hints

  • Update trafaret lib, rewrite tox.ini

KostyaEsmukov and others added 17 commits September 5, 2021 14:09
  airflow-declarative/tests/test_good_dags.py:49: YAMLLoadWarning: calling yaml.load() without Loader=... is deprecated, as the default Loader is unsafe. Please read https://msg.pyyaml.org/load for full details.
    schema1 = airflow_declarative.schema.ensure_schema(yaml.load(content))
>       assert yml_dag.start_date == datetime.datetime(2017, 7, 27, 0, 0, 0)
E       AssertionError: assert DateTime(2017...mezone('UTC')) == datetime.datet..., 7, 27, 0, 0)
E         -DateTime(2017, 7, 27, 0, 0, 0, tzinfo=Timezone('UTC'))
E         +datetime.datetime(2017, 7, 27, 0, 0)
E       yaml.representer.RepresenterError: ('cannot represent an object', <class 'airflow.operators.dummy.DummyOperator'>)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants