Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Allow Airflow DB upgrades/migrations to be on-demand #589

Open
adwk67 opened this issue Mar 3, 2025 · 0 comments
Open

Allow Airflow DB upgrades/migrations to be on-demand #589

adwk67 opened this issue Mar 3, 2025 · 0 comments

Comments

@adwk67
Copy link
Member

adwk67 commented Mar 3, 2025

Related to SUP-174

At the moment, upgrades to the airflow database occur every time the scheduler starts up: see here and here. This can cause significant overhead, depending on the number and complexity of DAGs (as well as delays in the scheduler being available). This ticket will cover the following:

  • replacing airflow db upgrade with airflow db migrate (as the former has been deprecated)
  • making the migration on demand via e.g. a new field in the resource
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant