Skip to content

Conversation

@jason810496
Copy link
Member

@jason810496 jason810496 commented Mar 11, 2025

related: #44508

Why

Improving the Kubernetes development experience, as described in #44508.

How

  • Introduce dev mode in the Helm chart
    • Add airflow-code-pvc PVC
    • Mount airflow-code-pvc as $AIRFLOW_HOME/airflow to include the source code
  • Introduce the breeze k8s reload command
    • Copy the current source code from the local machine to airflow-code-pvc
    • Roll out a restart for all Airflow components

What

  • Significantly improves the k8s test iteration process
    • Don't need to rebuild image and upload to kind cluster repeatedly.
  • Could potentially speed up CI in k8s system tests
    • Eliminates the need to rebuild the k8s image with breeze k8s build-k8s-image --rebuild-base-image for every change (only required when dependencies change)
    • Allows loading the latest code changes using breeze k8s reload

@boring-cyborg boring-cyborg bot added the area:helm-chart Airflow Helm Chart label Mar 11, 2025
@github-actions
Copy link

This pull request has been automatically marked as stale because it has not had recent activity. It will be closed in 5 days if no further activity occurs. Thank you for your contributions.

@github-actions github-actions bot added the stale Stale PRs per the .github/workflows/stale.yml policy file label Apr 26, 2025
@potiuk potiuk removed the stale Stale PRs per the .github/workflows/stale.yml policy file label Apr 26, 2025
@potiuk
Copy link
Member

potiuk commented Apr 26, 2025

I 'd encourage to continue it :)

@jason810496
Copy link
Member Author

I 'd encourage to continue it :)

So do I, but I still working on #49470 ( rework resolving OOM for api-server when reading large logs ) and almost finish it, and will continue on this one.

@jason810496 jason810496 force-pushed the refactor/improve-k8s-tests-iteration-experience branch 4 times, most recently from eae849f to 78ff971 Compare May 13, 2025 02:49
@jason810496 jason810496 force-pushed the refactor/improve-k8s-tests-iteration-experience branch from 78ff971 to 75c0cd7 Compare May 28, 2025 13:47
@jason810496 jason810496 force-pushed the refactor/improve-k8s-tests-iteration-experience branch from 75c0cd7 to d074196 Compare June 1, 2025 07:07
@github-actions
Copy link

This pull request has been automatically marked as stale because it has not had recent activity. It will be closed in 5 days if no further activity occurs. Thank you for your contributions.

@github-actions github-actions bot added the stale Stale PRs per the .github/workflows/stale.yml policy file label Jul 27, 2025
@jason810496
Copy link
Member Author

up.

I still stuck with a few conference recently but I will keep work this later.
Before this PR, I will add --dev flag for hot-reload support for all components startup commands.

@github-actions github-actions bot removed the stale Stale PRs per the .github/workflows/stale.yml policy file label Jul 28, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

area:helm-chart Airflow Helm Chart

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants