Automatically import move standard operators / hooks etc with deprecation from old location

[potiuk]

Body

For compatibility reason we wanted to "redirect" all the moved "airflow.operators" , "airflow.hooks" etc. to "standard" provider in Airflow 3 - with deprectation warning.

In the past we were doing it with our deprecation include but @ashb mentioned that he found another way. @gopidesupavan - that would be a follow up after #42081 and #42252 .

@ashb -> can you please explain the mechanism you found?

Committer

• I acknowledge that I am a maintainer/committer of the Apache Airflow project.

[gopidesupavan]

Oh yeah that would helpful :).

When this discussion began a while ago, i heard from the discussion using meta path, then I experimented with using this to redirect old imports to new ones.

ash please suggest your approach.

import sys
import importlib

class ModuleRedirectSpec:
    def __init__(self, redirects):
        self.redirects = redirects

    def find_spec(self, old_module_ref, path, target=None):
        if old_module_ref in self.redirects:
            new_module_name = self.redirects[old_module_ref]
            return importlib.util.find_spec(new_module_name)
        return None

redirects = {
    "airflow.operators.bash": "airflow.providers.standard.operators.bash"
}
sys.meta_path.insert(0, ModuleRedirectSpec(redirects))

[potiuk]

And let's not forget deprecations :)