could this somehow co-operate or run as apache airflow tasks? https://airflow.apache.org/. or integrate with apache beam - https://beam.apache.org/.