Open
Description
dlt version
1.10
Describe the problem
There seems to be an incompatibility between the freshly released airflow==3.0.0 and dlt=1.10:
Traceback (most recent call last):
File "/home/airflow/.local/lib/python3.12/site-packages/dlt/helpers/airflow_helper.py", line 21, in <module>
from airflow.operators.dummy import DummyOperator
ModuleNotFoundError: No module named 'airflow.operators.dummy'
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "/opt/airflow/dags/01_load_staging.py", line 7, in <module>
from dlt.helpers.airflow_helper import PipelineTasksGroup
File "/home/airflow/.local/lib/python3.12/site-packages/dlt/helpers/airflow_helper.py", line 24, in <module>
raise MissingDependencyException("Airflow", ["apache-airflow>=2.5"])
dlt.common.exceptions.MissingDependencyException:
You must install additional dependencies to run Airflow. If you use pip you may do the following:
pip install "apache-airflow>=2.5"Expected behavior
If this is indeed a problem caused by changes of the recent airflow release, I expect the pyproject.toml to specify an upper bound for apache-airflow.
Steps to reproduce
Install airflow=3.0.0 and dlt=1.10 and create a pipeline using the airflow_helper.
Operating system
macOS
Runtime environment
Airflow
Python version
3.12
dlt data source
No response
dlt destination
No response
Other deployment details
No response
Additional information
No response
Metadata
Metadata
Assignees
Type
Projects
Status
Todo