The open source Apache Airflow data orchestration technology is adding new features to help enterprises build better data pipelines and understand where data is coming from.

Apache Airflow is a great data pipeline as code, but having most of its contributors work for Astronomer is another example of a problem with open source.

The new operators will help enterprises integrate Vertex AI’s generative AI models into data pipelines orchestrated by Apacher Airflow and its managed workflow orchestration service Cloud Composer.

While customers really enjoy the pre-built integrations and familiar Python programming language of Apache Airflow, they want it without the added operational cost and complexity.

Apache Airflow is one of the world’s most popular open source tools for building and managing data pipelines, with around 16 million downloads per month. Those users will see several compelling new ...