Skip to content Skip to sidebar Skip to footer
Showing posts with the label Airflow

Airflow Run Tasks At Different Times In The Same Dag?

I have 30 individual tasks in a dag, they have no dependencies between each other. The tasks run th… Read more Airflow Run Tasks At Different Times In The Same Dag?

Bashoperator Raising Importerror For A Lib Used In Other Pythonoperators

I have a set of tasks in my dag builder module which uses Python operator as used worldwide in Airf… Read more Bashoperator Raising Importerror For A Lib Used In Other Pythonoperators

Airflow Webserver Not Starting In 1.10

Trying to migrate from Airflow 1.9 to Airflow 1.10. After some effort I was able to install the new… Read more Airflow Webserver Not Starting In 1.10

Listing Variables From External Script Python Without The Built-in And Imported Variables

I'm writing a python script that gets parameters from a json file, opens a template script spec… Read more Listing Variables From External Script Python Without The Built-in And Imported Variables

Incorrect Work Of Scheduler Interval And Start Time In Apache Airflow

Can't find the solution with start time of tasks. I have code and can't find where I'm … Read more Incorrect Work Of Scheduler Interval And Start Time In Apache Airflow

Paperboy Throwing Error: Typeerror: The Json Object Must Be Str, Not 'bytes'?

I have installed paperboy using steps given at https://github.com/timkpaine/paperboy.git and execut… Read more Paperboy Throwing Error: Typeerror: The Json Object Must Be Str, Not 'bytes'?

Composer On Google Platform Not Available For Python 3

According to the documentation here: https://cloud.google.com/composer/docs/release-notes Composer … Read more Composer On Google Platform Not Available For Python 3

How Do I Restart Airflow Webserver?

I am using airflow for my data pipeline project. I have configured my project in airflow and start … Read more How Do I Restart Airflow Webserver?