Using Kubernetes executors

Instead of using the Celery workers you can let Airflow run the tasks using Kubernetes executors, where pods are created dynamically as needed without jobs being routed through a redis queue to the workers.

To achieve this, swap spec.celeryExecutors with spec.kubernetesExecutors. E.g. you would change the following example

spec:
  celeryExecutors:
    roleGroups:
      default:
        replicas: 2
    config:
      resources:
        # ...

to

spec:
  kubernetesExecutors:
    config:
      resources:
        # ...