Batch Backend Technology Stack

The Batch component is dedicated to support long running tasks.

The scheduling, monitoring, incident resolution(,...) tool for long running tasks is Airflow.

The Airflow admin is not intended for end-users (but for IT operators).

When long running tasks must be under final users control, a dedicated user interface (for the controlled tasks) is built (using Airflow REST API).