nbox.framework.on_operators
Though initially this code just like the on_ml.py <nbox.framework.on_ml.html>
_ code was build separately for each different package that we supported and that led to just some really duct taping and hacking around that made it inefficient to scale. The lesson is that premature attempts to scale are as bad as not being able to scale. On that end eventually this file will be broken apart by packages but hopefully it is in a way better. My depth limit = 2.
Read the code for best understanding.
Classes
classAirflowMixin
[source]functionnbx_job_to_airflow_operator
[source]Args: operator (Operator): nbox.Operator object to be converted to Airflow Operator timeout (timedelta, default=None): in how many seconds the operator should timeout
classPrefectMixin
[source]functionfrom_prefect_flow
[source]functionto_prefect_flow
[source]functionfrom_prefect_task
[source]functionto_prefect_task
[source]