General purpose utils functions
dest
(destination_dataset_table
, prefix_dataset
='tmp'
, return_dataset_only
=False
, return_table_only
=False
)
If AIRFLOW_ENV != PROD
then write results to prefix_dataset
instead.
:param destination_dataset_table: destination to write results to.
:return: destination_dataset_table: destination to write results to with prefix added if needed.
dest_dict
(destination_dataset_table
, prefix_dataset
='tmp'
)
Wrapper for dest()
but to return as dict.
sched
(schedule
:Any
)
If AIRFLOW_ENV != PROD then schedule should be @once
.
:param schedule: schedule for prod.
:return: schedule: schedule
if prod else @once
.