rialto.jobs.decorators package

Submodules

rialto.jobs.decorators.decorators module

rialto.jobs.decorators.job_base module

rialto.jobs.decorators.resolver module

rialto.jobs.decorators.test_utils module

Module contents

rialto.jobs.decorators.config_parser(cf_getter: Callable) → Callable

Config parser functions decorator.

Registers a config parsing function into a rialto job prerequisite. You can then request the job via job function arguments.

Parameters:

cf_getter – dataset reader function

Returns:

raw function, unchanged

rialto.jobs.decorators.datasource(ds_getter: Callable) → Callable

Dataset reader functions decorator.

Registers a data-reading function into a rialto job prerequisite. You can then request the job via job function arguments.

Parameters:

ds_getter – dataset reader function

Returns:

raw reader function, unchanged

rialto.jobs.decorators.job(*args, custom_name=None, disable_version=False)

Rialto jobs decorator.

Transforms a python function into a rialto transformation, which can be imported and ran by Rialto Runner. Is mainly used as @job and the function’s name is used, and the outputs get automatic. To override this behavior, use @job(custom_name=XXX, disable_version=True).

Parameters:

• *args –

  list of positional arguments. Empty in case custom_name or disable_version is specified.

• custom_name – str for custom job name.

• disable_version – bool for disabling automatically filling the VERSION column in the job’s outputs.

Returns:

One more job wrapper for run function (if custom name or version override specified). Otherwise, generates Rialto Transformation Type and returns it for in-module registration.