flowbber.pipeline

Base class for Flowbber pipeline.

Classes

• Pipeline: Pipeline executor class.

class flowbber.pipeline.Pipeline(pipeline, name, app='flowbber')

Pipeline executor class.

This class will fetch all components from locally declared components and entrypoint plugins, create instance of all of them and execute the pipeline in order, creating subprocesses when needed.

Execution of the pipeline is registered in a journal that is returned and / or saved when the execution of the pipeline ends.

Parameters

• pipeline (dict) – A pipeline definition data structure.
• name (str) – Name of the pipeline. Used only for pretty printing only.
• app (str) – Name of the application running the pipeline. This name is used mainly to set the process name and the journals directory.

Inheritance

executed

Number of times this pipeline has been executed.

name

Name of this pipeline.

run()

Execute pipeline.

This method can be called several times after instantiating the pipeline.

Returns

The journal of the execution.

Return type

dict