flowbber.pipeline

Base class for Flowbber pipeline.

Classes

class flowbber.pipeline.Pipeline(pipeline, name, app='flowbber', save_journal=True)

Pipeline executor class.

This class will fetch all components from locally declared components and entrypoint plugins, create instance of all of them and execute the pipeline in order, creating subprocesses when needed.

Execution of the pipeline is registered in a journal that is returned and / or saved when the execution of the pipeline ends.

Parameters
  • pipeline (dict) – A pipeline definition data structure.
  • name (str) – Name of the pipeline. Used only for pretty printing only.
  • app (str) – Name of the application running the pipeline. This name is used mainly to set the process name and the journals directory.
  • save_journal (bool) – Save the journal to a temporal location when the pipeline execution ends.

Inheritance

Inheritance diagram of Pipeline

executed

Number of times this pipeline has been executed.

name

Name of this pipeline.

run()

Execute pipeline.

This method can be called several times after instantiating the pipeline.

Returns
The journal of the execution.
Return type
dict