Example pipelines

Pimlico comes with a number of example pipelines to demonstrate how to use it.

A more extensive set of examples is also provided in the form of test pipelines, which give a small example of the usage of individual core modules and are used as unit tests for the modules.

Available pipelines

• empty_test
• train_tms_example
• custom_module_example
• tokenize_example
• tokenize_example2

Running

To run example pipelines, you can use the script run_example.sh in Pimlico’s example directory, e.g.:

./example_pipeline.sh simple/tokenize.conf status

This will load a single example pipeline from the given config file and show the execution status of the modules.