State.checkpoint.cleanup#
- State.checkpoint.cleanup()#
Remove intermediate checkpoints from pipeline.
These are the steps to clean up:
Open main pipeline if not already open (it may be closed if running with multiprocessing),
Create a new single-checkpoint pipeline file with the latest version of all checkpointed tables,
Delete the original main pipeline and any subprocess pipelines
This method is generally called at the end of a successful model run, as it removes the intermediate checkpoint files.
Called if cleanup_pipeline_after_run setting is True