Skip to content

Cleanup Calibration datasets to (temporarily) reduce chain bandwidth pressure before GA #411

@BigLep

Description

@BigLep

Done Criteria

~50% of the ~11k datasets on calibration as of 2026-02-03 are deleted.

Why Important

  1. Reduce the strain on Calibration as discussed in Audit impact of increasing DEFAULT_MAX_PROVING_PERIOD on Calibnet #409
  2. Helps validate that users can self-service delete their datasets and pieces

Notes

  1. Some quick analysis should be done to see the top creator of datasets to ensure that cleaning up dealbot and loadtests will get us the headroom we are looking for.
  2. We don't just want to terminate datasets as termination results in 30 more days of proving by default. We want to also delete pieces.
  3. The suggested set of actions would be: - List all datasets
    • For each dataset
      • List all pieces
      • Delete each piece
      • Terminate the dataset
  4. filecoin-pin already has rm --piece functionality per Add rm --piece $pieceCid command filecoin-project/filecoin-pin#8. Terminating datasets is in progress with Add data-set $dataSetId --terminate filecoin-project/filecoin-pin#189. Those should be the key things someone needs to script the above. Bonus if someone wants to create a rm --dataset to do all of the above in one command.

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    Status

    🐱 Todo

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions