Support parallelism so the job finishes faster. Files in the 100s of megabytes can take a while to process, so doing them in series is slow.