Migrate tar files with deeply nested paths in tar
Created by: charlesbrandt
Existing tar files (previously archived to ~2024.08.30) will continue to have deeply nested paths in them. This issue has been fixed in https://github.com/IUSCA/bioloop/pull/264
To mitigate, download each tar file, extract and recreate using the new process.
- if file transfer is interrupted, don't want incomplete data on the SDA
- upload to a different name, then rename on SDA (instant)
- rerun validate process
re-tar will create a new tar file that will need to be updated in the db this should be a workflow so it can be tracked through portal