Skip to content

Commit

Permalink
Add note about large bag uploads and S3 clients.
Browse files Browse the repository at this point in the history
  • Loading branch information
Nathan Tallman committed Jul 22, 2024
1 parent 3cc3487 commit 2c0b43f
Show file tree
Hide file tree
Showing 2 changed files with 4 additions and 0 deletions.
2 changes: 2 additions & 0 deletions docs/preservation/ingest.md
Original file line number Diff line number Diff line change
Expand Up @@ -20,6 +20,8 @@ If you plan on interacting frequently with S3, the [Minio Client](https://docs.m

For most of what you'll be doing with APTrust, [DART](https://aptrust.github.io/dart-docs/users/getting_started/) and the [APTrust Partner Tools](../partner_tools.md) should be sufficient.

__Note:__ Some members have issues using DART to upload large bags (400GB or larger) because of local networking infrastructure. If you encounter this, we recommend using DART to create bags and using a third-party S3 client (e.g., [CyberDuck](https://cyberduck.io/){:target="_blank"}, [S3 Browser](https://s3browser.com/){:target="_blank"}) to upload them.

## The Ingest Process

!!! warning Delay in ingest
Expand Down
2 changes: 2 additions & 0 deletions docs/quick_start.md
Original file line number Diff line number Diff line change
Expand Up @@ -30,6 +30,8 @@ DART runs on Windows, Mac, and Linux. To install DART and run your first ingest

DART allows you to test test out different bagging and uploading options through a simple point-and-click interface. Once you find the combination that works for you, you can save it as a [Workflow](https://aptrust.github.io/dart-docs/users/workflows/), and then you can run that workflow from within DART, or from the command line. You can also incorporate DART's command-line workflows into larger scripted workflows using languages like Ruby, Python, PHP, JavaScript or even bash shell scripts.

__Note:__ Some members have issues using DART to upload large bags (400GB or larger) because of local networking infrastructure. If you encounter this, we recommend using DART to create bags and using a third-party S3 client (e.g., [CyberDuck](https://cyberduck.io/){:target="_blank"}, [S3 Browser](https://s3browser.com/){:target="_blank"}) to upload them.

### Exporting from Fedora

If your local repository uses Fedora, you can [export APTrust-compliant bags directly from Fedora](https://github.com/fcrepo4-labs/fcrepo-import-export/blob/master/README.md#running-the-importexport-utility-with-a-bagit-support) and then upload them to your receiving bucket for ingest.
Expand Down

0 comments on commit 2c0b43f

Please sign in to comment.