From 2c0b43f97c05d9630a507f85ef55705ae90d30e0 Mon Sep 17 00:00:00 2001 From: Nathan Tallman Date: Mon, 22 Jul 2024 11:50:28 -0400 Subject: [PATCH] Add note about large bag uploads and S3 clients. --- docs/preservation/ingest.md | 2 ++ docs/quick_start.md | 2 ++ 2 files changed, 4 insertions(+) diff --git a/docs/preservation/ingest.md b/docs/preservation/ingest.md index 8b5c8d1..9f55135 100644 --- a/docs/preservation/ingest.md +++ b/docs/preservation/ingest.md @@ -20,6 +20,8 @@ If you plan on interacting frequently with S3, the [Minio Client](https://docs.m For most of what you'll be doing with APTrust, [DART](https://aptrust.github.io/dart-docs/users/getting_started/) and the [APTrust Partner Tools](../partner_tools.md) should be sufficient. +__Note:__ Some members have issues using DART to upload large bags (400GB or larger) because of local networking infrastructure. If you encounter this, we recommend using DART to create bags and using a third-party S3 client (e.g., [CyberDuck](https://cyberduck.io/){:target="_blank"}, [S3 Browser](https://s3browser.com/){:target="_blank"}) to upload them. + ## The Ingest Process !!! warning Delay in ingest diff --git a/docs/quick_start.md b/docs/quick_start.md index 4b3fb3e..6f03a00 100644 --- a/docs/quick_start.md +++ b/docs/quick_start.md @@ -30,6 +30,8 @@ DART runs on Windows, Mac, and Linux. To install DART and run your first ingest DART allows you to test test out different bagging and uploading options through a simple point-and-click interface. Once you find the combination that works for you, you can save it as a [Workflow](https://aptrust.github.io/dart-docs/users/workflows/), and then you can run that workflow from within DART, or from the command line. You can also incorporate DART's command-line workflows into larger scripted workflows using languages like Ruby, Python, PHP, JavaScript or even bash shell scripts. +__Note:__ Some members have issues using DART to upload large bags (400GB or larger) because of local networking infrastructure. If you encounter this, we recommend using DART to create bags and using a third-party S3 client (e.g., [CyberDuck](https://cyberduck.io/){:target="_blank"}, [S3 Browser](https://s3browser.com/){:target="_blank"}) to upload them. + ### Exporting from Fedora If your local repository uses Fedora, you can [export APTrust-compliant bags directly from Fedora](https://github.com/fcrepo4-labs/fcrepo-import-export/blob/master/README.md#running-the-importexport-utility-with-a-bagit-support) and then upload them to your receiving bucket for ingest.