Do bucket access preflight before local processing #16

Merged
vlw merged 2 commits from refs/pull/16/head into master 2026-07-05 14:48:03 +02:00
vlw commented 2026-07-05 14:14:54 +02:00 (Migrated from codeberg.org)

This PR makes a pre-flight check to confirm bucket access permissions before starting any actual processing. Depending on the AWS authorization used, for example, sessions can time out while the archive is being created. This check prevents these expensive IO operations from being performed if there is an issue accessing the bucket at the start of a run.

We can not determine if a timeout occurred while still archiving since we have not implemented multi-threading (yet).

This PR makes a pre-flight check to confirm bucket access permissions before starting any actual processing. Depending on the AWS authorization used, for example, sessions can time out while the archive is being created. This check prevents these expensive IO operations from being performed if there is an issue accessing the bucket _at the start of a run._ We can not determine if a timeout occurred while still archiving since we have not implemented multi-threading (yet).
Sign in to join this conversation.
No reviewers
No milestone
No project
No assignees
1 participant
Notifications
Due date
The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set.

Reference
vlw/3rd!16
No description provided.