Inaccessible files in Saltstack S3 repository

[Max Erenberg]

Hello,

I've noticed that some top-level HTML files at
https://s3.repo.saltproject.io no longer appear to be downloadable via the
S3 API. This is the rclone command which I ran, along with the
accompanying output:

$ RCLONE_CONFIG_S3_TYPE=s3 RCLONE_CONFIG_S3_PROVIDER=Other RCLONE_CONFIG_S3_ENV_AUTH=false RCLONE_CONFIG_S3_ENDPOINT=https://s3.repo.saltproject.io rclone sync --fast-list --use-server-modtime -v s3:s3/ ./fullrepo/
2023/04/16 03:38:12 ERROR : 3002.html: Failed to copy: failed to open source object: NoSuchKey: The specified key does not exist.
status code: 404, request id: , host id:
2023/04/16 03:38:12 ERROR : 403.html: Failed to copy: failed to open source object: NoSuchKey: The specified key does not exist.
status code: 404, request id: , host id:
2023/04/16 03:38:12 ERROR : 3003.html: Failed to copy: failed to open source object: NoSuchKey: The specified key does not exist.
status code: 404, request id: , host id:
2023/04/16 03:38:12 ERROR : 3001.html: Failed to copy: failed to open source object: NoSuchKey: The specified key does not exist.
status code: 404, request id: , host id:
2023/04/16 03:38:13 ERROR : index.html: Failed to copy: failed to open source object: NoSuchKey: The specified key does not exist.
status code: 404, request id: , host id:
2023/04/16 03:38:13 INFO  : js/bootbox-min.js: Copied (new)
2023/04/16 03:38:13 INFO  : js/bootstrap.min.js: Copied (new)
...

Using the AWS CLI produces a similar error:

$ AWS_EC2_METADATA_DISABLED=true aws --debug --no-sign-request --endpoint-url https://s3.repo.saltproject.io s3 cp s3://s3/ ./fullrepo/
...
botocore.exceptions.ClientError: An error occurred (404) when calling the HeadObject operation: Key "3003.html" does not exist
...

These HTML files are listable (e.g. via `rclone tree`), but for some
reason they cannot be downloaded using the S3 API. Our last successful

sync occurred on April 6, which coincides with the last modified time

of 3003.html.

--
Max Erenberg
Systems Committee
Computer Science Club of the University of Waterloo