Amazon S3 connection

42 views
Skip to first unread message

Jon Lewis

unread,
Apr 27, 2026, 1:37:48 PM (4 days ago) Apr 27
to A gathering place for the Open Rail Data community
Hi all, hopefully an easy one.

I'm trying to set up automatic file transfers to an AWS S3 bucket.  The file transfers page advises to setup the Bucket permissions/policy with the aws credentials (I assume of RDM) as follows

```
"Principal": { "AWS": "arn:aws:iam::<XXXXXXXXXXXX>:user/<XXXXXXXXXXX>" },
```

Where on earth (well in RDM) do i find what those XXXXs should be?

Any help greatly appreciated

Peter Hicks

unread,
Apr 27, 2026, 1:44:08 PM (4 days ago) Apr 27
to openrail...@googlegroups.com
Hi Jon

On Monday, 27 April 2026 at 18:37, Jon Lewis <jon...@jonnus.co.uk> wrote:

I'm trying to set up automatic file transfers to an AWS S3 bucket. The file transfers page advises to setup the Bucket permissions/policy with the aws credentials (I assume of RDM) as follows

```
"Principal": { "AWS": "arn:aws:iam::<XXXXXXXXXXXX>:user/<XXXXXXXXXXX>" },
```

Where on earth (well in RDM) do i find what those XXXXs should be?

The first one is your AWS account number - if you log in to the AWS console, it will either show up in the top right, or you can click the down-arrow and copy the Account ID.  Ignore the dashes though.  The second is the name of the IAM user you've set up.

You don't set these in the RDM - you set them in a policy within IAM in your AWS account.

If you're struggling to set this up, I'd make a suggestion that you set up an SFTP server and have RDM push files to you that way.  It's much more visible than pushing to a bucket, and so much easier to troubleshoot.


Peter

Marks Polakovs

unread,
Apr 27, 2026, 1:46:33 PM (4 days ago) Apr 27
to openrail...@googlegroups.com
RDM works by having you create a "User" (in AWS parlance) in your AWS account and then giving its access/secret keys to RDM. It then authenticates to AWS as that user and uses it to push to the bucket. Thus when setting up the bucket's permissions, use the details of the user you just created - nothing RDM-specific. When you create the user in the AWS console you can just copy its ARN - example from mine:

image.png

Hope this helps!
Marks

--
You received this message because you are subscribed to the Google Groups "A gathering place for the Open Rail Data community" group.
To unsubscribe from this group and stop receiving emails from it, send an email to openraildata-t...@googlegroups.com.
To view this discussion, visit https://groups.google.com/d/msgid/openraildata-talk/5ef447f7-2631-4825-ac35-ca0d13087dd3n%40googlegroups.com.

Jon Lewis

unread,
Apr 27, 2026, 2:02:25 PM (4 days ago) Apr 27
to A gathering place for the Open Rail Data community
Thanks for the quick response guys.  I'll give this a go (I've already set up the IAM user), and keep my fingers crossed magic happens overnight.

Seb Dazeley

unread,
Apr 27, 2026, 2:13:28 PM (4 days ago) Apr 27
to openrail...@googlegroups.com
Jon

Once you add the destination it transfers a file called Test-File-Transfer.txt (I use SFTP, but the file mentions IAM, they must use the same text for SFTP).

I don't know if it will transfer if you add the file destination from a data product. I added it from Manage > My file transfers. 

You might have noticed my recent thread here on missing timetable files; hopefully this doesn't happen to you. 

Seb
Reply all
Reply to author
Forward
0 new messages