Potentially unexpected RDM behavior with automatic file transfers

52 views

Skip to first unread message

Peter Hicks

unread,

Sep 13, 2026, 11:08:56 AM (13 days ago) Sep 13

to A gathering place for the Open Rail Data community

All,

Further to my earlier message about Darwin timetable files, I though it appropriate to point out the unexpected RDM behaviour that led to this.

I have an AWS S3 bucket which receives data products from the RDM. Since it's cheap, I just leave older files in that bucket - it acts as an archive. However, I noticed that for some products, including the Darwin Timetable Files product, the older files are removed from the bucket after a certain time - which is a little annoying as a I consider a long-term store of data as a key part of a platform such as the RDM (others may not).

What is surprising is that even though the new files are being transferred to my S3 bucket, when a file is deleted in the data product, that same file is deleted from my bucket too!

I could change the permissions on my IAM user for RDM such that it can't delete anything in a bucket, but the lack of being able to test this means that I don't know if it's going to break anything else.

I'll report this to RDM Support in due course, but thought it better to let others know about it, because a number of us care about historical archives.