This issue follows from https://github.com/jenkinsci/folder-auth-plugin/pull/3 and JENKINS-58485 . The Folder Authorization Strategy needs to be immutable and a new object should be set whenever any modification is made to the roles.
See: https://github.com/jenkinsci/folder-auth-plugin/pull/19