Figured it out! Was trying to change the Filter and save that instead of using the toolbar icon. Oops!
The 'modern' default should probably be hiding completed tasks by default, but allowing users a few seconds to untick them before hiding them away, and prompting users to allow them to 'undo' it.