What do you mean by ‘server restart’?
These are mysqladmin commands, right? Restarting the server or ‘flushing the privileges’ are needed because changes have been made to user accounts, but ‘clients’ accessing the database server are in some ‘outdated memory’ mode?