Skip caching facts for specific hosts

[Anjana Raghavendra P]

I run ansible playbooks on multiple servers as controller servers and now want to start using the cache plugin. As each controller server is "localhost" for playbook, the facts captured by one controller server are getting replaced by another server making the cache data not usable. So, checking to see if I can skip caching of facts when the hostname is localhost. Is it possible in current ansible?