selinux: reduce the number of calls to synchronize_net() when flushing caches