userfaultfd: don't block on the last VM updates at exit time