KVM: fix crash on irqfd deassign