Eliminate redundant bitwise operations when using a llvm/ADT/PointerUnion.