[ptr-traits] Refactor how PointerIntPair does its pointer manipulation