[FastISel][AArch64] Followup commit for 218031 to handle negative offsets too.