Only do stuff for the REAL number of physical registers we have, not 1024.