Remove a linear walk to find the default FPU for a given CPU by directly