[FunctionAttrs] Make the per-function attribute inference a boring