sdhci-of: cleanup eSDHC's set_clock() a little bit