arm64: init: Move of_clk_init to time_init