Revert "rk312x: set clk_ignore_unused = true"