serial: core: remove baud_rates when serial console setup