spi: spi-fsl-dspi: Drop extra spi_master_put in device remove function