ASoC: Prevent pop_wait overwrite