Move the memory fences out of the path for single-threaded mode.