Speed up clang-only link, by really linking only clang, and not the unittests