Move address caching logic from AsyncSSLSocket to AsyncSocket.