U.S. assets are set to suffer in the long run as investors consider the “psychological” impacts of the U.S. travel ban.