Vance said "in some ways it could be worse" after stocks posted their worst day since 2020 in response to Trump's tariffs.