If the chosen player has four or fewer cards in their hand as Black Vise's ability resolves, the ability just won't do anything that turn.

You choose one opposing player as it enters and it only affects that one player. This choice is not changed even if Black Vise changes controllers. It becomes useless but stays on the battlefield if that player leaves the game.