You choose whether to add or remove counters as the ability resolves. If the permanent has multiple kinds of counters, you don't have to make the same choice for each kind.