Many vacancy taxes already exist all around the world. There is not a single one that taxes normal short vacancies. It is just false that this increases costs for all landlords. The vast VAST majority of landlords will never pay it.
On the other hand, the increase in supply due to the tax can be noticeable, which has a much bigger effect lowering prices.