It’d be fair to just keep paying the same compensation you received before moving; you could still move, but you’d have to pay the price.
And yeah, there are still a lot of problems with this approach as long as housing is left to market forces. But those problems are inherent to free markets, not to this possible solution to another problem.