How do I keep my fence from settling so much?

I’m in Austin Texas. We installed a fence three years ago and the posts between the gate door have shifted about four inches. This makes closing the door a pain in the ass, as the latch quickly becomes misaligned. A few times a year I move the latch bracket down to align it with the other part of the latch. My fence post is...