That is absolutely correct. The atmosphere is held in place, so to speak, by gravity. It is also spinning along with the earth. Some of the atmosphere is lost to outer space at a regular rate and again replenished by natural processes that are beyond the scope of your question.
What’s more interesting is the atmosphere is pressurized at a decreasing gradient the closer it gets to outer space thereby relinquishing the idea that a container is necessary to house all of our atmosphere. (I watch a lot of flat earth videos for funzies.)