Generally in trees you have the xylem in the middle which transports water and minerals from the roots to the rest of the plant. You have the phloem on the outside, it transports photosynthetic products and nutrients to all parts of the plant. The cambium where growth happens sits between them, because there they get easy access to water minerals and nutrients. The xylem is a mix of living and dead cells. The tracheids and vessel elements in the xylem, which are responsible for water transport, are dead at maturity. So it’s probably too hard to move them to grow from the inside out for trees. This whole process of growing thicker is called secondary growth as opposed to primary growth at the tips of stems and roots.
Also if were the other way around and trees would grow from the inside out, you’d have to have vessels going from the leaves to the center of the stems to deliver nutrients, which just complicates everything. And the tree wanted to grow from the inside by 1cm, every “ring” in the xylem would have to grow one centimeter longer in circumference or crack. It’s much easier to just add a layer on the outside. Also having living layer around the tree probably helps it defend itself from pathogens. If all the mostly dead woody stuff was on the outside fungi etc would have an easier time invading, I think.