Trees grow. Some grow really big. It is hard to imagine a metre-high stick as a monster higher than a two-storey building, but it is amazing how quickly it happens.
If you plan to be on your block in 20 years (and even if you don’t), you don’t want big trees where they will block views, shade the house, crowd each other, or grow into power lines. I also don’t recommend having a long-term plan that involves thinning for firewood or chainsawing down big trees when you are 65 (I’m looking at you, members of the eucalypt family).
Plant with a mental picture of the eventual size of your tree. This can be hard. Information online can be conflicting, usually because trees grow differently in different climates.
I personally enjoy going to arboretums and gardens and getting an idea of the eventual shape and size of a tree. I then hold that image in my head when planting out my little twigs. Already some of them are starting to live up to their potential.