Contrary to popular opinion, the tree peony is a surprisingly easy shrub to grow, as long as it basic needs are met. The name “tree peony” must be dismissed as an exaggeration since this woody shrub can grow 4 to 5 feet tall and spread an equal distance.