The botanical name for sourwood is Oxydendrum arboreum.
You say it doesn't grow like a dogwood. There are tree, shrub and groundcover types of dogwood(Cornus) so it could very well be a dogwood. Where do you live? That can narrow down the possibilities.