Tracy, sourwood is Oxydendrum arboreum. Sonny, that could very well be persimmon. It has rough bark like that, but it's usually a bit more broken up into a squarish blocky structure. Like Pat said, seeing the whole tree would help. Persimmon trees are dioceous, so you would only see fruit remnants on female trees.