Ok, well after a little more research and thinking, I am leaning towards hazelnut.  I looked at some photos and the leaves look like what j think I saw in the summer.  More than that hazelnut makes more sense to me as it was planted in the orchard and every tree there is either a fruit or nut tree.  Are hazel nut trees either male or female or does every tree produce nuts?  Thanks for the help.
Kip