Yeah, you are thinking of another plant like DC said.
Horseweed(Conyza canadensis) is a perennial weed that dies back to the ground each winter but comes back from the crown each spring.
Horse tail, aka scouring rush(Equisetum arvense) is the tube like plant you described that has lots of silica in it and is used as sandpaper sometimes.
Google horseweed. You may have it in your area and you could harvest it next fall for arrows.