Eddie, usually leather dye, once dried won't rub off. Maybe the neatsfoot oil is causing it. There is a product that Tandy's sells called Resonol, I think that is a clear acrylic finish for leather. Only problem with it is it is shiny. Maybe water based satin poly would work but do a test first. Be sure any excess oil has been removed first.