Set is set, and will reduce cast regardless of draw weight. Set is caused by over stressed limbs. A little bit of set (about 1") is good... it lets you know your limbs are not over built and too heavy. 3-4" of set will rob cast. I have many warbows, but one I just finished is a maple backed yew, 90#@30" with <1" of set. I have an older tri-lam warbow, hickory, bamboo, osage... 100#@30" with 4" of set. They both have a physical weight within a few grams of each other, but the yew bow consistently outshoots the tri-lam. I attribute that to set.
Steve Stratton of DIY Archery in the UK has made some very heavy self yew warbows with zero set. I believe he posted one here that was 160#, and it was pipe straight unstrung. Do a search... you'll find it.
But, as Del mentioned, are you talking set, or string follow?