You will limit yourself to a fraction of the Camanos for sale and may not save any money if you only look at owner represented boats.
I agree that brokers, particularly Florida brokers are a PITA to deal with, but probably no worse than owners in representing the boat accurately.
I have bought two boats myselsf through Florida brokers and sold one as a Maryland broker myself working with a Florida broker and I must say two out of the three experiences were bad. There is something about the culture there that makes brokers arrogant, untruthful, etc.
But have patience, keep your eyes open and don't believe it unless you see it when dealing with Florida brokers. But they do represent a lot of boats.