Found the thing that rockimtn suggested. It would work in theory, but in practice it's too long and there's not enough room for the straddle wire to move.
I flipped the bracket I have fitted over, and again the same issue, no room for cable pull. Looks like I may need another solution or v brakes.