I'm playing in a campaign with some thematic house rules which I didn't really understand/consider properly. Basically it's a magic poor world and spellcasters suffer a spell-chance failure for high level spells. In a few levels (I'm Lore Bard 5) I will have access to 4th level spells, but if I cast them, then I do so at a 40% chance of failure. This makes having 4th level spells seem sort of pointless to me.

Currently my plan is to get to Lore Bard 6 (to get Additional Magical Secrets up to 3rd level), and then bail on the class. It seems to me (correct me if I'm wrong) that the benefits of almost any other class are going to outweigh an only 60% chance to use my upper-level spells while still holding onto my lower level spells. Again, tell me if I am under-estimating the non-spell abilities of the Bard.

So, I'll be a Lore Bard 6, optimized for deception/persuasion stuff (Charlatan Background, Actor Feat). Where should I go?

Mastermind Rogue? Hexblade Warlock (I run into the spell problem again, but not for 6 levels)? Bardbarian (if I can convince my DM how/why)?