Swift attack is often pinned as an option that's too good to not use every time you've got the chance. And given the core rules, Swift attack is an option almost all the time. So people have tried to make Swift attack worse, or other options better, until "balance" is achieved.

What about doing it the other way around. Keep Swift attack as the holy grail! Make your players love when they get to attack the monster three times without penalty. BUT ... make it inaccessible per default, or a great risk. For example, only make Swift attack available once you've maneuvered into an advantage. If you've surprised your opponent, if they have fallen to the ground or are stunned. Otherwise, add a penalty similar to that of "All-Out-Attack": press a swift attack once by giving the opponent an opening to attack you (no dodge/parry).