Its moreso commonly agreed that pulling the lever and saying the 5 lives is worth taking action and diverting the trolley and killing the one.

However, something I've just considered that... some how ive NEVER seen brought up before, or even though about myself.

Is that, by pulling the lever, and diverting the trolley, I am now sending that trolley down an unscheduled path, meaning I could have just caused more needless deaths, what if it collides with a stopped trolley, or one thats at the gate getting passengers, etc.

Having a trolley suddenly going down a track off schedule could induce a ton of issues as a result. And as such, gives merit to the idea of not taking action, and letting the 5 die.