Hi folks. I've been having an issue with some neighbors where they walk up my shared driveway and up the side of my house to get to the street behind it. It requires climbing a maybe 4-5' rock wall.

Now, I was ok with it at first since the previous owner was ok with it, but I don't know their names, they don't say anything, they drop trash, and when we get out of the car strange men constantly appear from behind and just walk by. My wife doesn't feel safe and we have a toddler.

They do not loiter. They don't damage anything, they just scare the hell out of us and the family that shares our driveway. They also have an infant and have two young daughters.

Requests for them to stop is met with, "I can walk where I want" and "I've lived here for 22 years." An HOA lady who does it straight up told us the driveway doesn't belong to us. Well I checked and it does.

My research is telling me there's absolutely nothing I can do but just get over it, but if anyone who is actually familiar with the law and can help me end this ridiculous situation, I'd appreciate it. Even if I'm SOL, I'd like to know for sure.