Hello, I'm looking to all my fellow big brain sysadmins for ideas on a solution...

I am in government sector IT and have a few areas in our jurisdictions which ISPs report meeting the FCC guidelines for broadband, however residents within those pockets complain of quality and speeds from that ISP. We're looking to challenge the FCC maps to allow other providers to come in with infrastructure grants to complete fiber to the home for all homes in our jurisdiction which we have minus these cable provider pockets which providers hold the territory and only provide the bare minimum speeds to lock other providers out.

Okay... now for what I'm looking for....

I'm looking for a hardware device which we can have residents plug into their service providers modem which will collect results on ping, jitter, downtimes, and run periodic speed tests.

I'm thinking a PI or or Nuc which can run some software to do this... the question is... which software will do all of this for us?

It can be any operating system, ideally be able to push reports back to us for us to challenge locations and ISPs faster and less purchase on our end as we can move devices faster.