I've read a lot of examples of these batteries dying but I just wanted to make sure there was nothing I could do before I throw it away.

I cleaned the battery contacts with isopropyl alcohol.

I am able to power on the controller while plugged in without the battery so I know it isn't the cable or controller.

I only have windows, and when I check the battery on the accessories app it says its critical even after charging. It dies shortly after. Using standard AA batteries shows a full charge.

Is there anything else I can do?

If not, what is the best alternative? I would prefer something I can charge through the controller's usb-c port.