[Update] I found it! It's this: https://animevoiceover.fandom.com/wiki/YuYu_Hakusho:_Opening_and_Ending_Encyclopedia

I got a handful of old VHS tapes from back in the day, and this is on a tape that was clearly copied over. So no box or anything to help me identify it. Popped it in my VCR (I know, yes, I still own one, lol) and it seems to be entirely in Japanese with no subtitles, and it's the opening/closing sequences but clean (so no credits, subtitles, etc) with little vignettes in between explaining some of the characters. One scene is Yusuke cooking at a noodle shop and Kuwabara, Botan and Keiko eating there, one is a flashback to how Yusuke "died" saving the kid, etc.

The hand written label just says "Yu Yu Hakusho White Tape."

Any idea what this is?