This post has been de-listed
It is no longer included in search results and normal feeds (front page, hot posts, subreddit posts, etc). It remains visible only via the author's post history.
Hi all! My setup is ooba TheBloke_WizardLM-13B-V1-1 SuperHOT-8K-GPTQ Memoir as my only extension running. Not running sillytavern or anything on top of ooba. Memoir's ego and STM/LTM are unchanged.
Chatting with my characters with memoir was definitely a good conversational improvement. However, when I told one of them they're a computer program that uses memoir, the character suddenly becomes incoherent, spouts gibberish, and eventually crashes ooba. I tried it again with another character, same thing. The third character, however, is described as an AI and not some fictional human. This character didn't have any issues when told it was an AI using memoir.
I am NOT implying this is somehow "conscious" (I hate that word) nor is it exhibiting "self awareness" or anything like that. LLMs cannot, and will not, exhibit that kind of behavior. What I'm thinking is that the ego persona is causing some sort of infinite recursion loop, clogging up context and eventually hitting my 3060's memory limit. I've never had this issue before, and it doesn't happen if I don't tell the human characters about memoir.
If you'd like to replicate this yourself, get memoir installed and get a couple human character descriptions. I'd love to see if other people are expericing this too, and what might be going on.
In general, what do you all think might be happening?
Subreddit
Post Details
- Posted
- 8 months ago
- Reddit URL
- View post on reddit.com
- External URL
- reddit.com/r/LocalLLaMA/...