This post has been de-listed
It is no longer included in search results and normal feeds (front page, hot posts, subreddit posts, etc). It remains visible only via the author's post history.
6
Configurations for Nous-Capybara-limarpv3-34B...
Post Body
I have a 4090 card and using Koboldcpp for loading my LLMs. I was curious if anyone had optimized configurations for Nous-Capybara-limarpv3-34B? I noticed it is running slow (like 2-3 minutes) vs other LLMs which is 2-3 seconds.
Any ideas would be appreciated....
Author
Account Strength
90%
Account Age
10 years
Verified Email
Yes
Verified Flair
No
Total Karma
645
Link Karma
182
Comment Karma
463
Profile updated: 16 hours ago
Posts updated: 6 months ago
Subreddit
Post Details
We try to extract some basic information from the post title. This is not
always successful or accurate, please use your best judgement and compare
these values to the post title and body for confirmation.
- Posted
- 7 months ago
- Reddit URL
- View post on reddit.com
- External URL
- reddit.com/r/LocalLLaMA/...