This post has been de-listed
It is no longer included in search results and normal feeds (front page, hot posts, subreddit posts, etc). It remains visible only via the author's post history.
18
Best AI model for RTX 3080 10GB for coding?
Post Flair (click to view more posts with a particular flair)
Post Body
I have my local computer set up so I can run a model but I'm struggling to find a model that doesn't use up to much memory.
I have an RTX 3080 10GB and 32gb system ram [soon to be 64gb]
What kind of models should I be looking at? I see 7b, 13b, 30b
And there seems to be a 4bit version of these as well that vastly reduces the size?
My goal is to have it help me learn, review, and deploy code
Any help is appreciated!
Author
Account Strength
100%
Account Age
11 years
Verified Email
Yes
Verified Flair
No
Total Karma
172,890
Link Karma
46,627
Comment Karma
16,892
Profile updated: 2 days ago
Posts updated: 4 months ago
Subreddit
Post Details
We try to extract some basic information from the post title. This is not
always successful or accurate, please use your best judgement and compare
these values to the post title and body for confirmation.
- Posted
- 1 year ago
- Reddit URL
- View post on reddit.com
- External URL
- reddit.com/r/singularity...