This post has been de-listed
It is no longer included in search results and normal feeds (front page, hot posts, subreddit posts, etc). It remains visible only via the author's post history.
1
Utilize my current hardware or upgrade?
Post Body
I've got a 3070 with 8gb VRAM and 32gb RAM. I want to be able to run 13b or even 30b models.
With the new ways to load models and offload to GPU, should I look at just upgrading my ram to 80GB or upgrade GPU to 4070 12gb? I don't have the budget to get a 4090.
Author
Account Strength
100%
Account Age
12 years
Verified Email
Yes
Verified Flair
No
Total Karma
6,199
Link Karma
2,322
Comment Karma
3,877
Profile updated: 5 hours ago
Posts updated: 19 hours ago
Subreddit
Post Details
We try to extract some basic information from the post title. This is not
always successful or accurate, please use your best judgement and compare
these values to the post title and body for confirmation.
- Posted
- 1 year ago
- Reddit URL
- View post on reddit.com
- External URL
- reddit.com/r/LocalLLaMA/...