Coming soon - Get a detailed view of why an account is flagged as spam!
view details

r/LocalLLaMA

225,575 subscribers

Notice: This subreddit is not actively monitored, so the posts here are only a small subset of what exists on reddit.

Browse by flair

Question | Help Discussion Funny Resources Tutorial | Guide News Other New Model Waiting for Llama 3 Llama 3 llama.cpp Hugging Face Staff
New Top (24hr) Top (Week) Top (Month)
to r/LocalLLaMA by Meowsthicc
2 months ago
Something similar to ChatGPT to use Offline for Coding?
Question | Help
to r/LocalLLaMA by mstahh
1 month ago
Isn't RAG unnecessarily archaic?
Discussion
to r/LocalLLaMA by ninjasaid13
6 months ago
Preview thumbnail for Andrew Ng Defends Open Source AI, Says Regulations Should Focus on Applications image
Andrew Ng Defends Open Source AI, Says Regulations Should Focus on Applications
to r/LocalLLaMA by HadesThrowaway
6 months ago
KoboldCpp 1.67 released - Integrated whisper.cpp and quantized KV cache
Resources
to r/LocalLLaMA by nderstand2grow
6 months ago
Cohere's Command R Plus deserves more love! This model is at the GPT-4 league, and the fact that we can download and run it on our own servers gives me hope about the future of Open-Source/Weight models.
to r/LocalLLaMA by roz303
4 months ago
Anyone get any weird issues using memoir?
Question | Help
to r/LocalLLaMA by ShotSorcerer
7 months ago
Training Llama-3B on Math [What Am I Doing Wrong?]
Question | Help
to r/LocalLLaMA by searcher1k
1 month ago
Preview thumbnail for Salesforce/SFR-Iterative-DPO-LLaMA-3-8B-R · Hugging Face image
Salesforce/SFR-Iterative-DPO-LLaMA-3-8B-R · Hugging Face
New Model
to r/LocalLLaMA by Emcf
8 months ago
AI project gaining traction -- how can I make it friendly for local models?
Question | Help
to r/LocalLLaMA by GreedyWorking1499
7 months ago
How inflated is Llama 3?
Discussion
to r/LocalLLaMA by Confidence_Possible
3 months ago
How do I train a model on our private knowledge base?
Question | Help
to r/LocalLLaMA by whalemor0n
9 months ago
Best practices for constructing query for retrieving relevant nodes (RAG)
Discussion
to r/LocalLLaMA by Mescallan
6 months ago
Has anyone gotten JSON working with Llama.cpp python and Llama 3 8b?
Question | Help
to r/LocalLLaMA by ReadyAndSalted
1 week ago
Rho-1: Not All Tokens Are What You Need. (A very efficient way to train SOTA models)
New Model
to r/LocalLLaMA by GreedyWorking1499
7 months ago
best 7b coding LLM? (java)
Question | Help
to r/LocalLLaMA by SilentCartographer2
3 months ago
Codellama Query
Discussion
to r/LocalLLaMA by leavsssesthrowaway
7 months ago
Maximizing mac LLM performance
Question | Help
to r/LocalLLaMA by noiseinvacuum
6 months ago
Preview thumbnail for Meta’s official response to NTIA request about AI image
Meta’s official response to NTIA request about AI
to r/LocalLLaMA by PeaceCompleted
10 months ago
Preview thumbnail for What is the cause of more and more régulations on Open source AI?? image
What is the cause of more and more régulations on Open source AI??
Discussion
to r/LocalLLaMA by Moravec_Paradox
10 months ago
Preview thumbnail for PSA: The white house executive order on AI is written as "compute capacity of 10^20 INT or FLOPS" so that it naturally expands to cover smaller and smaller players over time as compute improves. image
PSA: The white house executive order on AI is written as "compute capacity of 10^20 INT or FLOPS" so that it naturally expands to cover smaller and smaller players over time as compute improves.
Discussion
to r/LocalLLaMA by Mescallan
6 months ago
LLama cpp on metal switching to CPU/not clearing memory?
Question | Help
to r/LocalLLaMA by Eisenstein
9 months ago
Preview thumbnail for OpenAI GPT-4 vs Groq Mistral-8x7b image
OpenAI GPT-4 vs Groq Mistral-8x7b
Discussion
to r/LocalLLaMA by Mescallan
6 months ago
Guide to configuring Llama.cpp? I just switched and it's 1/10th the speed of ollama
Question | Help
to r/LocalLLaMA by Dry_One_2032
1 week ago
What would you use knowing what you know today to build your own custom LLM with your own data?
Question | Help
to r/LocalLLaMA by dreamyrhodes
6 months ago
Why all AI should be open source and openly available
Discussion