This post has been de-listed
It is no longer included in search results and normal feeds (front page, hot posts, subreddit posts, etc). It remains visible only via the author's post history.
1
Finetuning Llama3.1-8B
Post Flair (click to view more posts with a particular flair)
Post Body
Hello all
I am trying to Fine-tune llama 3.1-8B on my datasets. But there is an issue with the axolotl/train.py and the config file(I have already made changes to the RoPE part and the upgraded transformers to 4.43.0) that I just cant seem to figure out.
Has anyone successfully finetuned the model using axolotl? If so, please guide me with your approach.
Any help would be appreciated.
Thanks in advance!!
Author
Account Strength
60%
Account Age
3 years
Verified Email
Yes
Verified Flair
No
Total Karma
57
Link Karma
9
Comment Karma
48
Profile updated: 2 days ago
Posts updated: 4 weeks ago
Subreddit
Post Details
We try to extract some basic information from the post title. This is not
always successful or accurate, please use your best judgement and compare
these values to the post title and body for confirmation.
- Posted
- 3 months ago
- Reddit URL
- View post on reddit.com
- External URL
- reddit.com/r/LocalLLaMA/...