Hi community, I created a fork of microsoft's guidance and added llama-cpp-python support!

This post has been de-listed

It is no longer included in search results and normal feeds (front page, hot posts, subreddit posts, etc). It remains visible only via the author's post history.

Post Flair (click to view more posts with a particular flair)

Resources

Post Body

As I said in the title, I forked guidance and added llama-cpp-python support.

Here is the result of the RPG Character example with Manticore-13B:

The following is a character profile for an RPG game in JSON format.

```json

{

"id": "e1f491f7-7ab8-4dac-8c20-c92b5e7d883d",

"description": "A quick and nimble fighter.",

"name": "Katana",

"age": 26,

"armor": "leather",

"weapon": "sword",

"class": "fighter",

"mantra": "I am the sword of justice.",

"strength": 10,

"items": ["a katana", "a leather jacket", "a backpack", "traveler's rations", "water bottle"]

}```

Here is the fork:

https://github.com/Maximilian-Winter/guidance

Author

Account Strength

60%

Account Age

2 years

Verified Email

Yes

Verified Flair

Total Karma

675

Link Karma

441

Comment Karma

214

Profile updated: 4 days ago

Posts updated: 1 year ago

FlowerPotTeaTime

Subreddit

r/LocalLLaMA

Post Details

We try to extract some basic information from the post title. This is not always successful or accurate, please use your best judgement and compare these values to the post title and body for confirmation.

Posted: 1 year ago
Reddit URL: View post on reddit.com
External URL: reddit.com/r/LocalLLaMA/...