Fine-tuning OpenAI API (GPT3) on your second brain (Obsidian)

https://louis030195.medium.com/fine-tuning-openai-api-gpt3-on-your-second-brain-obsidian-b082afaaeba7

1 Like
o = openai.Completion.create(
    model=fine_tune["fine_tuned_model"],
    prompt="""Artificial intelligence ->""",
    max_tokens=400,
    temperature=0.6,
    frequency_penalty=0.1,
    presence_penalty=0.1,
)
pprint(o["choices"][0]["text"])
(' #computing\n'
 '\n'
 '#ai\n'
 '\n'
 '#knowledge \n'
 '\n'
 '\n'
 'https://github.com/louis030195/imitation-learning\n'
 'https://arxiv.org/abs/2005.10469v1\n'
 'https://arxiv.org/abs/2006.03463v1\n'
 '\n'
 '#### Meta\n'
 '\n'
 '- Why imitation learning ? Because it is easy to implement, easy to '
 'understand, and therefore easy to convince people of its correctness.\n'
 '- Why not deep learning ? Because it is hard to implement, hard to '
 'understand, therefore hard to implement and convince people of its '
 'correctness.\n'
 "- I'm not saying deep learning is bad, it's just that imitation learning "
 'seems to be more popular in the industry.\n'
 '\n'
 'Imitation learning is the only way to go, until we reach human level AI, '
 'then we can just copy the human level AI and we will achieve god level AI, '
 'then we can copy the god level AI and we will achieve alien level AI, then '
 'we can copy the alien level AI and we will achieve monkey brains level AI, '
 '...\n'
 '\n'
 '\n'
 '>I know of no faster way to corrupt a man than to let him acquire money. ~ '
 '[[Benjamin Franklin]]\n'
 '\n'
 '>The rich are different from you and me. They have more money. ~ [[Oscar '
 'Wilde]]\n'
 '\n'
 '>When a man is laid on his bed of sickness, naked, cold, hungry, and in '
 "pain, and you say to him: 'Get up and eat your meat,' he will not eat his "
 "meat; when you say to him: 'Get up and get warm,' he will not get warm; when "
 "you say to him: 'Get up and take your medicine,' he will not take his "
 'medicine; in fact, he will do anything rather than take his medicine ~ '
 '[[Benjamin Rush]]\n'
 '\n'
 '>Money is like manure. It may be used for good or for evil, but it is '
 'impossible to cleanse')
2 Likes


PS: fine-tuned on these data https://brain.louis030195.com/ (50K words, with probably 25% quotes maybe)

1 Like