Create your own datasets for fine-tuning
When fine-tuning, you need to provide data to your model.
10 docs tagged with "Fine-Tuning"
View All TagsFine-tuning
See also
Fine-tuning all the weights of a model
Is it possible to fine-tune all the weights of a model when training ?
How do you fine-tune a model using peft
Let's say you have a model variable containing your model as seen in
How to repurpose networks without fine-tuning
Let's say you can a neural network that generates code, but you want to use it
Preparing a model for PEFT
Let's start by importing the relevant peft function we'll need.
QLoRA
Source
Saving PEFT models
Once your model is trained you need to save it to not lose the hours of
Understanding Code with Open AI
Goal: Determine which model to use for bam.AI
Using QLora to fine-tune a model
https://github.com/artidoro/qlora