Fine Tune Models With AutoTrain from HuggingFace
Fine tuning an AI model gives you the opportunity to add additional training data to the model. Workers AI allows for Low-Rank Adaptation, LoRA, adapters that will allow you to finetune our models.
In this tutorial, we will explore how to create our own LoRAs. We will focus on LLM Finetuning using AutoTrain ↗.
Start by creating a CSV, Comma Separated Values, file. This file will only have one column named text. Set the header by adding the word text on a line by itself.
Now you need to figure out what you want to add to your model.
Example formats are below:
### Human: What is the meaning of life? ### Assistant: 42.If your training row contains newlines, you should wrap it with quotes.
"human: What is the meaning of life? \n bot: 42."Different models, like Mistral, will provide a specific chat template/instruction format ↗
<s>[INST] What is the meaning of life? [/INST] 42</s>Open the HuggingFace Autotrain Advanced Notebook ↗
In order to give your AutoTrain ample memory, you will need to need to choose a different Runtime. From the menu at the top of the Notebook choose Runtime > Change Runtime Type. Choose A100.
The notebook contains a few interactive sections that we will need to change.
Modify the following fields
- project_name: Choose a descriptive name for you to remember later
- model_name: Choose from the one of the official HuggingFace base models that we support:
mistralai/Mistral-7B-Instruct-v0.2google/gemma-2b-itgoogle/gemma-7b-itmeta-llama/llama-2-7b-chat-hf
Although not required to use AutoTrain, creating a HuggingFace account ↗ will help you keep your finetune artifacts in a handy repository for you to refer to later.
If you do not perform the HuggingFace setup you can still download your files from the Notebook.
Follow the instructions in the notebook ↗ to create an account and token if necessary.
We only need to change a few of these fields to ensure things work on Cloudflare Workers AI.
- quantization: Change the drop down to
none - lora-r: Change the value to
8
Notebooks have a folder structure which you can access by clicking the folder icon on the left hand navigation bar.
Create a folder named data.
You can drag your CSV file into the notebook.
Ensure that it is named train.csv
In the Notebook menu, choose Runtime > Run All.
It will run through each cell of the notebook, first doing installations, then configuring and running your AutoTrain session.
This might take some time depending on the size of your train.csv file.
If you encounter the following error, it is caused by an Out of Memory error. You might want to change your runtime to a bigger GPU backend.
subprocess.CalledProcessError: Command '['/usr/bin/python3', '-m', 'autotrain.trainers.clm', '--training_config', 'blog-instruct/training_params.json']' died with <Signals.SIGKILL: 9>.If you pushed to HuggingFace you will find your new model card that you named in project_name above. Your model card is private by default. Navigate to the files and download the files listed below.
In your Notebook you can also find the needed files. A new folder that matches your project_name will be there.
Download the following files:
adapter_model.safetensorsadapter_config.json
You need to add one line to your adapter_config.json that you downloaded.
"model_type": "mistral"
Where model_type is the architecture. Current valid values are mistral, gemma, and llama.
Now that you have your files, you can add them to your account.
You can either use the REST API or Wrangler.
After you have your new fine tune all set up, you are ready to put it to use in your inference requests.