Overview
How fine-tuning works in Predibase
Fine-tuning is the process of adapting a pre-trained model to a specific task or domain. Predibase supports fine-tuning via the UI and Python SDK.
Upload a Dataset
The first step in fine-tuning is to upload a Dataset that contains examples of the task you want the model to learn. You may also upload a dataset using the UI.
Create an Adapter
The next step is to create an Adapter — a small set of auxiliary parameters that are added to the base model to learn the specific task.
Prompt your Adapter
Once you have a fine-tuned adapter (or even during training, once you have a checkpoint), you can prompt your adapter using an existing deployment of the same base model to spot-check its quality. Shared endpoints are available for quick testing without needing to first create a private deployment.
Evaluate your Adapter
Before going to production, you may want to Evaluate your adapter to ensure it meets the desired response quality.
Create a Production Deployment
When you’re ready to serve your fine-tuned adapter in production, create a Private Deployment.
Note that you are creating a base model deployment which supports multi-LoRA, meaning your newly trained adapter
and any other adapters, can be prompted by specifying the adapter_id
in the generate
function.