Why Fine-Tune?
Fine-tuning is a great tool to reach for when basic prompting and context engineering fall short. You may need to fine-tune when:- Quality is critical and the model isnβt consistently producing correct outputs.
- Proprietary Data gives you a unique advantage that generic models canβt capture.
- Latency is a deal breaker and you need real-time responses.
- Throughput limitations are bottlenecking your applicationβs scalability.
- Ownership of the model is important and you want to control your own destiny.
- Cost if a foundation model is too expensive for your use case or you want to deploy a smaller model to the edge.
Modalities
Oxen.ai supports many data types and tasks for fine-tuning.Text Generation
Fine-tune a model to take a user input as text and generate a single response as text.
Chat Completions
Fine-tune a model on chat messages to have a conversation with a user.
Image Generation
Fine-tune a model to go from text descriptions to images.
Image Editing
Fine-tune a model to take a prompt and a reference image and generate a new image.
Video Generation
Fine-tune a model to take in a prompt and generate a video.
Start by Uploading a Dataset
To get started, youβll need to create a new repository on Oxen.ai. Once youβve created a repository, you can upload your data. The dataset can be in any tabular format includingcsv, jsonl, or parquet.
Once you have your dataset uploaded, you can query, explore, and make sure that the data is high quality before kicking off the fine-tuning process. Your model will only be as good as the data you train it on.
When you feel confident that your dataset is ready, use the βActionsβ button to select the model you want to fine-tune.
Selecting a Model
This will take you to a form where you can select the model you want to fine-tune and the columns you want to use for the fine-tuning process. We support fine-tuning for text generation, image generation, image editing, and video generation with a variety of models.If you want support for any specific models, data formats, training methods contact us at hello@oxen.ai and we are happy to help you get started. We are actively working on support for new models and distributed training.
Monitoring the Fine-Tune
Once you have started the fine-tuning process, you can monitor its progress. The dashboard will show you loss over time and token accuracy processed. If you are fine-tuning an image or video generation model, you can view the generated images or videos in the βSamplesβ tab to get a feel for the modelβs performance. Click on the βInfoβ tab to see the fine-tuning configuration and all the hyper-parameters used. This will include a link to the dataset version you used and the raw model weights for downloading and running locally.Deploying the Model
Once the model is fine-tuned, you can deploy it to a dedicated endpoint or in the playground. This will give you a/ai/chat/completions api and a playground that you can use to test out the model.
Start by using the βplaygroudβ button.
if the model is not loaded youβll see an βinactiveβ button on the top right of the playgroud.
use the activate button to load the model.
To use the API Swap out the model name with the name of the model you want to use.