Serving
Keeping a fine-tuned model portable
How do I make sure I can move a fine-tuned model to another provider?
Keep three things: the weights, the exact base model and version they were trained against, and the dataset. With those you can rebuild or relocate anywhere. Serving on an OpenAI-compatible interface makes the client side a base URL change.
Three artefacts, not one
People think portability means having the weights. It means having the weights, knowing exactly which base model and version they apply to, and still holding the dataset that produced them.
An adapter without its base pairing is close to useless — applied to a different version it produces degraded or nonsensical output, and nothing in the file format warns you. The dataset is the insurance: with it you can rebuild even if the rest is lost.
Record the pairing where it will survive
A generated model card recording base model, version, template, hyperparameters and final metrics is the right container, because it travels with the weights rather than living in someone’s memory or a wiki page that gets archived.
This is the main practical reason to keep the card alongside the model rather than treating it as documentation for other people.
The client side is a base URL
Serving on the OpenAI chat-completions shape means moving providers is a base URL and a key. Chat completions, streaming and tool calling all use the same request and response objects, so application code does not change.
Compatibility is a spectrum at the edges — log probabilities and some structured-output modes vary. Check the specific features your client depends on rather than assuming the whole surface transfers.
Publish privately as a backstop
Pushing a finished model to a private hub repository puts a copy somewhere the training platform does not control. It costs nothing, it is not public, and it means an account problem is an inconvenience rather than a loss.
Test it before you need it
Portability that has never been exercised is a claim. Download a model, load it somewhere else, and confirm it produces the output you expect — once, deliberately, while nothing is on fire.
The most common thing this exercise uncovers is that nobody recorded the base model version.
Frequently asked questions
Should I merge the adapter for portability?
A merged model is easier to hand to third-party tooling and removes the pairing problem entirely. The cost is that it can no longer share serving capacity with siblings. Keeping both is cheap.
Does the base model licence follow the fine-tune?
Yes. A derivative inherits the base model’s terms, and they pass to anyone you give it to. Check naming requirements and revenue thresholds before publishing rather than after.
Terms used here
More on serving
Last verified 6 August 2026.
Start with the free tier
A magic link creates your account, your tenant and your first API key. No card until you ask for compute.