onrup

Catalogue

43 models you can fine-tune.

Which models can I fine-tune on Onrup?

43 open-weight base models across 12 families, from 350M to 117B parameters. Each one lists the memory it needs for half-precision and four-bit training, which objectives it supports, its licence, and the cheapest GPU class that will run it.

The catalogue is curated rather than open. That is a real constraint and worth checking before you plan a migration: if your base model is not here, this is not the right platform for it.

Memory figures are admission thresholds — the point below which a run will not be scheduled because it would fail. They are deliberately conservative and are not a claim about the theoretical minimum.

SmolLM

Hugging Face

Small models trained on an unusually large token budget for their size, aimed at running where a GPU is not guaranteed to exist.

ModelParamsTypeLoRAQLoRAObjectivesFrom
SmolLM2 1.7B1.7BDense6 GB4 GBSFT, DPO$0.09/hr
SmolLM3 3B3BDense10 GB6 GBSFT, DPO$0.09/hr

Qwen3

Alibaba

The broadest size ladder in the catalogue, from 0.6B to a 30B mixture-of-experts, with permissive licensing across the whole range.

ModelParamsTypeLoRAQLoRAObjectivesFrom
Qwen3 0.6B600MDense4 GB3 GBSFT, DPO, GRPO$0.09/hr
Qwen3 1.7B1.7BDense6 GB4 GBSFT, DPO, GRPO$0.09/hr
Qwen3 4B4BDense12 GB8 GBSFT, DPO, GRPO$0.09/hr
Qwen3 8B8BDense18 GB14 GBSFT, DPO, GRPO$0.09/hr
Qwen3 14B14BDense28 GB20 GBSFT, DPO, GRPO$0.09/hr
Qwen3 30B-A3B30B / 3B activeMixture of experts64 GB36 GBSFT$0.42/hr
Qwen3 32B32BDense64 GB48 GBSFT$0.42/hr

Llama

Meta

The models with the largest surrounding ecosystem of tooling, adapters and published recipes. Community licence rather than a standard open-source one.

ModelParamsTypeLoRAQLoRAObjectivesFrom
Llama 3.2 1B1BDense4 GB3 GBSFT, DPO$0.09/hr
Llama 3.2 3B3BDense10 GB6 GBSFT, DPO$0.09/hr
Llama 3.1 8B8BDense18 GB14 GBSFT, DPO, GRPO$0.09/hr
Llama 3.3 70B70BDense140 GB48 GBSFT$0.42/hr
Llama 4 Scout 109B109B / 17B activeMixture of experts220 GB80 GBSFT$1.68/hr

Mistral

Mistral AI

Apache-2.0 throughout, with a long-context 12B and a 24B that was positioned as best-in-class at its size on release.

ModelParamsTypeLoRAQLoRAObjectivesFrom
Mistral 7B v0.37BDense16 GB12 GBSFT, DPO, GRPO$0.09/hr
Mistral Nemo 12B12BDense24 GB16 GBSFT, DPO$0.09/hr
Mistral Small 3 24B24BDense48 GB36 GBSFT, DPO$0.42/hr

Phi

Microsoft

Data-quality-first models under a plain MIT licence, which consistently benchmark above their parameter count.

ModelParamsTypeLoRAQLoRAObjectivesFrom
Phi-4 Mini 3.8B3.8BDense12 GB8 GBSFT, DPO$0.09/hr
Phi-4 14B14BDense28 GB20 GBSFT, DPO$0.09/hr

Gemma

Google

A four-rung ladder from 1B to 27B. Supervised fine-tuning only in this catalogue; preference objectives are not offered on Gemma bases.

ModelParamsTypeLoRAQLoRAObjectivesFrom
Gemma 3 1B1BDense4 GB3 GBSFT$0.09/hr
Gemma 3 4B4BDense12 GB8 GBSFT$0.09/hr
Gemma 3 12B12BDense24 GB18 GBSFT$0.09/hr
Gemma 3 27B27BDense56 GB36 GBSFT$0.42/hr

DeepSeek-R1 distills

DeepSeek

Reasoning-distilled versions of existing 7B and 8B bases. The reasoning behaviour is already present before you start, which shortens the path for maths and code work.

ModelParamsTypeLoRAQLoRAObjectivesFrom
DeepSeek-R1 Distill Qwen 7B7BDense16 GB12 GBSFT, DPO$0.09/hr
DeepSeek-R1 Distill Llama 8B8BDense18 GB14 GBSFT, DPO$0.09/hr

LFM2

Liquid AI

Hybrid architectures combining gated convolutions with attention, built for on-device and agentic workloads. Licence is Apache-2.0-derived with a commercial revenue threshold.

ModelParamsTypeLoRAQLoRAObjectivesFrom
LFM2 350M350MHybrid3 GB2 GBSFT$0.09/hr
LFM2 700M700MHybrid4 GB3 GBSFT$0.09/hr
LFM2 1.2B1.2BHybrid5 GB4 GBSFT$0.09/hr
LFM2 2.6B2.6BHybrid8 GB6 GBSFT$0.09/hr
LFM2 8B-A1B8.3B / 1.5B activeMixture of experts18 GB12 GBSFT$0.09/hr
LFM2 24B-A2B24B / 2.3B activeMixture of experts48 GB28 GBSFT$0.42/hr

Granite

IBM

Enterprise-oriented models under Apache-2.0, tuned toward retrieval and tool use rather than open-ended chat.

ModelParamsTypeLoRAQLoRAObjectivesFrom
Granite 3.0 2B2BDense7 GB5 GBSFT, DPO$0.09/hr
Granite 3.0 8B8BDense18 GB14 GBSFT, DPO$0.09/hr
Granite 4.1 8B8BDense18 GB14 GBSFT, DPO$0.09/hr

gpt-oss

OpenAI

OpenAI's open-weight mixture-of-experts models, Apache-2.0, with a small active parameter count relative to their total size.

ModelParamsTypeLoRAQLoRAObjectivesFrom
gpt-oss 20B20.9B / 3.6B activeMixture of experts40 GB24 GBSFT$0.17/hr
gpt-oss 120B116.8B / 5.1B activeMixture of experts220 GB80 GBSFT$1.68/hr

Falcon 3

TII

A clean four-rung ladder from 1B to 10B under the TII Falcon licence, with consistent behaviour across sizes.

ModelParamsTypeLoRAQLoRAObjectivesFrom
Falcon 3 1B1BDense4 GB3 GBSFT, DPO$0.09/hr
Falcon 3 3B3BDense10 GB6 GBSFT, DPO$0.09/hr
Falcon 3 7B7BDense16 GB12 GBSFT, DPO$0.09/hr
Falcon 3 10B10BDense22 GB16 GBSFT, DPO$0.09/hr

OLMo

Allen Institute for AI

Fully open models: training data, code and every intermediate checkpoint are published, not just the final weights. The right choice when provenance has to be auditable.

ModelParamsTypeLoRAQLoRAObjectivesFrom
OLMo 2 7B7BDense16 GB12 GBSFT, DPO$0.09/hr
OLMo 3 7B7BDense16 GB12 GBSFT, DPO, GRPO$0.09/hr
OLMo 3 32B32BDense64 GB48 GBSFT$0.42/hr

Reading the objective column

How to choose between them →

Last verified 6 August 2026.

Start with the free tier

A magic link creates your account, your tenant and your first API key. No card until you ask for compute.