F16 GGUF models

Unquantized 16-bit floats. Original quality and the largest size. 53239 models have a F16 file. Sizes run from 0M to 1030B parameters. The longest trained context is 10742K tokens.

Most downloadedNewestLargestLongest contextSmallest
PY
Pythia 160m
Pythia · mradermacher
Params162M
Context2K
Q4_K_M0.1 GB
GGUF
QW
Qwen3 1.7B Jailbreak Reasoning
Qwen · mradermacher
Params1.72B
Context40K
Q4_K_M1.1 GB
ReasoningTool use
LL
Llama-3-8B-Magpie-Pro-MT-UltraDPO2
Llama · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
QW
Bharat Tiny LLM v3
Qwen · eulogik
Params1.72B
Context32K
Q4_K_M1.1 GB
Tool use
SP
Spark-X2.6-4B
Spark · Mungert
Params4.11B
Context1024K
Q4_K_M2.6 GB
ReasoningTool use
ST
stt en fastconformer ctc large
Stt · cstr
Params116M
Context—
Smallest0.1 GB
GGUF
SI
SILMA 9B Instruct v1.0
Silma · bartowski
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
GR
granite docling 258M
Granite · ggml-org
Params164M
Context8K
Smallest0.2 GB
Vision
IN
InternVL3 2B Instruct
Internvl · ggml-org
Params1.78B
Context32K
Q4_K_M1.1 GB
Vision
PH
Phonon-2
Phonon · cstr
Params627M
Context—
Smallest0.4 GB
GGUF
GE
Gemma 4 A4B 98e v6 Coder It
Gemma · ManniX-ITA
Params19.9B
Context256K
Q4_K_M10.6 GB
CodingVision
GE
Gemma 4 E4B Abliterated Uncensored
Gemma · mradermacher
Params7.46B
Context128K
Q4_K_M5.3 GB
Roleplay
QW
Qwen2.5 7B Instruct
Qwen · bartowski
Params7.62B
Context32K
Q4_K_M4.7 GB
GGUF
FA
Falcon3 7B Instruct Abliterated
Falcon · bartowski
Params7.46B
Context32K
Q4_K_M4.6 GB
GGUF
QW
Qwen2.5 Coder 1.5B Instruct
Qwen · second-state
Params1.54B
Context32K
Q4_K_M1.0 GB
Coding
OP
OpenELM 450M Instruct
Openelm · mradermacher
Params457M
Context2K
Q4_K_M0.3 GB
GGUF
FU
Fun-ASR-Nano-2512
Fun · cstr
Params985M
Context—
Smallest0.9 GB
GGUF
SP
Spark-X2.5-1.7B
Spark · Mungert
Params1.71B
Context1024K
Q4_K_M1.1 GB
GGUF
MI
Mahou-1.3a-mistral-7B
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
LL
Home Llama 3.2 3B
Llama · acon96
Params3.21B
Context128K
Q4_K_M2.0 GB
GGUF
DA
danube2-1.8b-WizardLM-Evol-V2-Unfiltered
Danube · mradermacher
Params1.83B
Context8K
Q4_K_M1.1 GB
GGUF
QW
Qwen3.5 4B Instruct
Qwen · Hob-forge
Params4.33B
Context256K
Q4_K_M2.8 GB
GGUF
SM
SmolLM2 1.7B Instruct
SmolLM · unsloth
Params1.71B
Context8K
Q4_K_M1.1 GB
GGUF
GE
Gemma 4 12B It Heretic
Gemma · SC117
Params11.9B
Context256K
Q4_K_M7.4 GB
Vision
PI
pixart
Pixart · calcuis
Params611M
Context—
Q4_K_M1.0 GB
GGUF
GE
Gemma 2 2B ArliAI RPMax v1.1
Gemma · bartowski
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
QW
qwen3 4b pokerbench grpo
Qwen · YiPz
Params4B
Context256K
Q4_K_M2.5 GB
GGUF
QW
MiMo V2.6 Distill Qwen 9B Heretic
Qwen · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
CodingReasoningRoleplay
PH
Phi 2 Hyper
Phi · mradermacher
Params2.78B
Context2K
Q4_K_M1.7 GB
GGUF
BT
btc chords
Btc · cstr
Params3M
Context—
Smallest0.0 GB
GGUF

Other quants

Keep browsing