F16 GGUF models

Unquantized 16-bit floats. Original quality and the largest size. 53239 models have a F16 file. Sizes run from 0M to 1030B parameters. The longest trained context is 10742K tokens.

Most downloadedNewestLargestLongest contextSmallest
MI
Hermes 2 Pro Mistral 7B
Mistral · backyardai
Params7.24B
Context32K
Q4_K_M4.4 GB
Tool use
LI
H2O Lightning 4b
Lightning · mradermacher
Params4.21B
Context256K
Q4_K_M2.7 GB
GGUF
CA
CAJAL 4B Merged 16bit
Cajal · Agnuxo
Params4.21B
Context256K
Q4_K_M2.7 GB
GGUF
LL
llava 1.6
LLaVA · cmp-nct
Params7.24B
Context32K
Smallest4.4 GB
Vision
OL
OLMoE 1B 7B 0125 Instruct
OLMo · allenai
Params6.9B
Context4K
Q4_K_M4.2 GB
GGUF
FA
Falcon3 10B Instruct
Falcon · bartowski
Params10.3B
Context32K
Q4_K_M6.3 GB
GGUF
GR
Granite 4.0 H 1B BE
Granite · taronaeo
Params1.46B
Context—
Q4_K_M0.9 GB
GGUF
MI
mimo asr
Mimo · cstr
Params8.02B
Context—
Smallest0.0 GB
GGUF
LL
model
Llama · ChatGpt1
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
MI
Trinity 2 Codestral 22B v0.2
Mistral · bartowski
Params22.2B
Context32K
Q4_K_M13.3 GB
Coding
MI
Ministral-3-3B-Reasoning-2512
Mistral · Mungert
Params3.43B
Context256K
Q4_K_M2.2 GB
Reasoning
QW
Qwen2.5 VL 7B Instruct Heretic
Qwen · mradermacher
Params7.62B
Context125K
Q4_K_M4.7 GB
CodingVision
SM
KrynexAI 1.4
SmolLM · KrynexLabs
Params135M
Context8K
Q4_K_M0.1 GB
GGUF
FA
Falcon H1 34B Instruct
Falcon · tiiuae
Params33.6B
Context256K
Q4_K_M20.3 GB
GGUF
LF
LFM2 VL 450M
Lfm · LiquidAI
Params354M
Context125K
Smallest0.2 GB
Vision
LL
saiga_llama3_8b
Llama · IlyaGusev
Params8B
Context8K
Smallest3.2 GB
GGUF
PY
Pythia 2.8b
Pythia · mradermacher
Params2.78B
Context2K
Q4_K_M1.8 GB
GGUF
LL
LLaMA2 13B Psyfighter2
Llama · KoboldAI
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
QW
Jan-v2-VL-high
Qwen · Mungert
Params8.2B
Context256K
Q4_K_M5.4 GB
ReasoningVision
VI
vibevoice asr
Vibevoice · cstr
Params8.33B
Context—
Smallest0.0 GB
GGUF
QW
Qwen2.5 Coder 0.5B Instruct Abliterated
Qwen · bartowski
Params494M
Context32K
Q4_K_M0.4 GB
Coding
GE
Gemma 3 it 4B Uncensored DBL X
Gemma · DavidAU
Params4.26B
Context128K
Q4_K_M2.7 GB
Roleplay
QW
Qwythos 9B v2
Qwythos · mradermacher
Params9.2B
Context1024K
Q4_K_M5.8 GB
ReasoningVision
QW
Qwen3 VL 8B Abliterated Caption It
Qwen · mradermacher
Params8.19B
Context256K
Q4_K_M5.0 GB
Vision
QW
Qwen2.5 VL 32B Instruct
Qwen · ggml-org
Params32.8B
Context125K
Q4_K_M19.9 GB
Vision
OR
Ornith 1.5 REAP 20B A3B
Ornith · sleepyeldrazi
Params19B
Context256K
Smallest10.5 GB
ReasoningTool use
QW
Qwen2.5 VL 72B Instruct
Qwen · ggml-org
Params72.7B
Context125K
Q4_K_M47.4 GB
Vision
QW
Qwen3.8 27B Escha W2
Qwen · aj9o9
Params6.33B
Context256K
Smallest2.9 GB
GGUF
VI
Vietnamese 4B Chat abliterated
Vietnamese · N14QM
Params4.2B
Context256K
Q4_K_M2.7 GB
Vision
GE
Gemma 2B Uncensored
Gemma · lemuralabs
Params2.51B
Context8K
Q4_K_M1.6 GB
Coding

Other quants

Keep browsing