F16 GGUF models
Unquantized 16-bit floats. Original quality and the largest size. 53239 models have a F16 file. Sizes run from 0M to 1030B parameters. The longest trained context is 10742K tokens.
LL
Hermes 2 Theta Llama 3 8B
Llama · NousResearch
Params8B
Context8K
Q4_K_M4.9 GB
QW
Qwen3.5 2B EmperoAI Qwen3.8 Distill Heretic Abliterated
Qwen · mradermacher
Params1.88B
Context256K
Q4_K_M1.3 GB
QW
dnotitia_Smoothie Qwen3 14B
Qwen · Alcoft
Params14.8B
Context40K
Q4_K_M9.0 GB
QW
Qwen3 14B
Qwen · lm-kit
Params14.8B
Context40K
Q4_K_M9.0 GB
QW
Qwen3 1.7B
Qwen · gaianet
Params2.03B
Context40K
Q4_K_M1.3 GB
OL
OLMo 2 1124 7B Instruct
OLMo · bartowski
Params7.3B
Context4K
Q4_K_M4.5 GB
WE
WeVisOne VL 2B
Wevisone · mradermacher
Params2.03B
Context256K
Q4_K_M1.3 GB
LL
Llama 3.2 3B Instruct Abliterated
Llama · mradermacher
Params3.61B
Context128K
Q4_K_M2.2 GB
GE
Gemma 4 12B Agentic Fable5 Composer2.5 v2 3.5x Tau2 Uncensored Heretic
Gemma · llmfan46
Params11.9B
Context256K
Q4_K_M7.4 GB
MI
MiniMax H3 Prompt Rewriter LoRA
Minimax · pytraveler
Params1.87B
Context—
Smallest2.0 GB
BG
bge m3
BGE · CompendiumLabs
Params567M
Context8K
Smallest1.2 GB
GE
Gemma 3 4b It Heretic Uncensored Abliterated Extreme
Gemma · mradermacher
Params3.88B
Context128K
Q4_K_M2.5 GB
QW
Qwen3Vl 32b Thinking
Qwen · Qwen
Params32.8B
Context256K
Q4_K_M19.8 GB
QW
Qwen2.5 Coder 3B Instruct
Qwen · unsloth
Params3.09B
Context32K
Q4_K_M1.9 GB
LL
Llama3.1 8B ShiningValiant2
Llama · bartowski
Params8B
Context128K
Q4_K_M4.9 GB
OR
Ornith 1.5 27B A3B CoderX MTP
Ornith · ManniX-ITA
Params26.2B
Context256K
Q4_K_M16.1 GB
JI
jina embeddings v2 base code
Jina · second-state
Params160M
Context8K
Q4_K_M0.1 GB
QW
Qwen2.5 32b RP Ink
Qwen · bartowski
Params32.8B
Context32K
Q4_K_M19.9 GB
QW
Qwen2.5 Coder 7B Instruct Heretic
Qwen · saidutta69
Params7.62B
Context32K
Q4_K_M4.7 GB
TI
Tiny Aya Global
Tiny · CohereLabs
Params3.35B
Context488K
Q4_K_M2.1 GB
GE
Gemmasutra Mini 2B v1
Gemma · l3utterfly
Params2.61B
Context8K
Q4_K_M1.7 GB
DE
DeepSeek R1 Distill Qwen 1.5B Abliterated
DeepSeek · mradermacher
Params1.78B
Context128K
Q4_K_M1.1 GB
LL
Llama3.2 DeepHermes 3 3B Preview Reasoning MAX NEO Imatrix
Llama · DavidAU
Params3.21B
Context128K
Q4_K_M2.5 GB
QW
Qwen3.6 27B Omnimerge v4
Qwen · ManniX-ITA
Params27B
Context256K
Q4_K_M16.5 GB
QW
Qwen3 Reranker 8B GGUF llama cpp
Qwen · Voodisss
Params7.57B
Context40K
Q4_K_M4.7 GB
IN
INTELLECT 1 Instruct
Intellect · bartowski
Params10.2B
Context8K
Q4_K_M6.2 GB
LL
Llama 3.2 1B Instruct Abliterated
Llama · mradermacher
Params1.5B
Context128K
Q4_K_M1.0 GB
MI
Ministral-3-8B-Reasoning-2512
Mistral · Mungert
Params8.5B
Context256K
Q4_K_M5.5 GB
QW
Qwen3.5 9B Claude Code
Qwen · empero-ai
Params8.95B
Context256K
Q4_K_M5.6 GB
FL
FLUX.1 Depth dev
Flux · SporkySporkness
Params11.9B
Context—
Smallest6.8 GB