F16 GGUF models

Unquantized 16-bit floats. Original quality and the largest size. 53239 models have a F16 file. Sizes run from 0M to 1030B parameters. The longest trained context is 10742K tokens.

Most downloadedNewestLargestLongest contextSmallest
CO
C4AI inverse sft model
Command R · mradermacher
Params135M
Context2K
Q4_K_M0.1 GB
GGUF
TE
TerraSense
Terrasense · mradermacher
Params8.19B
Context256K
Q4_K_M5.0 GB
Tool useVision
NA
Nanonets OCR S
Nanonets · prithivMLmods
Params3.1B
Context125K
Q4_K_M1.9 GB
Vision
MA
Magenta RealTime 2
Magenta · audio-cpp
Params2.67B
Context—
Smallest1.3 GB
GGUF
QW
nsfwcaption qwen3 vl 8b v3
Qwen · GitMylo
Params8.2B
Context256K
Q4_K_M5.0 GB
Vision
GE
gemma 3n E4B it
Gemma · ggml-org
Params6.9B
Context32K
Smallest7.4 GB
GGUF
MY
MythoLogic-Mini-7b
Mythologic · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
QW
Qwen2 VL 2B Instruct Abliterated
Qwen · mradermacher
Params1.78B
Context32K
Q4_K_M1.1 GB
Vision
TE
Ternary Bonsai 4b Abliterated v2
Ternary · Rootkit7
Params4B
Context32K
Q4_K_M2.5 GB
GGUF
GE
gemma 4 E2B it heretic
Gemma · saidutta69
Params4.63B
Context128K
Q4_K_M3.4 GB
ReasoningTool useVision
QW
Qwen3 4B Instruct 2507 Abliterated
Qwen · mradermacher
Params4.02B
Context256K
Q4_K_M2.5 GB
Tool use
QW
Qwen3 Reranker 8B
Qwen · mradermacher
Params8.19B
Context40K
Q4_K_M5.0 GB
Embedding
QW
Qwen.Qwen2.5 VL 3B Instruct
Qwen · DevQuasar-6
Params669M
Context125K
Q4_K_M1.9 GB
Vision
GL
Poe 8B GLM5 Opus4.6 Sonnet4.5 Kimi Grok Gemini 3 Pro Preview HERETIC
GLM · mradermacher
Params8.19B
Context256K
Q4_K_M5.0 GB
Vision
LL
Llama 3.2 3B Instruct Uncensored
Llama · PurpleAILAB
Params3.21B
Context128K
Q4_K_M2.0 GB
GGUF
JA
JapanRailwaysimLLM
Japanrailwaysimllm · mradermacher
Params7.5B
Context128K
Q4_K_M5.3 GB
Vision
TI
TinyEnsemble-3x1.1B-TinyMoE
Tinyensemble · mradermacher
Params2.62B
Context4K
Q4_K_M1.6 GB
Tool use
MI
MiniMax H3 Prompt Rewriter LoRA Omni
Minimax · pytraveler
Params323M
Context—
Smallest0.3 GB
GGUF
DE
DeepSeek R1 Distill Qwen 1.5B Fully Uncensored
DeepSeek · mradermacher
Params1.78B
Context128K
Q4_K_M1.1 GB
Reasoning
QW
Qwen3 0.6B Gensyn Swarm tall tame panther
Qwen · 0xgr3y
Params596M
Context40K
Q4_K_M0.4 GB
ReasoningTool use
QW
Qwen2.5 Coder 7B Instruct Uncensored
Qwen · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
Coding
SU
supertonic 3
Supertonic · cstr
Params100M
Context—
Smallest0.2 GB
GGUF
GP
Gpt-Oss-Safeguard-20B
gpt-oss · unsloth
Params20.9B
Context128K
Q4_K_M11.6 GB
GGUF
RW
rwkv 6 finch 1b6
Rwkv · latestissue
Params1.6B
Context1024K
Smallest0.7 GB
GGUF
GE
Gemma4 E4B Mahou Nsfw
Gemma · mradermacher
Params7.46B
Context128K
Q4_K_M5.3 GB
ReasoningRoleplayTool use
BA
BabyHercules 4x150M
Babyhercules · mradermacher
Params411M
Context2K
Q4_K_M0.3 GB
GGUF
LL
Llama-2-7b-pruned70-retrained-gsm8k
Llama · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
SA
Sarvamai.Sarvam 30b
Sarvam · DevQuasar
Params32.2B
Context128K
Smallest12.2 GB
GGUF
YO
Youtu-VL-4B-Instruct
Youtu · Mungert
Params4.9B
Context32K
Q4_K_M3.1 GB
Vision
MA
Marco o1
Marco · bartowski
Params7.6B
Context32K
Q4_K_M4.7 GB
GGUF

Other quants

Keep browsing