F16 GGUF models

Unquantized 16-bit floats. Original quality and the largest size. 53239 models have a F16 file. Sizes run from 0M to 1030B parameters. The longest trained context is 10742K tokens.

Most downloadedNewestLargestLongest contextSmallest
GR
GreenOgno-7b-passthrough
Greenogno · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
AB
ABD3ID CodeMentor
Abd · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
CodingVision
DA
DavidAU.L3.1 Dark Reasoning LewdPlay Evo Hermes R1 Uncensored 8B
Dark · DevQuasar-13
Params8B
Context128K
Q4_K_M4.9 GB
ReasoningTool use
QW
Gliese Qwen3.5 9B Abliterated Caption
Qwen · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
ReasoningTool useVision
TE
text super resolution
Text · cstr
Params—
Context—
Smallest0.0 GB
GGUF
GR
Granite 8b Code Instruct 4k
Granite · mradermacher
Params8.05B
Context4K
Q4_K_M4.9 GB
CodingTool use
CH
Chatterbox TTS Persian
Chatterbox · mazrba
Params264M
Context—
Smallest0.4 GB
GGUF
LF
LiquidAI.LFM2 2.6B Transcript
Lfm · DevQuasar
Params2.57B
Context125K
Q4_K_M1.6 GB
GGUF
NE
Sakura Nemotron 3.5 Bolt 74B A9B 24GB Uncensored
Nemotron · webmp3
Params74B
Context256K
Smallest23.4 GB
GGUF
LL
LLaMA2 13B Estopia
Llama · KoboldAI
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
GE
gemma 4 A4B 98e v7 coderx it
Gemma · ManniX-ITA
Params19.9B
Context256K
Q4_K_M13.2 GB
CodingVision
IN
amd.Instella MoE 16B A3B Think
Instella · DevQuasar
Params15.9B
Context32K
Smallest6.5 GB
Reasoning
CO
c4ai-command-r-plus
Command R · pmysl
Params104B
Context128K
Q4_K_M62.8 GB
GGUF
EM
EmertonOgno-7B
Emertonogno · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
GR
granite-4.0-h-micro
Granite · Mungert
Params3.2B
Context1024K
Q4_K_M2.0 GB
GGUF
TI
TIPO 200M 40Btok
Tipo · KBlueLeaf
Params203M
Context2K
Smallest0.4 GB
Vision
NE
NVIDIA-Nemotron-3.5-Transcribe-30B-A4B
Nemotron · sakasegawa
Params33.7B
Context—
Smallest19.0 GB
GGUF
MI
Ministral 3 3B Instruct 2512
Mistral · EnlistedGhost
Params3.43B
Context256K
Smallest1.3 GB
Vision
MI
MiniCPM V 4.7 1B Balanced Heretic Abliterated
MiniCPM · maternion
Params1.01B
Context256K
Q4_K_M0.7 GB
Vision
GA
GameScaling 2B S1
Gamescaling · mradermacher
Params2.39B
Context256K
Q4_K_M1.6 GB
ReasoningTool useVision
LO
LoomAI
Loomai · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
DI
DistilQwen3 1.7B uncensored
Distilqwen · reaperdoesntknow
Params2.03B
Context40K
Q4_K_M1.3 GB
ReasoningTool use
LL
Llama 3.1 Argunaut 1 8B SFT
Llama · bartowski
Params8B
Context128K
Q4_K_M4.9 GB
Reasoning
MI
MiLMMT 46 4B v1.0
Milmmt · mradermacher
Params3.88B
Context128K
Q4_K_M2.5 GB
Vision
ON
OneJev1.5 0.8B
Onejev · mradermacher
Params1.01B
Context256K
Q4_K_M0.7 GB
Vision
SE
Seamaiiza-7B-v2-128k
Seamaiiza · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
Roleplay
MI
Mixtral AI CyberLord
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
DA
h2o-danube2-1.8b-chat
Danube · h2oai
Params1.83B
Context8K
Q4_K_M1.1 GB
GGUF
NO
Notus-TheTop-7b-Passthrough
Notus · mradermacher
Params8.99B
Context32K
Q4_K_M5.4 GB
GGUF
MI
Huihui Devstral Small 2 24B Instruct 2512 abliterated
Mistral · AliBilge
Params23.6B
Context384K
Q4_K_M14.3 GB
Coding

Other quants

Keep browsing