F16 GGUF models
Unquantized 16-bit floats. Original quality and the largest size. 53239 models have a F16 file. Sizes run from 0M to 1030B parameters. The longest trained context is 10742K tokens.
QW
Qwen3.5 4B SOMPOA Heresy v2
Qwen · mradermacher
Params4.21B
Context256K
Q4_K_M2.7 GB
GE
gemma 4 A4B 98e v7 coder it
Gemma · ManniX-ITA
Params19.9B
Context256K
Q4_K_M13.2 GB
GE
gemma-2-9b-it
Gemma · second-state
Params9.24B
Context8K
Q4_K_M5.8 GB
GE
Gemma 3 1b It
Gemma · DavidAU
Params1B
Context32K
Q4_K_M1.1 GB
AG
AgentCPM Explore
Agentcpm · openbmb
Params4.41B
Context256K
Q4_K_M2.7 GB
QW
Karlsen Chat 27B abliterated
Qwen · karlsencoin
Params27.3B
Context256K
Q4_K_M16.6 GB
HA
Hare 1.1B Base 0.5v
Hare · mradermacher
Params1.19B
Context32K
Q4_K_M0.7 GB
LL
Llama 3.1 Hawkish 8B
Llama · bartowski
Params8.03B
Context128K
Q4_K_M4.9 GB
LF
Claude
Lfm · FlameF0X
Params1.17B
Context125K
Q4_K_M0.7 GB
RW
RWKV 5.2 3B NSFW Role 16k
Rwkv · mzwing
Params3.1B
Context1024K
Q4_K_M1.9 GB
GE
EZO Humanities 9B gemma 2 it
Gemma · MCZK
Params9.24B
Context8K
Q4_K_M5.8 GB
IN
InternVL3 14B Instruct
Internvl · ggml-org
Params14.8B
Context32K
Q4_K_M9.0 GB
SM
SmolLM3 3B heretic
SmolLM · saidutta69
Params3.08B
Context64K
Q4_K_M1.9 GB
NA
Nanbeige4.2-3B
Nanbeige · Mungert
Params4.17B
Context256K
Q4_K_M2.8 GB
BA
bark-small
Bark · cstr
Params404M
Context—
Smallest0.2 GB
DE
DeepSeek R1 Distill Qwen 14B
DeepSeek · osllmai-community
Params14.8B
Context128K
Q4_K_M9.0 GB
CL
clef flash heretic
Clef · saidutta69
Params8.95B
Context256K
Smallest17.9 GB
QW
Qwen3 4B Thinking 2507 MiniMax M2.1 Distill
Qwen · TeichAI
Params4.02B
Context256K
Q4_K_M2.5 GB
QW
Qwen2.5-0.5B-Instruct
Qwen · Mungert
Params494M
Context32K
Q4_K_M0.4 GB
QW
Huihui Qwen3.5 9B abliterated
Qwen · Kausik-A
Params8.95B
Context256K
Q4_K_M5.6 GB
KR
Krea-2-Engineer-V1
Krea · BennyDaBall
Params4B
Context256K
Q4_K_M2.5 GB
QW
Qwen3.5 4B Deckard HERETIC UNCENSORED Thinking
Qwen · mradermacher
Params4.21B
Context256K
Q4_K_M2.7 GB
SQ
SQLFlow Retrival 0.6B
Sqlflow · mradermacher
Params596M
Context32K
Q4_K_M0.4 GB
ON
OneDecision VisionGuard 4B SFT
Onedecision · mradermacher
Params4.21B
Context256K
Q4_K_M2.7 GB
PH
microsoft.Phi 4 Reasoning Vision 15B
Phi · DevQuasar
Params14.7B
Context32K
Smallest5.5 GB
WI
WizardMath 7B V1.1
Wizardmath · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
CH
Chandra Ocr 2
Chandra · mradermacher
Params4.84B
Context256K
Q4_K_M3.1 GB
GR
Granite 3.3 2b Instruct
Granite · mrutkows
Params2.53B
Context128K
Q4_K_M1.5 GB
QW
Qwen3.5 9B Uncensored Cyber v2
Qwen · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
SA
Saul 7B Instruct v1
Saul · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB