F16 GGUF models
Unquantized 16-bit floats. Original quality and the largest size. 53239 models have a F16 file. Sizes run from 0M to 1030B parameters. The longest trained context is 10742K tokens.
QW
Qwen3.5-0.8B-Fable-GPT6
Qwen · Shreesha-2011
Params752M
Context256K
Q4_K_M0.5 GB
MI
BlackSheep Mistral RP 7B
Mistral · bartowski
Params7.24B
Context32K
Q4_K_M4.4 GB
LL
uzbek llama 3.1 8B instruct v2
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
CA
CabraLlama3-8b-32k
Cabrallama · mradermacher
Params8B
Context32K
Q4_K_M4.9 GB
MI
dphn.Dolphin Mistral 24B Venice Edition
Mistral · DevQuasar
Params23.6B
Context32K
Q4_K_M14.3 GB
LL
MathCoder2 Llama 3 8B
Llama · bartowski
Params8B
Context8K
Q4_K_M4.9 GB
AT
AtomPro-Coder-7B
Atompro · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
PH
phi3.5 gutenberg 4B
Phi · mradermacher
Params3.82B
Context128K
Q4_K_M2.4 GB
MI
LeChatonFat Final
Mistral · squ11z1
Params3.43B
Context256K
Q4_K_M2.1 GB
TU
TutorRL 7B
Tutorrl · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
QW
Qwen3.6 35B A3B
Qwen · prithivMLmods
Params35.5B
Context256K
Q4_K_M21.7 GB
MI
mistral-orthogonalized
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
LL
Llama-3-Neurona-8b
Llama · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
OP
OpenMobile 2 9B
Openmobile · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
GR
ClinicalThought AI 8B
Granite · Raymond-dev-546730
Params8.17B
Context128K
Q4_K_M4.9 GB
MI
MN Helcyon GPT 4o 12b v4.5
Mistral · XeyonAI
Params12.2B
Context128K
Q4_K_M7.5 GB
MI
Mistral 7B v0.2 none DepressionDetection v2
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
HI
HiViG Critic
Hivig · mradermacher
Params8.19B
Context256K
Q4_K_M5.0 GB
MI
Merge Mistral Prometheus 7B
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
LL
Llama-3-Groq-8B-Tool-Use
Llama · second-state
Params8.03B
Context8K
Q4_K_M4.9 GB
YI
Yi-1.5-6B-Chat
Yi · mradermacher
Params6.06B
Context4K
Q4_K_M3.7 GB
GE
REDCELL 26B A4B OSINT Cyber
Gemma · 0xSojalSec
Params25.2B
Context256K
Smallest12.3 GB
HO
Home 3B v3
Home · acon96
Params2.8B
Context4K
Q4_K_M1.7 GB
QW
Qwen2.5 7B Instruct 1M heretic
Qwen · saidutta69
Params7.62B
Context986K
Q4_K_M4.7 GB
QW
Qwen.Qwen3.8 Flash Next
Qwen · DevQuasar
Params177B
Context256K
Smallest80.4 GB
QW
Qwen3 TTS 12Hz 0.6B CustomVoice
Qwen · BricksDisplay
Params652M
Context32K
Q4_K_M0.4 GB
QW
Qwen2.5 3B Instruct lora sex float16
Qwen · mradermacher
Params3.09B
Context32K
Q4_K_M1.9 GB
YI
yi-1.5-6b-tofutune
Yi · mradermacher
Params6.06B
Context8K
Q4_K_M3.7 GB
CA
Cac v0.1
Cac · mradermacher
Params6.74B
Context16K
Q4_K_M4.1 GB
RE
ReWiz Nemo 12B Instruct
Rewiz · theprint
Params12.2B
Context1000K
Q4_K_M7.5 GB