F16 GGUF models
Unquantized 16-bit floats. Original quality and the largest size. 53239 models have a F16 file. Sizes run from 0M to 1030B parameters. The longest trained context is 10742K tokens.
MI
Mistral-7B-v0.3-Chinese-Chat-uncensored
Mistral · stephenlzc
Params7.25B
Context32K
Q4_K_M4.4 GB
QW
MiroThinker-v1.0-8B
Qwen · Mungert
Params8.2B
Context256K
Q4_K_M5.4 GB
GE
Gemma 4 E4B It Uncensored MAX Opus 4.7
Gemma · mradermacher
Params7.52B
Context128K
Q4_K_M5.3 GB
AR
arco reflection v4
Arco · mradermacher
Params514M
Context8K
Q4_K_M0.3 GB
OM
OmniCoder 2 9B
Omnicoder · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
DA
danube2-1.8b-Neural
Danube · mradermacher
Params1.83B
Context8K
Q4_K_M1.1 GB
PH
PII Model Phi3 Mini
Phi · mradermacher
Params3.82B
Context4K
Q4_K_M2.4 GB
SM
SmolLM 135M Taiwan Instruct v1.0
SmolLM · mradermacher
Params135M
Context2K
Q4_K_M0.1 GB
OC
octo net
Octo · NexaAI
Params3.82B
Context128K
Q4_K_M2.4 GB
RE
RedSage K SFT GRPO
Redsage · mradermacher
Params8.2B
Context32K
Q4_K_M5.0 GB
FI
v6 Finch 3B HF
Finch · bartowski
Params3.1B
Context1024K
Q4_K_M1.9 GB
CL
Clef Flash
Clef · prithivMLmods
Params8.95B
Context256K
Q4_K_M5.6 GB
MA
Magnum v4 22b
Magnum · bartowski
Params22.2B
Context32K
Q4_K_M13.3 GB
QW
QwenPaw Flash 9B heretic
Qwen · SC117
Params8.95B
Context256K
Q4_K_M5.6 GB
NE
NeuTTS Air
Neutts · BricksDisplay
Params262M
Context—
Q4_K_M0.3 GB
FL
Flux Prompt Enhance
Flux · mradermacher
Params223M
Context512
Q4_K_M0.1 GB
VI
VibeThinker 3B
Vibethinker · prithivMLmods
Params3.09B
Context128K
Q4_K_M1.9 GB
FL
flux dev
Flux · gguf-org
Params123M
Context—
Q4_K_M6.7 GB
DI
dictalm2.0-instruct
Dictalm · mradermacher
Params7.25B
Context32K
Q4_K_M4.4 GB
QW
ISO42001 Qwen2.5 0.5B Edge
Qwen · sallani
Params494M
Context32K
Smallest1.0 GB
CY
Cydonia 22B v1
Cydonia · bartowski
Params22.2B
Context128K
Q4_K_M13.3 GB
KO
kokoro
Kokoro · mmwillet2
Params88M
Context—
Smallest0.2 GB
KR
KrakenSakura Maelstrom 12B v1
Krakensakura · Naphula
Params12.2B
Context128K
Q4_K_M7.5 GB
TI
TinySlime-1.1B-Chat-v1.0
Tinyslime · mradermacher
Params1.1B
Context2K
Q4_K_M0.7 GB
KO
Koa AI v2 Code 9B
Koa · mradermacher
Params9.2B
Context256K
Q4_K_M5.8 GB
LF
LFM2.5 1.2B Instruct heretic
Lfm · saidutta69
Params1.17B
Context125K
Q4_K_M0.7 GB
XL
xLAM 8x7b R
Xlam · bartowski
Params46.7B
Context32K
Q4_K_M28.4 GB
MI
Sydney_Pirate_Mistral_7b
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
EX
EXAONE 3.5 32B Instruct
Exaone · bartowski
Params32B
Context32K
Q4_K_M19.3 GB
KH
kheops compressed
Kheops · mradermacher
Params283M
Context2K
Q4_K_M0.2 GB