F16 GGUF models
Unquantized 16-bit floats. Original quality and the largest size. 53239 models have a F16 file. Sizes run from 0M to 1030B parameters. The longest trained context is 10742K tokens.
LL
FuseChat Llama 3.2 3B Instruct
Llama · bartowski
Params3.21B
Context128K
Q4_K_M2.0 GB
LL
Llama 3.3 70B Instruct Abliterated GGUF ARMADO
Llama · Thaurock
Params70.6B
Context128K
Q4_K_M42.5 GB
MI
Ministral 3 8B Uncensored
Mistral · mradermacher
Params8.49B
Context256K
Q4_K_M5.2 GB
ST
stablelm tuned alpha 7b
Stablelm · mradermacher
Params7.87B
Context4K
Q4_K_M5.1 GB
TI
TinyLlama Indo Chat v.02
Tinyllama · mradermacher
Params1.1B
Context2K
Q4_K_M0.7 GB
DE
Huihui ai.DeepSeek R1 Distill Qwen 7B Abliterated
DeepSeek · DevQuasar-7
Params7.62B
Context128K
Q4_K_M4.7 GB
LL
Hermes-2-Theta-Llama-3-8B
Llama · thesven
Params8B
Context8K
Q4_K_M4.9 GB
LL
Meta Llama 3.1 8B Claude iMat
Llama · InferenceIllusionist
Params8B
Context128K
Q4_K_M4.9 GB
MI
MiniLoong-3B
Miniloong · mradermacher
Params3.02B
Context31K
Q4_K_M1.8 GB
QW
Qwen3 VL 8B Thinking Abliterated
Qwen · mradermacher
Params8.19B
Context256K
Q4_K_M5.0 GB
LL
TransLLaMA2-7B-Alpaca
Llama · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
IN
Index Homura 2B
Index · IndexTeam
Params1.94B
Context256K
Q4_K_M1.3 GB
AY
Aya Expanse 8b
Aya · matrixportalx
Params8B
Context8K
Q4_K_M5.1 GB
LE
LemonadeRP 4.5.3
Lemonaderp · backyardai
Params7.24B
Context32K
Q4_K_M4.4 GB
TO
TowerInstruct 7B v0.2
Towerinstruct · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
QI
Qianfan OCR
Qianfan · ggml-org
Params4.42B
Context32K
Smallest4.7 GB
PE
PersianMind v1.0
Persianmind · mradermacher
Params6.8B
Context2K
Q4_K_M4.1 GB
SM
SmolLM 135M
SmolLM · mradermacher
Params135M
Context2K
Q4_K_M0.1 GB
LF
LFM2 24B A2B
Lfm · NexaAI
Params23.8B
Context125K
Q4_K_M14.4 GB
AR
AraPhi-3-mini-4k-instruct
Araphi · mradermacher
Params3.82B
Context4K
Q4_K_M2.3 GB
FU
Fun-ASR-MLT-Nano-2512
Fun · cstr
Params985M
Context—
Smallest0.9 GB
LL
Agente Llama 3.1 Asistant 16bit v2
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
QW
bu-30b-a3b-preview
Qwen · Mungert
Params30.5B
Context256K
Q4_K_M18.9 GB
DI
dia 1.6b
Dia · cstr
Params54M
Context—
Smallest0.1 GB
DA
Darkest muse v1
Darkest · bartowski
Params9.24B
Context8K
Q4_K_M5.8 GB
EU
EuroLLM 9B Instruct 2512
Eurollm · mradermacher
Params9.15B
Context32K
Q4_K_M5.6 GB
TO
Tongyi-DeepResearch-30B-A3B
Tongyi · Mungert
Params30.5B
Context128K
Q4_K_M19.0 GB
LF
LFM2.5 350M home assistant sft
Lfm · OrdenWills
Params353M
Context125K
Q4_K_M0.2 GB
GE
Skaldic Gemma 4 E4B
Gemma · mradermacher
Params7.46B
Context128K
Q4_K_M5.3 GB
MI
Snorkel Mistral PairRM DPO ExPO
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB