BF16 GGUF models
Unquantized bfloat16. Original quality and the largest size. 9004 models have a BF16 file. Sizes run from 1M to 2780B parameters. The longest trained context is 10240K tokens.
QW
Holo2-30B-A3B
Qwen · Mungert
Params30.5B
Context256K
Q4_K_M19.0 GB
GE
gemma-4-E4B
Gemma · ggml-org
Params7.52B
Context128K
Smallest8.0 GB
SK
SkyReels V2 DF 14B 720P
Skyreels · ThePun1sher
Params14.3B
Context—
Q4_K_M9.7 GB
QW
MiMo V2.6 Distill Qwen 9B
Qwen · Quantelium
Params8.95B
Context256K
Q4_K_M5.6 GB
FA
Falcon H1 Tiny Coder 90M
Falcon · tiiuae
Params108M
Context256K
Q4_K_M0.1 GB
HU
HunyuanVideo Avatar GGUF Experiment
Hunyuanvideo · lym00
Params13B
Context—
Q4_K_M8.0 GB
SP
Spark X2.6 1.7B
Spark · bartowski
Params1.71B
Context1024K
Q4_K_M1.1 GB
GI
GigaChat3-10B-A1.8B
Gigachat · Mungert
Params10.7B
Context256K
Q4_K_M6.7 GB
EV
FutureMa Eva 4B
Eva · bartowski
Params4.02B
Context256K
Q4_K_M2.5 GB
JI
jina-reranker-v3
Jina · jinaai
Params596M
Context128K
Q4_K_M0.4 GB
QW
Erebus RP Mini 4B Instruct 2608 v0.1
Qwen · Indexnusrefather
Params4.33B
Context256K
Q4_K_M2.8 GB
IN
InternLM2
InternLM · legraphista
Params7.74B
Context32K
Smallest1.9 GB
GE
Gemma 4 12B It
Gemma · axteam
Params11.9B
Context256K
Q4_K_M7.4 GB
AD
ADOPD
Adopd · prithivMLmods
Params4.4B
Context256K
Q4_K_M2.7 GB
MI
Mistral Nemo 12B ArliAI RPMax v1.2
Mistral · Lewdiculous
Params12.2B
Context1000K
Q4_K_M7.5 GB
GE
humanizer-12b
Gemma · Kathir121
Params11.9B
Context256K
Q4_K_M7.6 GB
QW
Ma7ee7 Qwen3.8 4B Distilled v2
Qwen · thebbg
Params4.02B
Context256K
Q4_K_M2.5 GB
QW
Qwen3 4B Instruct 2507 Claude Haiku 4.5 Distill
Qwen · TeichAI
Params4.02B
Context256K
Q4_K_M2.5 GB
LF
LFM3 1.7B
Lfm · prithivMLmods
Params1.73B
Context256K
Q4_K_M1.1 GB
QW
Qwen3 Coder 30B A3B Instruct
Qwen · Userb1az
Params30.5B
Context256K
Q4_K_M18.6 GB
LL
Dolphin3.0 Llama3.1 1B abliterated
Llama · NexesQuants
Params1.24B
Context128K
Smallest0.9 GB
QW
Qwen3.8-27B
Qwen · testingusera1
Params27.3B
Context256K
Q4_K_M16.5 GB
WA
Wanabi_Novelist_12B
Wanabi · kawaimasa
Params12.2B
Context128K
Q4_K_M7.5 GB
LF
LFM2.5-Audio-1.5B
Lfm · Mungert
Params1.17B
Context125K
Q4_K_M0.7 GB
AZ
Azure Dusk v0.2 GGUF IQ Imatrix
Azure · Lewdiculous
Params12.2B
Context1000K
Q4_K_M7.5 GB
MI
Mistral Nemo Instruct 2407
Mistral · legraphista
Params12.2B
Context1000K
Smallest3.0 GB
HE
Hearthfire 24B
Hearthfire · LatitudeGames
Params23.6B
Context128K
Q4_K_M14.3 GB
EX
EXAONE 4.0 1.2B
Exaone · bartowski
Params1.28B
Context64K
Q4_K_M0.8 GB
QW
Qwen_Qwen3.5 9B__project Jeva 9b_1791678248
Qwen · OPENGRAPE
Params9.08B
Context256K
Q4_K_M5.7 GB
IN
Internvl3-78B
Internvl · unsloth
Params72.7B
Context32K
Q4_K_M47.4 GB