BF16 GGUF models
Unquantized bfloat16. Original quality and the largest size. 9004 models have a BF16 file. Sizes run from 1M to 2780B parameters. The longest trained context is 10240K tokens.
QW
Qwen Drive 1.0 4B
Qwen · Hob-forge
Params4.2B
Context32K
Q4_K_M2.7 GB
VE
Veritas 12B
Veritas · bartowski
Params11.8B
Context128K
Q4_K_M7.3 GB
GE
gemma 3 4b it roleplay tuned v2
Gemma · Indexnusrefather
Params3.88B
Context128K
Q4_K_M2.5 GB
QW
Qwen3.8-27B
Qwen · emee-ai
Params27.3B
Context256K
Q4_K_M16.5 GB
HI
HiDream I1 Dev
Hidream · city96
Params17.1B
Context—
Q4_K_M11.5 GB
SH
Shuttle 3.5
Shuttle · bartowski
Params32.8B
Context40K
Q4_K_M19.8 GB
CH
CHEETAH 350M Merged
Cheetah · bartowski
Params354M
Context125K
Q4_K_M0.2 GB
GR
Grug 3b
Grug · bartowski
Params4.17B
Context256K
Q4_K_M2.7 GB
MI
Mistral NeMo Minitron 8B Base
Mistral · legraphista
Params8.41B
Context8K
Smallest2.1 GB
EX
EXAONE Deep 7.8B
Exaone · bartowski
Params7.8B
Context32K
Q4_K_M4.8 GB
FA
Falcon-H1-7B-Instruct
Falcon · unsloth
Params7.59B
Context256K
Q4_K_M4.6 GB
GE
gemma-4-12B-it-heretic
Gemma · JMingo
Params11.9B
Context256K
Q4_K_M7.1 GB
ON
OneJev1.5 9B
Onejev · prithivMLmods
Params8.95B
Context256K
Q4_K_M5.6 GB
EX
EXAONE Deep 32B
Exaone · bartowski
Params32B
Context32K
Q4_K_M19.3 GB
QW
NOESIS Qwopus3.5 9B Translate v3.5 BF16
Qwopus · AMAImedia
Params8.95B
Context256K
Smallest2.9 GB
LL
Cogito-V2-Preview-Llama-109B-Moe
Llama · unsloth
Params108B
Context256K
Q4_K_M65.4 GB
FA
Falcon H1 Tiny Tool Calling 90M
Falcon · tiiuae
Params108M
Context256K
Q4_K_M0.1 GB
AP
Apex 35B V1.0
Apex · prithivMLmods
Params35.5B
Context256K
Smallest18.6 GB
GE
Gemma-3-4B-It
Gemma · zw89
Params3.88B
Context128K
Q4_K_M2.5 GB
GE
Gemma 3 R1 4B v1
Gemma · bartowski
Params3.88B
Context128K
Q4_K_M2.5 GB
LF
LFM2 24B A2B
Lfm · NexaAI
Params23.8B
Context125K
Q4_K_M14.4 GB
QW
Qwen Image 2.1 PE T2I
Qwen · Moseyanling
Params8.95B
Context256K
Q4_K_M5.6 GB
GE
gemma 4 e2b it
Gemma · nile-academy
Params4.63B
Context128K
Smallest3.3 GB
LI
Ling-3.0-flash
Ling · inclusionAI
Params127B
Context256K
Q4_K_M77.0 GB
QW
bu-30b-a3b-preview
Qwen · Mungert
Params30.5B
Context256K
Q4_K_M18.9 GB
DA
PocketDoc Dans SakuraKaze V1.0.0 12b
Dans · bartowski
Params12.2B
Context1000K
Q4_K_M7.5 GB
TO
Tongyi-DeepResearch-30B-A3B
Tongyi · Mungert
Params30.5B
Context128K
Q4_K_M19.0 GB
CR
Crystal Think V2
Crystal · bartowski
Params4B
Context32K
Q4_K_M2.5 GB
LI
LightOnOCR-2-1B
Lightonocr · Mungert
Params596M
Context16K
Q4_K_M0.4 GB
KH
Al Khwarizmi 3B
Khwarizmi · mzoelfakar
Params3.08B
Context2K
Q4_K_M1.9 GB