BF16 GGUF models
Unquantized bfloat16. Original quality and the largest size. 9004 models have a BF16 file. Sizes run from 1M to 2780B parameters. The longest trained context is 10240K tokens.
LF
LFM2.5 8B A1B Hermes Agentic Coder Abliterated v2
Lfm · DuoNeural
Params8.47B
Context125K
Q4_K_M5.2 GB
QW
Qwen3.5 2B
Qwen · prithivMLmods
Params1.94B
Context256K
Q4_K_M1.3 GB
EL
EleMo V3 Base
Elemo · Earlychildhoodeducation
Params27.3B
Context256K
Q4_K_M16.5 GB
LF
LFM2 350M Extract
Lfm · bartowski
Params354M
Context125K
Q4_K_M0.2 GB
IN
Internvl3-8B-Instruct
Internvl · unsloth
Params7.61B
Context32K
Q4_K_M4.7 GB
DR
Drex v1.5
Drex · prithivMLmods
Params8.95B
Context256K
Q4_K_M5.6 GB
QW
LocateAnything-3B
Qwen · Mungert
Params3.4B
Context32K
Q4_K_M2.4 GB
VE
Velvet Eclipse 4x12B v0.2
Velvet · bartowski
Params38.7B
Context1000K
Q4_K_M23.5 GB
SN
Snowpiercer 15B v2
Snowpiercer · bartowski
Params15B
Context64K
Q4_K_M9.1 GB
GR
Granite 4.2 8B BE
Granite · taronaeo
Params8.79B
Context128K
Q4_K_M5.3 GB
GE
RiverCub Gemma 3 27B
Gemma · bartowski
Params27B
Context128K
Q4_K_M16.5 GB
QW
Qwen3-0.6B
Qwen · openwalrus
Params596M
Context40K
Q4_K_M0.4 GB
LF
LFM2 350M Math
Lfm · bartowski
Params354M
Context125K
Q4_K_M0.2 GB
GE
vi humanizer gemma 4 e2b
Gemma · contextboxai
Params4.63B
Context128K
Q4_K_M3.4 GB
NE
Nemotron 3.5 Lightning Omni 30B A3B
Nemotron · engram-ae
Params32.9B
Context1024K
Q4_K_M25.4 GB
QW
UIGEN-X-8B
Qwen · Mungert
Params8.19B
Context40K
Q4_K_M5.2 GB
FA
Fara1.5 4B
Fara · prithivMLmods
Params4.21B
Context256K
Q4_K_M2.7 GB
QW
Luau Qwen3 4B FIM v0.1
Qwen · TorpedoSoftware
Params4.02B
Context256K
Smallest2.1 GB
IN
Internvl3-14B
Internvl · unsloth
Params14.8B
Context32K
Q4_K_M9.0 GB
MU
Muse-Glimmer-30B-DFlash2
Muse · z-lab
Params2.77B
Context128K
Q4_K_M1.6 GB
QW
Qwen3 Sex
Qwen · evildevlive
Params4.02B
Context256K
Smallest4.3 GB
MX
mxbai-rerank-large-v2
Mxbai · Mungert
Params1.54B
Context32K
Q4_K_M1.0 GB
LL
llm-compiler-13b-ftd
Llm · legraphista
Params13B
Context16K
Smallest2.9 GB
PH
Phi-4-reasoning-plus
Phi · Mungert
Params14.7B
Context32K
Q4_K_M9.2 GB
BL
Q3.5 BlueStar v2 27B
Bluestar · zerofata
Params27B
Context256K
Q4_K_M16.5 GB
LU
Lumimaid v0.2 12B GGUF IQ Imatrix
Lumimaid · Lewdiculous
Params12.2B
Context1000K
Q4_K_M7.5 GB
QW
Qwen2 7B
Qwen · fedric95
Params7.62B
Context128K
Q4_K_M4.7 GB
QW
Qwen3.5 27B ultra uncensored heretic v1
Qwen · llmfan46
Params27B
Context256K
Q4_K_M16.5 GB
JA
AI21 Jamba2 3B
Jamba · bartowski
Params3.2B
Context256K
Q4_K_M1.9 GB
QW
SWE-agent-LM-32B
Qwen · Mungert
Params32.8B
Context32K
Q4_K_M19.8 GB