BF16 GGUF models

Unquantized bfloat16. Original quality and the largest size. 9004 models have a BF16 file. Sizes run from 1M to 2780B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
MU
TQ3.5 27B Musica v1
Musica · bartowski
Params26.9B
Context256K
Q4_K_M17.5 GB
ReasoningRoleplayTool use
AP
APUS OpenJev v1 9B
Apus · timfromhcs
Params8.95B
Context256K
Q4_K_M5.6 GB
ReasoningTool use
QW
Qwen2.5-1.5B-Instruct
Qwen · Mungert
Params1.54B
Context32K
Q4_K_M1.0 GB
Tool use
NO
NovelAI-LM-3B-508k
Novelai · NovelAI
Params3.04B
Context2K
Q4_K_M2.0 GB
GGUF
GE
Gemopus 4 E4B it
Gemopus · Jackrong
Params7.52B
Context128K
Q4_K_M5.3 GB
ReasoningVision
QW
QwenPaw Flash 9B
Qwen · agentscope-ai
Params8.95B
Context256K
Smallest17.9 GB
ReasoningTool use
GE
Gemma 4 31B It
Gemma · axteam
Params30.7B
Context256K
Q4_K_M18.7 GB
ReasoningTool useVision
GE
Cerberus E4B
Gemma · rrchat
Params7.52B
Context128K
Q4_K_M5.3 GB
ReasoningTool useVision
QW
Qwen3.8 27B Opus Distill
Qwen · barozp
Params27.3B
Context256K
Q4_K_M16.8 GB
ReasoningTool useVision
LL
FineLlama 3.1 8B
Llama · mlabonne
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
MI
Mistral Small Instruct 2409 Abliterated
Mistral · bartowski
Params22.2B
Context32K
Q4_K_M13.3 GB
Tool use
GU
GA Guard AIO
Guard · prithivMLmods
Params4.02B
Context250K
Q4_K_M0.4 GB
GGUF
MI
Magistral-Small-2507
Mistral · unsloth
Params23.6B
Context40K
Q4_K_M14.3 GB
ReasoningTool use
QW
Qwen3 0.6B tg signal extract
Qwen · Sigrex
Params596M
Context40K
Q4_K_M0.4 GB
ReasoningTool use
LL
llm-compiler-13b
Llm · legraphista
Params13B
Context16K
Smallest2.9 GB
GGUF
QW
HauhauCS Qwen3.5 4B Uncensored HauhauCS Aggressive
Qwen · CCSSNE
Params4.21B
Context256K
Q4_K_M2.7 GB
ReasoningTool useVision
ME
MedPsy 1.7B
Medpsy · qvac
Params2.03B
Context40K
Q4_K_M1.3 GB
ReasoningTool use
QW
Palette RP 4B 2609 v0.1
Qwen · Indexnusrefather
Params4.21B
Context256K
Q4_K_M2.7 GB
ReasoningRoleplayTool use
MA
ML2 123B Magnum Diamond
Magnum · Doctor-Shotgun
Params123B
Context128K
Q4_K_M73.2 GB
GGUF
GE
Tinman gemma4 companion
Gemma · Tinman-Lab
Params7.46B
Context128K
Q4_K_M5.3 GB
Roleplay
WE
WeMM Embedding 2B
Wemm · DreamBlooms
Params2.39B
Context256K
Q4_K_M1.6 GB
EmbeddingVision
LL
Llama-3_3-Nemotron-Super-49B-v1_5
Llama · Mungert
Params49.9B
Context128K
Q4_K_M30.6 GB
ReasoningTool use
QW
Qwen3.5-9B-Uncensored-HauhauCS-Aggressive-BF16
Qwen · Unrestricted
Params8.95B
Context256K
Q4_K_M5.6 GB
ReasoningTool useVision
OL
Olmo-2-0425-1B-Instruct
OLMo · unsloth
Params1.48B
Context4K
Q4_K_M0.9 GB
GGUF
BI
BigBang Aquila 35B Merged Abliterated
Bigbang · Davd-b01
Params34.7B
Context256K
Q4_K_M21.2 GB
ReasoningTool use
GE
gemma 3 27b it ultra uncensored heretic
Gemma · llmfan46
Params27B
Context128K
Q4_K_M16.5 GB
Vision
FL
flux dev de distill
Flux · BigStationW
Params11.9B
Context—
Q4_K_M6.9 GB
GGUF
IN
Infinity Parser2 Flash
Infinity · prithivMLmods
Params1.88B
Context256K
Q4_K_M1.3 GB
ReasoningTool useVision
PL
Plamo 2 Translate
Plamo · mitmul
Params9.53B
Context10240K
Q4_K_M6.3 GB
GGUF
QW
Qwen3 30B A3B Mixture 2507
Qwen · bartowski
Params30.5B
Context256K
Q4_K_M18.6 GB
ReasoningTool use

Other quants

Keep browsing