BF16 GGUF models
Unquantized bfloat16. Original quality and the largest size. 9004 models have a BF16 file. Sizes run from 1M to 2780B parameters. The longest trained context is 10240K tokens.
QW
Qwen3.5 35B Uncensored YaRN 1M
Qwen · Exil01
Params34.7B
Context256K
Q4_K_M21.2 GB
LL
OpenMath-CodeLlama-13b-Python-hf
Llama · Mungert
Params13B
Context16K
Q4_K_M7.8 GB
LL
R1 1776 Distill Llama 70b
Llama · unsloth
Params70.6B
Context128K
Q4_K_M42.5 GB
QW
Huihui-Qwen3.6-35B-A3B-abliterated
Qwen · dnnagy
Params35.5B
Context256K
Smallest21.3 GB
GE
Gemma 3 40b
Gemma · bartowski
Params39.8B
Context128K
Q4_K_M24.3 GB
QW
Qwen3.6 35B A3B Sydney
Qwen · Evidence114
Params34.7B
Context256K
Q4_K_M21.2 GB
QW
Qwen3.5 9B Distill Qwen 3.8 Flash 20261026
Qwen · kevinzhou21
Params9.2B
Context256K
Q4_K_M5.8 GB
QW
Qwen3.5 9B gemini 3.1 opus 4.6 reasoning
Qwen · Momix-44
Params8.95B
Context256K
Q4_K_M5.6 GB
GE
Gemma 4 12B it qat NVFP4
Gemma · WhiskyAKM
Params11.9B
Context256K
Smallest0.3 GB
VI
VisionGuardrail 4B
Visionguardrail · prithivMLmods
Params4.21B
Context256K
Q4_K_M2.7 GB
LF
LFM2.5 8B A1B Terminal ToolBench Full SFT 1Epoch
Lfm · LLM-OS-Models
Params8.47B
Context125K
Q4_K_M5.2 GB
ST
Step3 VL 10B
Step · JamePeng2023
Params8.19B
Context40K
Q4_K_M5.0 GB
JO
Josev 9B
Josev · mayflowergmbh
Params9.08B
Context256K
Q4_K_M5.7 GB
QW
MARTHA LXVIII.21b QWEN 3.5 3.6 prune 27b 3.6 base
Qwen · ZERO-POINT-AI
Params20.8B
Context256K
Q4_K_M12.9 GB
HO
HOT Step CPP PP VAE
Hot · scragnog
Params169M
Context—
Smallest0.3 GB
AR
Archaeo 12B V2
Archaeo · bartowski
Params12.2B
Context128K
Q4_K_M7.5 GB
MA
magnum 32b v1
Magnum · bartowski
Params32.5B
Context32K
Q4_K_M19.7 GB
AP
APUS OpenJev v1 4B
Apus · prithivMLmods
Params4.21B
Context256K
Q4_K_M2.7 GB
QW
Qwen3.6-35B-A3B
Qwen · a4lg
Params1.86B
Context256K
Q4_K_M1.6 GB
KI
Kimi K3 DSpark
Kimi · Anbeeld
Params2.25B
Context1024K
Q4_K_M1.3 GB
NE
NVIDIA-Nemotron-Nano-12B-v2
Nemotron · Mungert
Params12.3B
Context1024K
Q4_K_M7.9 GB
DE
DeepCoder-14B-Preview
DeepSeek · Mungert
Params14.8B
Context128K
Q4_K_M9.2 GB
GE
gemma 4 19b a4b it REAP
Gemma · barozp
Params18.4B
Context256K
Q4_K_M12.3 GB
QW
Qwen3.6-35B-A3B
Qwen · Shananhux
Params34.7B
Context256K
Q4_K_M22.1 GB
FA
Fara1.5 27B
Fara · prithivMLmods
Params26.9B
Context256K
Q4_K_M16.5 GB
LF
LFM2.5 8B A1B
Lfm · Mungert
Params8.47B
Context125K
Smallest0.0 GB
JA
Jan v1 AIO
Jan · prithivMLmods
Params4.02B
Context40K
Q4_K_M1.1 GB
LL
F2LLM v2 0.6B
Llm · yuvytung
Params596M
Context40K
Q4_K_M0.4 GB
QA
QaptaanLM 0.75B Instruct
Qaptaanlm · kaptaan45
Params752M
Context256K
Q4_K_M0.5 GB
RW
rwkv7-g1h-2.9b-20260710-ctx10240.pth
Rwkv · RemySkye
Params2.95B
Context1024K
Q4_K_M2.1 GB