F16 GGUF models
Unquantized 16-bit floats. Original quality and the largest size. 53239 models have a F16 file. Sizes run from 0M to 1030B parameters. The longest trained context is 10742K tokens.
QW
RedSage Qwen3 8B Ins
Qwen · mradermacher
Params8.19B
Context32K
Q4_K_M5.0 GB
QW
Qwen3.5 4b Agentic Coder v4
Qwen · mradermacher
Params4.33B
Context256K
Q4_K_M2.8 GB
GU
GUI Owl 1.5 8B Think
Gui · mradermacher
Params8.19B
Context32K
Q4_K_M5.0 GB
PY
Pythia 2.8b Deduped
Pythia · mradermacher
Params2.78B
Context2K
Q4_K_M1.8 GB
QW
Qwen3 Reranker 4B
Qwen · giladgd
Params4B
Context40K
Q4_K_M2.5 GB
GE
gemma 3 4b instruct
Gemma · lm-kit
Params3.88B
Context128K
Q4_K_M2.5 GB
LL
Llama 3.1 Tulu 3 8B
Llama · bartowski
Params8B
Context128K
Q4_K_M4.9 GB
QW
jinaai/test-qwen25-coder-jina-code-embeddings-1.5b
Qwen · jinaai
Params1.54B
Context32K
Smallest0.4 GB
MI
Writing_Partner_Mistral_7B
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Open StarLake Swap 7B
Mistral · Aryanne
Params7.24B
Context32K
Smallest4.1 GB
LL
Kiel 2.1 Sol
Llama · kiel2
Params3.2B
Context128K
Q4_K_M2.0 GB
BI
Bielik 7B Instruct v0.1
Bielik · mradermacher
Params7.24B
Context4K
Q4_K_M4.4 GB
LL
CodeLlama 13B MORepair
Llama · bartowski
Params13B
Context16K
Q4_K_M7.9 GB
G9
G9v3 3B
NANI-Nithin
Params3B
Context128K
Q4_K_M1.8 GB
LL
Colossal LLaMA 2 7b Base
Llama · mradermacher
Params7.04B
Context4K
Q4_K_M4.3 GB
QW
Qwen3 VL 8B Instruct
Qwen · mradermacher
Params8.19B
Context256K
Q4_K_M5.0 GB
GL
Sentie1.0 3B Claude Fable 5 GPT5.2 Sol Kimi K3 GLM 5.2
GLM · SentieAI
Params3.93B
Context256K
Q4_K_M2.4 GB
OL
Olmo-3-7B-Instruct
OLMo · Mungert
Params7.3B
Context64K
Q4_K_M4.7 GB
QW
Qwen2.5 3B Instruct Heretic
Qwen · mradermacher
Params3.09B
Context32K
Q4_K_M1.9 GB
AT
Athena Codegemma 2 9b
Athena · bartowski
Params9.24B
Context8K
Q4_K_M5.8 GB
NA
Nanbeige4.1-3B
Nanbeige · Mungert
Params3.93B
Context256K
Q4_K_M2.6 GB
QW
Replete LLM V2.5 Qwen 3b
Qwen · bartowski
Params3.4B
Context32K
Q4_K_M2.1 GB
HA
Harmonic Hermes 9B
Harmonic · DJLougen
Params8.95B
Context256K
Q4_K_M5.6 GB
MI
Minimax-M2.7
Minimax · mudler
Params230B
Context192K
Smallest69.1 GB
RO
RolmOCR
Rolmocr · mradermacher
Params7.62B
Context125K
Q4_K_M4.7 GB
QW
Qwen3.5 9B Ultra Uncensored Heretic v2
Qwen · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
QW
ThinkingCap Qwen3.6 27B Heretic
Qwen · egibson
Params27B
Context256K
Q4_K_M16.5 GB
GE
Gemma 3 1b It
Gemma · gguf-org
Params1B
Context32K
Q4_K_M0.8 GB
MS
MSM MS Cydrion 22B
Msm · bartowski
Params22.2B
Context128K
Q4_K_M13.3 GB
YI
Yi-9B-200K
Yi · mradermacher
Params8.83B
Context256K
Q4_K_M5.3 GB