F16 GGUF models

Unquantized 16-bit floats. Original quality and the largest size. 53239 models have a F16 file. Sizes run from 0M to 1030B parameters. The longest trained context is 10742K tokens.

Most downloadedNewestLargestLongest contextSmallest
NE
neural chat 7b v3 3
Neural · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
SM
SmolLM 135M GrammarSFT
SmolLM · mradermacher
Params135M
Context2K
Q4_K_M0.1 GB
GGUF
RE
lb reranker 0.5B v1.0
Reranker · bartowski
Params494M
Context32K
Q4_K_M0.4 GB
Embedding
GI
gigaam v3
Gigaam · cstr
Params221M
Context—
Smallest0.2 GB
GGUF
GE
Aura v1.1
Gemma · UncannyEcho
Params7.46B
Context128K
Smallest5.2 GB
Vision
GE
Gemma 4 26B A4B It Uncensored MAX
Gemma · prithivMLmods
Params25.2B
Context256K
Smallest26.9 GB
ReasoningVision
MI
Mistral 7B Instruct v0.3 Heretic
Mistral · saidutta69
Params7.25B
Context32K
Q4_K_M4.4 GB
Tool use
GE
Gemma 3 4B VL It GLM 4.7 Flash Heretic Uncensored Thinking
Gemma · mradermacher
Params3.88B
Context128K
Q4_K_M2.5 GB
ReasoningVision
IN
AlchemistCoder-DS-6.7B
InternLM · mradermacher
Params6.74B
Context16K
Q4_K_M4.1 GB
Coding
QW
Hermes-4-14B
Qwen · Mungert
Params14.8B
Context40K
Q4_K_M9.5 GB
ReasoningRoleplayTool use
YI
EVA Yi 1.5 9B 32K V1
Yi · mradermacher
Params8.83B
Context32K
Q4_K_M5.3 GB
GGUF
DA
danube2-1.8b-openhermes
Danube · mradermacher
Params1.83B
Context8K
Q4_K_M1.1 GB
Tool use
GE
Gemma 4 E2B It Assistant
Gemma · AtomicChat
Params77M
Context128K
Q4_K_M0.1 GB
GGUF
NE
nexus coder
Nexus · King3Djbl
Params1.54B
Context32K
Q4_K_M1.0 GB
Coding
MI
Mahou-1.2a-mistral-7B
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
LL
llama3.2 1b 2025 uncensored v2
Llama · carsenk
Params1.24B
Context128K
Smallest1.3 GB
CodingReasoning
BE
Beat This! (final0)
Beat · cstr
Params20M
Context—
Smallest0.0 GB
GGUF
LI
LightOnOCR 2 1B
Lightonocr · wangjazz
Params596M
Context16K
Q4_K_M0.4 GB
Vision
VE
Veena
Veena · Mungert
Params3.78B
Context128K
Q4_K_M2.5 GB
GGUF
QW
Qwen3 0.6B Uncensored
Qwen · Null-Guard
Params596M
Context40K
Q4_K_M0.4 GB
GGUF
QW
Qwen3 4B Instruct 2507 heretic
Qwen · saidutta69
Params4B
Context256K
Q4_K_M2.5 GB
ReasoningRoleplayTool use
PH
Phi 2 OmniMatrix
Phi · mradermacher
Params2.78B
Context2K
Q4_K_M1.7 GB
GGUF
QW
Zero To CAD Qwen3 VL 2B
Qwen · mradermacher
Params1.72B
Context256K
Q4_K_M1.1 GB
CodingTool useVision
LE
LegalOne 8B
Legalone · mradermacher
Params8.2B
Context40K
Q4_K_M5.0 GB
GGUF
QW
Qwen2.5 0.5B Instruct Abliterated
Qwen · mradermacher
Params494M
Context32K
Q4_K_M0.4 GB
GGUF
OL
OLMo 2 1124 7B Instruct
OLMo · allenai
Params7.3B
Context4K
Q4_K_M4.5 GB
GGUF
QW
Qwen3.5 4B
Qwen · mradermacher
Params4.21B
Context256K
Q4_K_M2.7 GB
Vision
MI
Mini-Omni2
Mini · cstr
Params782M
Context—
Smallest1.1 GB
GGUF
MI
mistral 7b v0.3 llama tokens
Mistral · Deeokay
Params7.25B
Context32K
Q4_K_M4.4 GB
GGUF
SW
Swallow-7b-hf
Swallow · mradermacher
Params6.83B
Context4K
Q4_K_M4.1 GB
GGUF

Other quants

Keep browsing