GGUF models: cc-by-4.0 license

1077 GGUF models listed under the cc-by-4.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 7M to 114B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
KI
Kiwi 1.0 0.7B 32k
Kiwi · mradermacher
Params703M
Context32K
Q4_K_M0.5 GB
Tool use
PA
Parakeet TDT 0.6B v3
Parakeet · ldov
Params627M
Context—
Q4_K_M0.5 GB
GGUF
RA
Railz
Railz · mradermacher
Params596M
Context40K
Q4_K_M0.4 GB
ReasoningTool use
LL
VersatiLlama Llama 3.2 3B Instruct Abliterated Imatrix
Llama · Devarui379
Params3.21B
Context128K
Smallest6.4 GB
Tool use
GE
C2S Scale Gemma 2 2B
Gemma · MarselM
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
PA
Parakeet TDT 0.6B v3
Parakeet · epapanita
Params627M
Context—
Q4_K_M0.5 GB
GGUF
LL
TroyDoesAI/Mermaid-Llama-3-8B
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
BI
BioMistral v0.2 i1
Biomistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
SL
Slerpeno
Slerpeno · Brouz
Params13B
Context4K
Smallest9.2 GB
GGUF
JA
bardsai/jaskier-7b-dpo-v5.6
Jaskier · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
GE
PD_gemma 3n E2B
Gemma · mradermacher
Params4.46B
Context32K
Q4_K_M2.8 GB
GGUF
FL
Fluid Speech Pro
Fluid · TalkMate
Params629M
Context—
Smallest0.7 GB
GGUF
PA
Parakeet TDT-CTC 0.6B Japanese
Parakeet · ASRISEx
Params619M
Context—
Smallest0.7 GB
GGUF
NE
OpenMath Nemotron 1.5B
Nemotron · mradermacher
Params1.54B
Context128K
Q4_K_M1.0 GB
Reasoning
RE
ReasonSQL 4B
Reasonsql · mradermacher
Params4.02B
Context256K
Q4_K_M2.5 GB
Tool use
PA
parakeet-tdt-0.6b-v3.oss-align.q8_0
Parakeet · ezequiel-andrade
Params637M
Context—
Smallest0.7 GB
GGUF
LL
CRAFT R1 Distill Llama 70B
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
ReasoningTool use
PA
Parakeet RNN-T 1.1B
Parakeet · epapanita
Params1.07B
Context—
Q4_K_M0.8 GB
GGUF
QW
azuolas qwen lt
Qwen · akisviete
Params2.35B
Context—
Smallest2.5 GB
GGUF
LL
Juungwon Llama 3 Instruction Constructionsafety
Llama · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
GGUF
NE
OpenReasoning Nemotron 32B
Nemotron · tensorblock
Params32.8B
Context128K
Smallest12.3 GB
CodingReasoning
MI
mistral 18B instruct v0.1
Mistral · mradermacher
Params17.7B
Context32K
Q4_K_M10.8 GB
GGUF
RI
Rio 2 Video Vl
Rio · mradermacher
Params7.62B
Context125K
Q4_K_M4.7 GB
Vision
LE
LexCAT
Lexcat · mradermacher
Params278M
Context512
Q4_K_M0.2 GB
Coding
LL
OneGate/Llama3-OGSQL-FT-8B
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
HU
HuginnV5.6 12.6B i1
Huginnv · mradermacher
Params12.9B
Context8K
Q4_K_M7.9 GB
GGUF
PY
C2S Pythia 410m Cell Type Prediction
Pythia · mradermacher
Params405M
Context4K
Q4_K_M0.3 GB
GGUF
QW
PolyGuard Qwen Smol
Qwen · mradermacher
Params494M
Context32K
Q4_K_M0.4 GB
Tool use
QW
jq coder 0.6B
Qwen · DominuZ
Params596M
Context32K
Smallest0.6 GB
Coding
DA
MN VelvetCafe RP 12B Q4 K M
Dans · IggyLux
Params12.2B
Context128K
Q4_K_M7.5 GB
Roleplay

Keep browsing