GGUF models: cc-by-4.0 license
1077 GGUF models listed under the cc-by-4.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 7M to 114B parameters. The longest trained context is 1024K tokens.
KI
Kiwi 1.0 0.7B 32k
Kiwi · mradermacher
Params703M
Context32K
Q4_K_M0.5 GB
PA
Parakeet TDT 0.6B v3
Parakeet · ldov
Params627M
Context—
Q4_K_M0.5 GB
RA
Railz
Railz · mradermacher
Params596M
Context40K
Q4_K_M0.4 GB
LL
VersatiLlama Llama 3.2 3B Instruct Abliterated Imatrix
Llama · Devarui379
Params3.21B
Context128K
Smallest6.4 GB
GE
C2S Scale Gemma 2 2B
Gemma · MarselM
Params2.61B
Context8K
Q4_K_M1.7 GB
PA
Parakeet TDT 0.6B v3
Parakeet · epapanita
Params627M
Context—
Q4_K_M0.5 GB
LL
TroyDoesAI/Mermaid-Llama-3-8B
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
BI
BioMistral v0.2 i1
Biomistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
SL
Slerpeno
Slerpeno · Brouz
Params13B
Context4K
Smallest9.2 GB
JA
bardsai/jaskier-7b-dpo-v5.6
Jaskier · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
GE
PD_gemma 3n E2B
Gemma · mradermacher
Params4.46B
Context32K
Q4_K_M2.8 GB
FL
Fluid Speech Pro
Fluid · TalkMate
Params629M
Context—
Smallest0.7 GB
PA
Parakeet TDT-CTC 0.6B Japanese
Parakeet · ASRISEx
Params619M
Context—
Smallest0.7 GB
NE
OpenMath Nemotron 1.5B
Nemotron · mradermacher
Params1.54B
Context128K
Q4_K_M1.0 GB
RE
ReasonSQL 4B
Reasonsql · mradermacher
Params4.02B
Context256K
Q4_K_M2.5 GB
PA
parakeet-tdt-0.6b-v3.oss-align.q8_0
Parakeet · ezequiel-andrade
Params637M
Context—
Smallest0.7 GB
LL
CRAFT R1 Distill Llama 70B
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
PA
Parakeet RNN-T 1.1B
Parakeet · epapanita
Params1.07B
Context—
Q4_K_M0.8 GB
QW
azuolas qwen lt
Qwen · akisviete
Params2.35B
Context—
Smallest2.5 GB
LL
Juungwon Llama 3 Instruction Constructionsafety
Llama · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
NE
OpenReasoning Nemotron 32B
Nemotron · tensorblock
Params32.8B
Context128K
Smallest12.3 GB
MI
mistral 18B instruct v0.1
Mistral · mradermacher
Params17.7B
Context32K
Q4_K_M10.8 GB
RI
Rio 2 Video Vl
Rio · mradermacher
Params7.62B
Context125K
Q4_K_M4.7 GB
LE
LexCAT
Lexcat · mradermacher
Params278M
Context512
Q4_K_M0.2 GB
LL
OneGate/Llama3-OGSQL-FT-8B
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
HU
HuginnV5.6 12.6B i1
Huginnv · mradermacher
Params12.9B
Context8K
Q4_K_M7.9 GB
PY
C2S Pythia 410m Cell Type Prediction
Pythia · mradermacher
Params405M
Context4K
Q4_K_M0.3 GB
QW
PolyGuard Qwen Smol
Qwen · mradermacher
Params494M
Context32K
Q4_K_M0.4 GB
QW
jq coder 0.6B
Qwen · DominuZ
Params596M
Context32K
Smallest0.6 GB
DA
MN VelvetCafe RP 12B Q4 K M
Dans · IggyLux
Params12.2B
Context128K
Q4_K_M7.5 GB