GGUF models: cc-by-4.0 license
1077 GGUF models listed under the cc-by-4.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 7M to 114B parameters. The longest trained context is 1024K tokens.
GP
Codegpt Oss 20b
gpt-oss · mradermacher
Params20.9B
Context128K
Q4_K_M15.8 GB
ST
stt en fastconformer ctc xlarge
Stt · cstr
Params609M
Context—
Smallest0.4 GB
PA
parakeet tdt 0.6b v3
Parakeet · pszemraj
Params627M
Context—
Smallest0.7 GB
DA
danskgpt v4 31b
Danskgpt · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
NE
Mirage OpenReasoning Nemotron 7B
Nemotron · mradermacher
Params7.62B
Context128K
Q4_K_M4.7 GB
NI
Nina v2 7B GGUF IQ Imatrix
Nina · Lewdiculous
Params7.24B
Context32K
Q4_K_M4.4 GB
EV
EVO SOLAR 10.7B v0.1
Evo · mradermacher
Params10.3B
Context4K
Q4_K_M6.2 GB
PA
Parakeet Unified EN 0.6B
Parakeet · tryambientai
Params618M
Context—
Smallest0.7 GB
PH
Fatiman mini V1
Phonon · jsbeaudry
Params41M
Context—
Smallest0.1 GB
LO
lola v1
Lola · QuantFactory
Params3.82B
Context4K
Q4_K_M2.4 GB
PH
saiga phi 3 mini 4k
Phi · mradermacher
Params3.82B
Context4K
Q4_K_M2.4 GB
NE
OpenMath Nemotron 7B
Nemotron · lmstudio-community
Params7.62B
Context128K
Q4_K_M4.7 GB
SI
Sina Thor 7b Merge
Sina · mradermacher
Params7.24B
Context32K
Q4_K_M4.5 GB
LL
Llama 3 8B Omnibus 1 PL v01 INSTRUCT
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
Llama3 2B Base
Llama · mradermacher
Params2.36B
Context8K
Q4_K_M1.5 GB
ME
.\Mermaid\
Mermaid · mradermacher
Params12B
Context4K
Q4_K_M7.2 GB
PA
Parakeet CTC 1.1B
Parakeet · epapanita
Params1.06B
Context—
Q4_K_M0.8 GB
MO
Mobile ReasoningLLM v0.1
Mobile · mradermacher
Params1.78B
Context128K
Q4_K_M1.1 GB
JA
jaskier 7b NeuralDPO
Jaskier · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
QW
Privoid Safety Qwen3.5 0.8B
Qwen · Privoid-ai
Params773M
Context256K
Q4_K_M0.5 GB
OP
Open Maid Samantha Hermes Orca dare tiesv0.1 i1
Open · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
SL
SlimMelodicMaid
Slimmelodicmaid · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
mistral 9B instruct v0.2
Mistral · mradermacher
Params8.99B
Context32K
Q4_K_M5.6 GB
QW
OpenMath-Nemotron-14B-Kaggle
Qwen · Mungert
Params14.8B
Context128K
Q4_K_M9.1 GB
PL
plapre nano
Plapre · syvai
Params335M
Context8K
Q4_K_M0.2 GB
DR
DRA DR.GRPO
Dra · mradermacher
Params1.78B
Context128K
Q4_K_M1.1 GB
WI
William_Tyndale
William · mradermacher
Params61M
Context512
Q4_K_M0.0 GB
TH
L3-TheSpice-8b-v0.1.3
Thespice · Lewdiculous
Params8.03B
Context8K
Q4_K_M4.9 GB
ST
conformer ctc small loom
Stt · loom-ai-org
Params15M
Context—
Smallest0.1 GB
CH
Chaifighter 20B
Chaifighter · mradermacher
Params20.8B
Context4K
Q4_K_M12.5 GB