GGUF models: cc-by-4.0 license
1077 GGUF models listed under the cc-by-4.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 7M to 114B parameters. The longest trained context is 1024K tokens.
JA
jaskier 7b dpo v5.6 i1
Jaskier · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
CO
CodeSteer v1
Codesteer · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
VE
MN VelvetCafe RP 12B
Velvetcafe · mradermacher
Params12.2B
Context128K
Q4_K_M7.5 GB
SL
SlimMelodicMaid i1
Slimmelodicmaid · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
TR
transcoda omr
Transcoda · cstr
Params59M
Context—
Smallest0.1 GB
PI
piccolo 8x7b i1
Piccolo · mradermacher
Params46.7B
Context32K
Q4_K_M28.4 GB
OP
opus-mt-en-es
Opus · cstr
Params78M
Context—
Smallest0.1 GB
AZ
Azazelle Half NSFW Noromaid 7b
Azazelle · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
NE
OpenMath Nemotron 32B
Nemotron · DevQuasar-13
Params32.8B
Context128K
Q4_K_M19.9 GB
LL
Devarui379 VersatiLlama Llama 3.2 3B Instruct Abliterated
Llama · RichardErkhov
Params3.21B
Context128K
Q4_K_M2.0 GB
CR
MN Crimson Cafe 12B
Crimson · mradermacher
Params12.2B
Context128K
Q4_K_M7.5 GB
LE
LemonadeRP 4.5.3 GGUF IQ Imatrix
Lemonaderp · Lewdiculous
Params7.24B
Context32K
Q4_K_M4.4 GB
LL
One Shot CFT Math Llama 3B
Llama · mradermacher
Params3.21B
Context128K
Q4_K_M2.0 GB
AF
AfriqueGemma 4B
Afriquegemma · mradermacher
Params4.55B
Context128K
Q4_K_M2.9 GB
BI
Bionic Cetacean 20B
Bionic · backyardai
Params20B
Context4K
Q4_K_M12.0 GB
MA
Manaca 1b Base
Manaca · mradermacher
Params1.72B
Context4K
Q4_K_M1.1 GB
LL
LLMBG Llama 3.1 8B BG Reasoning
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
VI
MN Violet Lotus 12B
Violet · Wabababb
Params12.2B
Context128K
Q4_K_M7.5 GB
AR
ARC Base 8B
Arc · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
PA
parakeet-tdt-0.6b-v3
Parakeet · sakasegawa
Params627M
Context—
Smallest0.4 GB
MH
MHC Coach
Mhc · mradermacher
Params70.6B
Context8K
Q4_K_M42.5 GB
AF
AfriqueQwen3.5 4B ExtendedCM
Afriqueqwen · mradermacher
Params4.84B
Context256K
Q4_K_M3.1 GB
GE
C2S Scale Gemma 2 27B
Gemma · mradermacher
Params27.2B
Context8K
Q4_K_M16.6 GB
OP
opus-mt-de-ar
Opus · cstr
Params77M
Context—
Smallest0.1 GB
OP
opus-mt-ar-de
Opus · cstr
Params77M
Context—
Smallest0.1 GB
NE
OpenMath Nemotron 14B
Nemotron · DevQuasar-13
Params14.8B
Context128K
Q4_K_M9.0 GB
MO
Mobile ReasoningLLM v0.1
Mobile · mradermacher
Params1.78B
Context128K
Q4_K_M1.1 GB
NE
OpenReasoning Nemotron 14B
Nemotron · lmstudio-community
Params14.8B
Context128K
Q4_K_M9.0 GB
AF
AfriqueLlama 8B
Afriquellama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
OP
opus-mt-fr-de
Opus · cstr
Params76M
Context—
Smallest0.1 GB