GGUF models: cc-by-4.0 license

1077 GGUF models listed under the cc-by-4.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 7M to 114B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
JA
jaskier 7b dpo v5.6 i1
Jaskier · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
CO
CodeSteer v1
Codesteer · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
Coding
VE
MN VelvetCafe RP 12B
Velvetcafe · mradermacher
Params12.2B
Context128K
Q4_K_M7.5 GB
Roleplay
SL
SlimMelodicMaid i1
Slimmelodicmaid · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
TR
transcoda omr
Transcoda · cstr
Params59M
Context—
Smallest0.1 GB
GGUF
PI
piccolo 8x7b i1
Piccolo · mradermacher
Params46.7B
Context32K
Q4_K_M28.4 GB
GGUF
OP
opus-mt-en-es
Opus · cstr
Params78M
Context—
Smallest0.1 GB
GGUF
AZ
Azazelle Half NSFW Noromaid 7b
Azazelle · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
NE
OpenMath Nemotron 32B
Nemotron · DevQuasar-13
Params32.8B
Context128K
Q4_K_M19.9 GB
GGUF
LL
Devarui379 VersatiLlama Llama 3.2 3B Instruct Abliterated
Llama · RichardErkhov
Params3.21B
Context128K
Q4_K_M2.0 GB
Tool use
CR
MN Crimson Cafe 12B
Crimson · mradermacher
Params12.2B
Context128K
Q4_K_M7.5 GB
Roleplay
LE
LemonadeRP 4.5.3 GGUF IQ Imatrix
Lemonaderp · Lewdiculous
Params7.24B
Context32K
Q4_K_M4.4 GB
Roleplay
LL
One Shot CFT Math Llama 3B
Llama · mradermacher
Params3.21B
Context128K
Q4_K_M2.0 GB
Tool use
AF
AfriqueGemma 4B
Afriquegemma · mradermacher
Params4.55B
Context128K
Q4_K_M2.9 GB
Vision
BI
Bionic Cetacean 20B
Bionic · backyardai
Params20B
Context4K
Q4_K_M12.0 GB
Roleplay
MA
Manaca 1b Base
Manaca · mradermacher
Params1.72B
Context4K
Q4_K_M1.1 GB
GGUF
LL
LLMBG Llama 3.1 8B BG Reasoning
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
ReasoningTool use
VI
MN Violet Lotus 12B
Violet · Wabababb
Params12.2B
Context128K
Q4_K_M7.5 GB
RoleplayTool use
AR
ARC Base 8B
Arc · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
PA
parakeet-tdt-0.6b-v3
Parakeet · sakasegawa
Params627M
Context—
Smallest0.4 GB
GGUF
MH
MHC Coach
Mhc · mradermacher
Params70.6B
Context8K
Q4_K_M42.5 GB
GGUF
AF
AfriqueQwen3.5 4B ExtendedCM
Afriqueqwen · mradermacher
Params4.84B
Context256K
Q4_K_M3.1 GB
ReasoningTool useVision
GE
C2S Scale Gemma 2 27B
Gemma · mradermacher
Params27.2B
Context8K
Q4_K_M16.6 GB
GGUF
OP
opus-mt-de-ar
Opus · cstr
Params77M
Context—
Smallest0.1 GB
GGUF
OP
opus-mt-ar-de
Opus · cstr
Params77M
Context—
Smallest0.1 GB
GGUF
NE
OpenMath Nemotron 14B
Nemotron · DevQuasar-13
Params14.8B
Context128K
Q4_K_M9.0 GB
GGUF
MO
Mobile ReasoningLLM v0.1
Mobile · mradermacher
Params1.78B
Context128K
Q4_K_M1.1 GB
Reasoning
NE
OpenReasoning Nemotron 14B
Nemotron · lmstudio-community
Params14.8B
Context128K
Q4_K_M9.0 GB
Reasoning
AF
AfriqueLlama 8B
Afriquellama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
OP
opus-mt-fr-de
Opus · cstr
Params76M
Context—
Smallest0.1 GB
GGUF

Keep browsing