GGUF models: cc-by-nc-4.0 license

5195 GGUF models listed under the cc-by-nc-4.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 321B parameters. The longest trained context is 4194304K tokens.

Most downloadedNewestLargestLongest contextSmallest
QW
Qwen3.5 0.8b JP Tuned v1.1
Qwen · CloudGoat
Params773M
Context256K
Smallest0.8 GB
ReasoningTool use
IT
ITT Yi Ko 6B v2.0
Itt · RichardErkhov
Params6.18B
Context2K
Q4_K_M3.8 GB
GGUF
LL
Llama 3 Lumimaid 8B v0.1 OAS
Llama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
DR
Drex Dlm
Drex · nace-ai
Params8.19B
Context32K
Smallest8.7 GB
ReasoningTool use
ME
m-a-p/MERT-v2-FullSong
Mert · gorse-io
Params632M
Context—
Q4_K_M0.7 GB
GGUF
ME
m-a-p/MERT-v1-95M
Mert · gorse-io
Params94M
Context—
Q4_K_M0.1 GB
GGUF
CO
CohereLabs.command A Translate 08 2025
Command · Abu-Dju
Params111B
Context8K
Q4_K_M67.1 GB
Tool use
BR
rwitz2/go-bruins-v2.1
Bruins · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
AC
AceInstruct 72B
Aceinstruct · mradermacher
Params72.7B
Context128K
Q4_K_M47.4 GB
Coding
MI
MiquMaid v2 70B
Miqumaid · mradermacher
Params69B
Context32K
Q4_K_M41.4 GB
GGUF
QW
Qwen2.5 1.5B Instruct_Johnny_Silverhand_Merged
Qwen · lewiswatson
Params1.54B
Context32K
Q4_K_M1.0 GB
Tool use
LL
L3.1 8B Llamoutcast
Llamoutcast · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
AC
AceMath 72B Instruct
Acemath · mradermacher
Params72.7B
Context4K
Q4_K_M47.4 GB
GGUF
UN
Undi95 Llamix2 MLewd 4x13B
Undi · RichardErkhov
Params38.5B
Context32K
Q4_K_M23.3 GB
GGUF
MI
Flammen3
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
KO
KoSOLAR 10.7B QLoRA NEFTune Kolon v2.0
Kosolar · mradermacher
Params10.8B
Context4K
Q4_K_M6.5 GB
GGUF
MI
MN 12B Mimicore GreenSnake i1
Mimicore · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
MI
Mixtral 8x7B MoE RP Story
Mistral · Undi95
Params46.7B
Context32K
Q4_K_M26.4 GB
Roleplay
NE
S4nfs.Neeto 1.0 8b
Neeto · DevQuasar
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Meta Llama 3 8b Instruct Hf
Llama · RichardErkhov
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
RE
RemmMistral13b i1
Remmmistral · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
NI
Sao10K/L3-8B-Niitama-v1
Niitama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
MI
Mixtralmerge 8x7B Rebalanced Test
Mistral · mradermacher
Params46.7B
Context32K
Q4_K_M28.4 GB
GGUF
TH
Thespis CurtainCall 7b v0.2.1 i1
Thespis · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
LE
LewdGem
Lewdgem · mradermacher
Params38.5B
Context4K
Q4_K_M23.3 GB
GGUF
TT
f5 tts v1 base loom
Tts · loom-ai-org
Params356M
Context—
Smallest1.4 GB
GGUF
ME
melodyflow t24 30secs
Melodyflow · thepatch
Params962M
Context—
Smallest0.2 GB
GGUF
LL
maldv/badger-lambda-llama-3-8b
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
BO
Borealis 10.7B i1
Borealis · mradermacher
Params10.7B
Context4K
Q4_K_M6.6 GB
GGUF
SA
SauerkrautLM SOLAR Instruct
Sauerkrautlm · mradermacher
Params10.7B
Context8K
Q4_K_M6.5 GB
GGUF

Keep browsing