GGUF models: cc-by-nc-4.0 license
5195 GGUF models listed under the cc-by-nc-4.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 321B parameters. The longest trained context is 4194304K tokens.
QW
Qwen3.5 0.8b JP Tuned v1.1
Qwen · CloudGoat
Params773M
Context256K
Smallest0.8 GB
IT
ITT Yi Ko 6B v2.0
Itt · RichardErkhov
Params6.18B
Context2K
Q4_K_M3.8 GB
LL
Llama 3 Lumimaid 8B v0.1 OAS
Llama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
DR
Drex Dlm
Drex · nace-ai
Params8.19B
Context32K
Smallest8.7 GB
ME
m-a-p/MERT-v2-FullSong
Mert · gorse-io
Params632M
Context—
Q4_K_M0.7 GB
ME
m-a-p/MERT-v1-95M
Mert · gorse-io
Params94M
Context—
Q4_K_M0.1 GB
CO
CohereLabs.command A Translate 08 2025
Command · Abu-Dju
Params111B
Context8K
Q4_K_M67.1 GB
BR
rwitz2/go-bruins-v2.1
Bruins · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
AC
AceInstruct 72B
Aceinstruct · mradermacher
Params72.7B
Context128K
Q4_K_M47.4 GB
MI
MiquMaid v2 70B
Miqumaid · mradermacher
Params69B
Context32K
Q4_K_M41.4 GB
QW
Qwen2.5 1.5B Instruct_Johnny_Silverhand_Merged
Qwen · lewiswatson
Params1.54B
Context32K
Q4_K_M1.0 GB
LL
L3.1 8B Llamoutcast
Llamoutcast · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
AC
AceMath 72B Instruct
Acemath · mradermacher
Params72.7B
Context4K
Q4_K_M47.4 GB
UN
Undi95 Llamix2 MLewd 4x13B
Undi · RichardErkhov
Params38.5B
Context32K
Q4_K_M23.3 GB
MI
Flammen3
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
KO
KoSOLAR 10.7B QLoRA NEFTune Kolon v2.0
Kosolar · mradermacher
Params10.8B
Context4K
Q4_K_M6.5 GB
MI
MN 12B Mimicore GreenSnake i1
Mimicore · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
MI
Mixtral 8x7B MoE RP Story
Mistral · Undi95
Params46.7B
Context32K
Q4_K_M26.4 GB
NE
S4nfs.Neeto 1.0 8b
Neeto · DevQuasar
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
Meta Llama 3 8b Instruct Hf
Llama · RichardErkhov
Params8.03B
Context8K
Q4_K_M4.9 GB
RE
RemmMistral13b i1
Remmmistral · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
NI
Sao10K/L3-8B-Niitama-v1
Niitama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
MI
Mixtralmerge 8x7B Rebalanced Test
Mistral · mradermacher
Params46.7B
Context32K
Q4_K_M28.4 GB
TH
Thespis CurtainCall 7b v0.2.1 i1
Thespis · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
LE
LewdGem
Lewdgem · mradermacher
Params38.5B
Context4K
Q4_K_M23.3 GB
TT
f5 tts v1 base loom
Tts · loom-ai-org
Params356M
Context—
Smallest1.4 GB
ME
melodyflow t24 30secs
Melodyflow · thepatch
Params962M
Context—
Smallest0.2 GB
LL
maldv/badger-lambda-llama-3-8b
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
BO
Borealis 10.7B i1
Borealis · mradermacher
Params10.7B
Context4K
Q4_K_M6.6 GB
SA
SauerkrautLM SOLAR Instruct
Sauerkrautlm · mradermacher
Params10.7B
Context8K
Q4_K_M6.5 GB