GGUF models: cc-by-nc-4.0 license
5195 GGUF models listed under the cc-by-nc-4.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 321B parameters. The longest trained context is 4194304K tokens.
BE
BeagSake 7B
Beagsake · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
QW
factusight 9B
Qwen · manuelgscom
Params8.95B
Context256K
Q4_K_M5.6 GB
MA
Mantis 50M
Mantis · kash8080
Params49M
Context1K
Smallest0.1 GB
PS
psarai_speech_stage_s15nn9in
Psarai · nphearum
Params93M
Context—
Smallest0.4 GB
ST
StartLux Decision v1 9B BF16
Startlux · startlux-models
Params8.95B
Context256K
Smallest17.9 GB
RH
L3 Rhaenys 8B
Rhaenys · bartowski
Params8.03B
Context8K
Q4_K_M4.9 GB
BI
BigL 7B i1
Bigl · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
AL
Alsebay/Narumashi-RT-11B
Alsebay · featherless-ai-quants
Params10.7B
Context4K
Q4_K_M6.5 GB
LL
lightblue/suzume-llama-3-8B-multilingual-orpo-borda-top25
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
TO
Undi95/Toppy-M-7B
Toppy · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
LD
LDCC SOLAR 10.7B
Ldcc · mradermacher
Params10.9B
Context4K
Q4_K_M6.6 GB
LL
NeverSleep Llama 3 Lumimaid 70B v0.1
Llama · RichardErkhov
Params70.6B
Context8K
Q4_K_M42.5 GB
LO
Loyal Macaroni Maid 7B
Loyal · mradermacher
Params7.24B
Context8K
Q4_K_M4.4 GB
IA
Iambe RP cDPO 20b
Iambe · mradermacher
Params20B
Context4K
Q4_K_M12.2 GB
LL
Llama 3.1 Arctic ExCoT 70B
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
SP
Spaetzle v85 7b
Spaetzle · cstr
Params7.24B
Context32K
Q4_K_M4.4 GB
RE
MM ReMM L2 20B
Remm · tensorblock
Params20B
Context4K
Smallest7.4 GB
BT
4BTestRC
Btestrc · mradermacher
Params4.41B
Context256K
Q4_K_M2.7 GB
CH
ChatWaifu_22B_v2.0_preview
Chatwaifu · mradermacher
Params22.2B
Context32K
Q4_K_M13.3 GB
OM
OmniLing V1 12b experimental
Omniling · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
NO
NeverSleep Noromaid 13b v0.2
Noromaid · tensorblock
Params13B
Context4K
Smallest4.9 GB
TH
Thespis Krangled 7b
Thespis · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
YU
Yue2 3B GGUF Quantized
Yue · jagamypriera
Params3.63B
Context—
Smallest0.3 GB
PA
paulml OmniBeagleSquaredMBX v3 7B v2
Paulml · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
MiniusLight 24B v1.01
Miniuslight · tensorblock
Params23.6B
Context32K
Smallest8.9 GB
TE
Tessera 4B Preview
Tessera · sahilchachra
Params4.33B
Context256K
Q4_K_M2.8 GB
NE
Monarch 7B
Neuralmonarch · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
SP
cstr/Spaetzle-v60-7b
Spaetzle · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
CO
Command A 03 2025 Writer v1
Command · mradermacher
Params111B
Context128K
Smallest42.1 GB
DE
Deacon 1b
Deacon · mradermacher
Params1.1B
Context2K
Q4_K_M0.7 GB