GGUF models: cc-by-nc-4.0 license

5195 GGUF models listed under the cc-by-nc-4.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 321B parameters. The longest trained context is 4194304K tokens.

Most downloadedNewestLargestLongest contextSmallest
NI
L3.1 8B Niitama v1.1
Niitama · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
IT
ITT Yi Ko 6B v5.0
Itt · RichardErkhov
Params6.18B
Context2K
Q4_K_M3.8 GB
GGUF
QU
quantumaikr/quantum-v0.01
Quantum · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
EI
Eileithyia 20b i1
Eileithyia · mradermacher
Params20B
Context4K
Q4_K_M12.2 GB
GGUF
XL
xLAM v0.1 r
Xlam · tensorblock
Params46.7B
Context32K
Smallest17.3 GB
Tool use
ST
Starling Monarch Westlake Garten 7B v0.1 i1
Starling · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
UN
unimate_uniml3d_f60_v3
Unimate · Goddard
Params110M
Context—
Smallest0.3 GB
GGUF
SO
CallComply/SOLAR-10.7B-Instruct-v1.0-128k
Solar · featherless-ai-quants
Params10.7B
Context128K
Q4_K_M6.5 GB
GGUF
SO
SOLAR 10.7B v1.4
Solar · mradermacher
Params10.8B
Context4K
Q4_K_M6.5 GB
GGUF
DA
DataVortexS 10.7B Dpo v1.1
Datavortexs · mradermacher
Params10.9B
Context2K
Q4_K_M6.5 GB
GGUF
DA
Dawn v2 70B
Dawn · mradermacher
Params69B
Context4K
Q4_K_M41.4 GB
GGUF
AI
Mu0Gum AIFT Yi Ko 6B v1.11
Aift · tensorblock
Params6.18B
Context2K
Smallest2.4 GB
GGUF
TE
L3-TenyxChat-Daybreak-Storywriter-RAE-70B
Tenyxchat · Quant-Cartel
Params70.6B
Context8K
Q4_K_M42.5 GB
GGUF
LL
care arabic llama3.1 8b
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
UN
Unholy v1.1 13B
Unholy · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
QW
nvidia.Nemotron Research Reasoning Qwen 1.5B
Qwen · DevQuasar
Params1.78B
Context128K
Q4_K_M1.1 GB
ReasoningTool use
PA
PaperPrediction LLM 1B
Paperprediction · mradermacher
Params1.24B
Context128K
Q4_K_M0.8 GB
GGUF
QW
factusight 2B
Qwen · manuelgscom
Params1.88B
Context256K
Q4_K_M1.3 GB
ReasoningTool useVision
BA
MN BackyardAI Party 12B v1
Backyardai · QuantFactory
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
QW
Qwen2.5 3B Instruct Function Calling xLAM
Qwen · ermiaazarkhalili
Params3.09B
Context32K
Q4_K_M1.9 GB
Tool use
BE
Beagle14 7B
Beagle · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
LL
Llama-3-Lumimaid-8B-v0.1-OAS
Llama · backyardai
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
AR
Arsenic Shahrazad 12B v3
Arsenic · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
Tool use
LL
Llama 3.1 8B Stheno v3.4
Llama · DarqueDante
Params8.03B
Context128K
Smallest4.4 GB
GGUF
PA
PaperPrediction LLM 4B
Paperprediction · mradermacher
Params4.02B
Context40K
Q4_K_M2.5 GB
ReasoningTool use
TE
L3-TenyxChat-Daybreak-Storywriter-RAE-70B
Tenyxchat · mradermacher
Params70.6B
Context8K
Q4_K_M42.5 GB
GGUF
SO
Kodonho SolarM SakuraSolar SLERP
Solarm · tensorblock
Params10.7B
Context4K
Smallest4.0 GB
GGUF
CA
Cat 8x7B
Cat · Artefact2
Params46.7B
Context32K
Q4_K_M28.4 GB
GGUF
ST
StopCarbon 10.7B v3
Stopcarbon · RichardErkhov
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF
MI
MN 12B Mimicore Orochi
Mimicore · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF

Keep browsing