GGUF models: cc-by-nc-4.0 license

5195 GGUF models listed under the cc-by-nc-4.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 321B parameters. The longest trained context is 4194304K tokens.

Most downloadedNewestLargestLongest contextSmallest
NO
Novus 7b tr v1 i1
Novus · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
IC
IceAbsintheLoucheRP 7b
Iceabsintheloucherp · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
FR
FrankenMonarch 7B
Frankenmonarch · mradermacher
Params10.7B
Context32K
Q4_K_M6.6 GB
GGUF
OM
OmniBeagleSquaredMBX v3 7B v2 i1
Omnibeaglesquaredmbx · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
AC
E1 AceReason 14B
Acereason · mradermacher
Params14.8B
Context128K
Q4_K_M9.0 GB
CodingReasoningTool use
AY
Aya Medikal V2
Aya · mradermacher
Params8.03B
Context8K
Q4_K_M5.1 GB
GGUF
WI
WizardIceLemonTeaRP 32k
Wizardicelemontearp · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
WE
WestBeagle 7B i1
Westbeagle · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MA
macadeliccc SOLAR 10.7b Instruct dpo
Macadeliccc · RichardErkhov
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF
HY
hyperdrive 7b alpha
Hyperdrive · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
AI
Airoboros 33b Gpt4 2.0
Airoboros · mradermacher
Params32.5B
Context2K
Q4_K_M19.6 GB
GGUF
IN
Yi Ko 6B
Instruct · mradermacher
Params6.18B
Context2K
Q4_K_M3.8 GB
GGUF
ST
Starcannon Unleashed 12B v1.0
Starcannon · MaziyarPanahi
Params12.2B
Context1000K
Smallest8.5 GB
GGUF
MI
Noromaid v0.1 mixtral 8x7b Instruct v3
Mistral · mradermacher
Params46.7B
Context32K
Q4_K_M28.4 GB
GGUF
QW
pizza words
Qwen · umarsheikh303
Params773M
Context256K
Smallest0.8 GB
ReasoningTool use
AI
Airoboros Gpt 3.5 Turbo 100k 7b
Airoboros · mradermacher
Params6.74B
Context2K
Q4_K_M4.1 GB
GGUF
TO
Tower 7b EAX
Tower · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
KO
KolmOCR_v251129
Kolmocr · mradermacher
Params7.61B
Context125K
Q4_K_M4.7 GB
Vision
OP
OpenLLM Ro RoLlama2 7b Chat
Openllm · RichardErkhov
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
JI
jina embeddings v5 text small retrieval Q8A64
Jina · VelociQ8
Params621M
Context32K
Smallest0.6 GB
GGUF
KU
Kuwutu 7B CYOA GGUF v2
Kuwutu · KeinNiemand
Params7.62B
Context32K
Q4_K_M4.7 GB
GGUF
LU
Lumimaid v0.2 70B Heretic
Lumimaid · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
Tool use
LU
Lumimaid v0.2 123B
Lumimaid · bartowski
Params123B
Context128K
Q4_K_M73.2 GB
GGUF
BA
BagelMIsteryTour v2 8x7B
Bagelmisterytour · Artefact2
Params46.7B
Context32K
Q4_K_M28.4 GB
GGUF
OG
Ogno Monarch Jaskier Merge 7b OH PREF DPO
Ogno · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
AY
Models lenML Aya Expanse 8b Abliterated
Aya · MaziyarPanahi
Params8.03B
Context8K
Smallest5.7 GB
GGUF
AY
CohereForAI Aya Expanse 8b
Aya · tensorblock
Params8.03B
Context8K
Smallest3.4 GB
GGUF
SO
Solar M SakuraSolar Mixed
Solar · RichardErkhov
Params8.99B
Context4K
Q4_K_M5.4 GB
GGUF
OB
OBLIQ IR 3B No Distill
Obliq · mradermacher
Params3.21B
Context128K
Q4_K_M2.0 GB
GGUF
MI
Mistral-11B-AirOmniMix
Mistral · mradermacher
Params10.7B
Context32K
Q4_K_M6.5 GB
GGUF

Keep browsing