GGUF models: cc-by-nc-4.0 license
5195 GGUF models listed under the cc-by-nc-4.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 321B parameters. The longest trained context is 4194304K tokens.
NO
Novus 7b tr v1 i1
Novus · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
IC
IceAbsintheLoucheRP 7b
Iceabsintheloucherp · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
FR
FrankenMonarch 7B
Frankenmonarch · mradermacher
Params10.7B
Context32K
Q4_K_M6.6 GB
OM
OmniBeagleSquaredMBX v3 7B v2 i1
Omnibeaglesquaredmbx · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
AC
E1 AceReason 14B
Acereason · mradermacher
Params14.8B
Context128K
Q4_K_M9.0 GB
AY
Aya Medikal V2
Aya · mradermacher
Params8.03B
Context8K
Q4_K_M5.1 GB
WI
WizardIceLemonTeaRP 32k
Wizardicelemontearp · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
WE
WestBeagle 7B i1
Westbeagle · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
MA
macadeliccc SOLAR 10.7b Instruct dpo
Macadeliccc · RichardErkhov
Params10.7B
Context4K
Q4_K_M6.5 GB
HY
hyperdrive 7b alpha
Hyperdrive · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
AI
Airoboros 33b Gpt4 2.0
Airoboros · mradermacher
Params32.5B
Context2K
Q4_K_M19.6 GB
IN
Yi Ko 6B
Instruct · mradermacher
Params6.18B
Context2K
Q4_K_M3.8 GB
ST
Starcannon Unleashed 12B v1.0
Starcannon · MaziyarPanahi
Params12.2B
Context1000K
Smallest8.5 GB
MI
Noromaid v0.1 mixtral 8x7b Instruct v3
Mistral · mradermacher
Params46.7B
Context32K
Q4_K_M28.4 GB
QW
pizza words
Qwen · umarsheikh303
Params773M
Context256K
Smallest0.8 GB
AI
Airoboros Gpt 3.5 Turbo 100k 7b
Airoboros · mradermacher
Params6.74B
Context2K
Q4_K_M4.1 GB
TO
Tower 7b EAX
Tower · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
KO
KolmOCR_v251129
Kolmocr · mradermacher
Params7.61B
Context125K
Q4_K_M4.7 GB
OP
OpenLLM Ro RoLlama2 7b Chat
Openllm · RichardErkhov
Params6.74B
Context4K
Q4_K_M4.1 GB
JI
jina embeddings v5 text small retrieval Q8A64
Jina · VelociQ8
Params621M
Context32K
Smallest0.6 GB
KU
Kuwutu 7B CYOA GGUF v2
Kuwutu · KeinNiemand
Params7.62B
Context32K
Q4_K_M4.7 GB
LU
Lumimaid v0.2 70B Heretic
Lumimaid · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
LU
Lumimaid v0.2 123B
Lumimaid · bartowski
Params123B
Context128K
Q4_K_M73.2 GB
BA
BagelMIsteryTour v2 8x7B
Bagelmisterytour · Artefact2
Params46.7B
Context32K
Q4_K_M28.4 GB
OG
Ogno Monarch Jaskier Merge 7b OH PREF DPO
Ogno · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
AY
Models lenML Aya Expanse 8b Abliterated
Aya · MaziyarPanahi
Params8.03B
Context8K
Smallest5.7 GB
AY
CohereForAI Aya Expanse 8b
Aya · tensorblock
Params8.03B
Context8K
Smallest3.4 GB
SO
Solar M SakuraSolar Mixed
Solar · RichardErkhov
Params8.99B
Context4K
Q4_K_M5.4 GB
OB
OBLIQ IR 3B No Distill
Obliq · mradermacher
Params3.21B
Context128K
Q4_K_M2.0 GB
MI
Mistral-11B-AirOmniMix
Mistral · mradermacher
Params10.7B
Context32K
Q4_K_M6.5 GB