GGUF models: cc-by-nc-4.0 license
5195 GGUF models listed under the cc-by-nc-4.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 321B parameters. The longest trained context is 4194304K tokens.
LU
Lumimaid 8B v0.1 OAS Q5 K S GGUF iMatrix
Lumimaid · Clevyby
Params8.03B
Context8K
Smallest5.6 GB
GH
ghana voice nzema
Ghana · ghanaopenai
Params244M
Context4K
Q4_K_M0.2 GB
QW
bhai qwen35 4b lora
Qwen · BultenHub
Params21M
Context—
Smallest0.0 GB
JE
Jellyfish-8B
Jellyfish · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
MA
MarsupialAI SkunkApe 14b
Marsupialai · RichardErkhov
Params14.2B
Context8K
Q4_K_M8.6 GB
IC
Ice0.37 18.11 RP
Ice · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
NE
Nemo12b TheSyntheticOne
Nemo · mradermacher
Params12.2B
Context128K
Q4_K_M7.5 GB
AM
U Amethyst 20B
Amethyst · mradermacher
Params20B
Context4K
Q4_K_M12.2 GB
OR
Orthrus 12b v0.8
Orthrus · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
ER
OxytocinErosEngineeringF1 7B slerp
Eris · weezywitasneezy
Params7.24B
Context32K
Smallest14.5 GB
AY
aya-23-35B
Aya · backyardai
Params35B
Context8K
Q4_K_M21.5 GB
LL
Meta Llama 3 8b Instruct Hf
Llama · RichardErkhov
Params8.03B
Context8K
Q4_K_M4.9 GB
13
1.3b i1
mradermacher
Params1.32B
Context2K
Q4_K_M0.9 GB
AC
Salesforce.E1 AceReason 14B
Acereason · DevQuasar
Params14.8B
Context128K
Q4_K_M9.0 GB
GP
FlashTopic Gpt Oss 20b Qat 0924 Experimental
gpt-oss · mradermacher
Params20.9B
Context128K
Q4_K_M15.8 GB
GH
ghana voice bimoba
Ghana · ghanaopenai
Params244M
Context4K
Q4_K_M0.2 GB
IC
Ice0.31 08.11 RP i1
Ice · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
TH
Thespis CurtainCall 7b v0.2.2
Thespis · cgato
Params7.24B
Context32K
Q4_K_M4.4 GB
SO
SOLAR-10.7B-NahIdWin
Solar · mradermacher
Params10.7B
Context4K
Q4_K_M6.5 GB
GP
Gpt2 Xl
Gpt · RichardErkhov
Params1.64B
Context1K
Q4_K_M1.2 GB
NY
L3-Nymeria-v2-8B
Nymeria · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
SO
L3-Solana-8B-v1
Solana · insomniactools
Params8.03B
Context8K
Q4_K_M4.9 GB
MU
musicgen large
Musicgen · vokra
Params3.26B
Context—
Smallest6.5 GB
ML
mlabonne UltraMerge 7B
Mlabonne · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
LL
dnotitia.Llama DNA 1.0 8B Instruct
Llama · DevQuasar-6
Params8.03B
Context128K
Q4_K_M4.9 GB
AI
AIFT Yi Ko 6B v1.11
Aift · mradermacher
Params6.18B
Context2K
Q4_K_M3.8 GB
SH
Shreyansh STEM AI 2B v3
Shreyansh · mradermacher
Params1.89B
Context4K
Q4_K_M1.2 GB
LL
Akash Ai 70B v0.1
Llama · MRSHREY197
Params70.6B
Context8K
Q4_K_M42.5 GB
JI
Jina Embeddings v5 Text Small Text Matching
Jina · mradermacher
Params596M
Context32K
Q4_K_M0.4 GB
LU
NeverSleep/Lumimaid-v0.2-8B
Lumimaid · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB