GGUF models: cc-by-nc-4.0 license
5195 GGUF models listed under the cc-by-nc-4.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 321B parameters. The longest trained context is 4194304K tokens.
NE
NeuralBeagle14-7B
Neuralbeagle · backyardai
Params7.24B
Context32K
Q4_K_M4.4 GB
MO
Most Embed De
Most · mradermacher
Params1.14B
Context256K
Q4_K_M0.7 GB
RE
reader lm 1.5b i1
Reader · mradermacher
Params1.54B
Context250K
Q4_K_M1.0 GB
ME
Merge-Mayhem-L3-V2
Merge · mradermacher
Params8.03B
Context24K
Q4_K_M4.9 GB
KO
KoSOLAR 10.7B QLoRA NEFTune Kolon v0.1
Kosolar · mradermacher
Params10.8B
Context4K
Q4_K_M6.5 GB
TH
Thanos 8B
Thanos · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
CO
c4ai-command-r-v01
Command R · second-state
Params35B
Context128K
Q4_K_M21.5 GB
ST
Starling LM 7B alpha
Starling · second-state
Params7.24B
Context8K
Q4_K_M4.4 GB
LU
Lumimaid v0.2 8B
Lumimaid · NeverSleep
Params8.03B
Context128K
Q4_K_M4.9 GB
CO
CoCo Decision 4B
Coco · prithivMLmods
Params4.21B
Context256K
Q4_K_M2.7 GB
CR
Creative Writer Plus 32b Preview 01 2025
Creative · mradermacher
Params32.3B
Context128K
Q4_K_M19.8 GB
ST
L3-8B-Stheno-v3.2
Stheno · Dragnbrn
Params8B
Context8K
Q4_K_M4.9 GB
MI
Mixtral_7Bx4_MOE_24B
Mistral · mradermacher
Params24.2B
Context32K
Q4_K_M14.6 GB
NY
Nyxene v3 11B i1
Nyxene · mradermacher
Params10.7B
Context32K
Q4_K_M6.5 GB
EH
EHR R1 8B
Ehr · mradermacher
Params8.19B
Context40K
Q4_K_M5.0 GB
TH
Thanos 1B i1
Thanos · mradermacher
Params1.24B
Context128K
Q4_K_M0.8 GB
MI
BagelMIsteryTour v2 8x7B
Mistral · ycros
Params46.7B
Context32K
Q4_K_M28.4 GB
BE
Beyonder 4x7B v3 i1
Beyonder · mradermacher
Params24.2B
Context32K
Q4_K_M14.6 GB
IM
Juggernaut Z Image
Image · milo01
Params6.15B
Context—
Q4_K_M5.2 GB
AY
Aya Medikal V2
Aya · mradermacher
Params8.03B
Context8K
Q4_K_M5.1 GB
RE
ResuVL L
Resuvl · mradermacher
Params752M
Context256K
Q4_K_M0.5 GB
ST
Lodestar 4B
Startlux · mradermacher
Params4.33B
Context256K
Q4_K_M2.8 GB
AC
AceInstruct 1.5B
Aceinstruct · bartowski
Params1.78B
Context128K
Q4_K_M1.1 GB
RI
Rivermind 12B v1 Heretic
Rivermind · mradermacher
Params12.2B
Context128K
Q4_K_M7.5 GB
MI
kunoichi-lemon-royale-v2-32K-7B
Mistral · bartowski
Params7.24B
Context32K
Q4_K_M4.4 GB
RE
ReMM v2 L2 13B
Remm · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
CO
command a 03 2025 writer v1 i1
Command · mradermacher
Params111B
Context128K
Smallest0.0 GB
LL
Llama-3-LewdPlay-8B-evo
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
Llama-3-Oasis-v1-OAS-8B
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
EU
Euryale Inverted L2 70B
Euryale · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB