GGUF models: cc-by-nc-4.0 license
5195 GGUF models listed under the cc-by-nc-4.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 321B parameters. The longest trained context is 4194304K tokens.
ST
L3-8B-Stheno-v3.1
Stheno · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
SP
Spaetzle v60 7b i1
Spaetzle · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
LY
Lyra4 Gutenberg2 12B
Lyra · QuantFactory
Params12.2B
Context1000K
Q4_K_M7.5 GB
SU
SunnyRain 2x10.7B
Sunnyrain · mradermacher
Params19.2B
Context4K
Q4_K_M11.7 GB
PI
PiVoT MoE
Pivot · mradermacher
Params36B
Context32K
Q4_K_M21.8 GB
JE
Jeff 1.0 Large
Jeff · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
LI
OmniLing V1 8b experimental
Lite · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
GE
shamrock 0 e2b
Gemma · oxalis-ink
Params4.63B
Context128K
Q4_K_M3.4 GB
JI
jina embeddings v5 omni small text matching
Jina · jinaai
Params596M
Context32K
Q4_K_M0.4 GB
FI
Fimbulvetr-11B-v2.1-16K
Fimbulvetr · backyardai
Params10.7B
Context16K
Q4_K_M6.5 GB
ML
MLewd L2 Chat 13B
Mlewd · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
SH
SHRDFU 7b gamma
Shrdfu · mradermacher
Params7.24B
Context32K
Q4_K_M4.5 GB
OX
Oxide F1 7B slerp
Oxide · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
QW
ExpertLens Qwen3 VL 30B A3B
Qwen · mradermacher
Params30.5B
Context256K
Q4_K_M18.6 GB
MI
MixtralOrochi8x7B
Mistral · mradermacher
Params46.7B
Context32K
Q4_K_M28.6 GB
LL
Llama3.1_StoryGeneration
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
MI
Mixtral_7Bx4_MOE_DPO
Mistral · mradermacher
Params24.2B
Context32K
Q4_K_M14.6 GB
EX
Explore LM Ext 7B Math
Explore · mradermacher
Params6.74B
Context2K
Q4_K_M4.1 GB
VY
VyvoTTS LFM2 350M Jenny
Vyvotts · mradermacher
Params383M
Context125K
Q4_K_M0.3 GB
AM
AmhQA_Multitask Small
Amhqa · mradermacher
Params300M
Context512
Q4_K_M0.2 GB
CO
C4Ai Command R7B 12 2024
Command R · oncu
Params8.03B
Context8K
Q4_K_M5.1 GB
OG
Ogno Monarch Jaskier Merge 7b OH PREF DPO
Ogno · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
LL
Llama 3 8B Instruct DADA iMat
Llama · Quant-Cartel
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
L3.1 Aglow Vulca v0.1 8B
Llama · QuantFactory
Params8B
Context128K
Q4_K_M4.9 GB
AI
Airoboros 65b Gpt4 1.4
Airoboros · mradermacher
Params65.3B
Context2K
Q4_K_M39.3 GB
AN
Anime Llasa 3B
Anime · mradermacher
Params3.41B
Context128K
Q4_K_M2.2 GB
CO
C4Ai Command R7B Arabic 02 2025
Command R · matrixportalx
Params8.03B
Context16K
Q4_K_M5.1 GB
EU
L3.1 70B Euryale v2.2
Euryale · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
OP
OpenHermes 2.5 Nebula v2 7B
Openhermes · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
DE
Dendrite-L3-10B
Dendrite · mradermacher
Params9.78B
Context8K
Q4_K_M6.0 GB