GGUF models: cc-by-nc-4.0 license

5195 GGUF models listed under the cc-by-nc-4.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 321B parameters. The longest trained context is 4194304K tokens.

Most downloadedNewestLargestLongest contextSmallest
LL
Llama-3-LewdPlay-8B-evo
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
OB
OBLIQ IR 3B
Obliq · mradermacher
Params3.21B
Context128K
Q4_K_M2.0 GB
GGUF
RO
rogue-enchantress-32k-7B
Rogue · Lewdiculous
Params7.24B
Context32K
Q4_K_M4.4 GB
Roleplay
NA
NarumashiRTS V2 i1
Narumashirts · mradermacher
Params7.24B
Context8K
Q4_K_M4.4 GB
Roleplay
BO
Borealis 10.7B DPO i1
Borealis · mradermacher
Params10.7B
Context4K
Q4_K_M6.6 GB
GGUF
MI
MiniusLight 24B v1.01 i1
Miniuslight · mradermacher
Params23.6B
Context32K
Q4_K_M14.3 GB
GGUF
SA
saishf SOVL Mega Mash V2 L3 8B
Saishf · RichardErkhov
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
NE
Neophanis 8x7B
Neophanis · mradermacher
Params46.7B
Context32K
Q4_K_M28.6 GB
GGUF
LL
llama-3-meerkat-8b-v1.0
Llama · bartowski
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
CI
CiQi Agent 7B
Ciqi · mradermacher
Params7.62B
Context125K
Q4_K_M4.7 GB
Tool useVision
HW
hwkwon S SOLAR 10.7B SFT v1.3
Hwkwon · RichardErkhov
Params10.8B
Context4K
Q4_K_M6.5 GB
GGUF
UN
UniNER 7B all
Uniner · yuuko-eth
Params6.74B
Context2K
Q4_K_M4.1 GB
Coding
GE
gemma 7b openhermes i1
Gemma · mradermacher
Params8.54B
Context8K
Q4_K_M5.3 GB
Tool use
IC
Ice0.17 03.10 RP
Ice · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
Roleplay
HA
Hammer2.1 0.5b
Hammer · mradermacher
Params494M
Context32K
Q4_K_M0.4 GB
Tool use
ST
Sao10K/L3-8B-Stheno-v3.3-32K
Stheno · featherless-ai-quants
Params8.03B
Context32K
Q4_K_M4.9 GB
GGUF
MI
Noromaid 7b v0.2 Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
OC
Octen WebGR 0.6B
Octen · mradermacher
Params730M
Context32K
Q4_K_M0.5 GB
ReasoningTool use
AY
aya
Aya · cortexso
Params35B
Context8K
Q4_K_M5.1 GB
GGUF
JI
jina v5 small
Jina · cstr
Params596M
Context32K
Smallest0.4 GB
Embedding
IC
Ice0.146 17.10 RP i1
Ice · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
Roleplay
FI
Finance Embeddings Investopedia
Finance · mradermacher
Params109M
Context512
Q4_K_M0.1 GB
Embedding
AI
Airoboros 13b Gpt4 1.3
Airoboros · mradermacher
Params13B
Context2K
Q4_K_M7.9 GB
GGUF
FO
MN 12B FoxFrame Shinori
Foxframe · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
KU
Kuro Lotus 10.7B i1
Kuro · mradermacher
Params10.7B
Context8K
Q4_K_M6.5 GB
GGUF
MA
Maestrale
Maestrale · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
OR
Ortho-SOVL-8B-L3
Ortho · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
HA
Harmonia 20B
Harmonia · mradermacher
Params20B
Context4K
Q4_K_M12.2 GB
GGUF
SA
SauerkrautLM SOLAR Instruct
Sauerkrautlm · RichardErkhov
Params10.7B
Context8K
Q4_K_M6.5 GB
GGUF
DU
DukunLM 13B V1.0 Uncensored
Dukunlm · mradermacher
Params13B
Context2K
Q4_K_M7.9 GB
GGUF

Keep browsing