GGUF models: cc-by-nc-4.0 license

5195 GGUF models listed under the cc-by-nc-4.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 321B parameters. The longest trained context is 4194304K tokens.

Most downloadedNewestLargestLongest contextSmallest
JI
Jina Reranker v2 Base Multilingual
Jina · gpustack
Params278M
Context1K
Q4_K_M0.2 GB
CodingEmbedding
OP
OpenJev Flash 9B
Openjev · openjev
Params8.95B
Context256K
Q4_K_M5.6 GB
GGUF
LL
Llama-3-Lumimaid-8B-v0.1-OAS
Llama · Lewdiculous
Params8B
Context8K
Q4_K_M4.9 GB
Roleplay
QW
Nemotron Research Reasoning Qwen 1.5B
Qwen · bartowski
Params1.78B
Context128K
Q4_K_M1.1 GB
Reasoning
EX
Extended-Mega-Mash-262K-8B-L3
Extended · mradermacher
Params8B
Context256K
Q4_K_M4.9 GB
GGUF
OC
octo net
Octo · NexaAI
Params3.82B
Context128K
Q4_K_M2.4 GB
GGUF
XL
xLAM 8x7b R
Xlam · bartowski
Params46.7B
Context32K
Q4_K_M28.4 GB
Tool use
OX
OxytocinErosEngineeringF1 7B slerp
Oxytocinerosengineeringf · mradermacher
Params7.24B
Context32K
Q4_K_M4.5 GB
GGUF
AU
Aura-Uncensored-OAS-8B-L3
Aura · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Llama3 Aloe 8B Alpha
Llama · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
MI
Mistral-11B-SynthIAirOmniMix
Mistral · mradermacher
Params10.7B
Context32K
Q4_K_M6.5 GB
GGUF
DA
DaringMaid 13B
Daringmaid · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
AY
Aya Expanse 32b
Aya · bartowski
Params32.3B
Context8K
Q4_K_M19.8 GB
GGUF
MI
chargoddard_mixtralrpchat-zloss
Mistral · TheBloke
Params46.7B
Context32K
Q4_K_M26.4 GB
GGUF
OP
OpenMia Indo Engineering 7b i1
Openmia · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
LL
Llama 3.1 8B UltraLong 4M Instruct
Llama · bartowski
Params8B
Context4192K
Q4_K_M4.9 GB
GGUF
ST
L3-8B-Stheno-v3.1
Stheno · Lewdiculous
Params8B
Context8K
Q4_K_M4.9 GB
Roleplay
LL
LLaMA2 13B Estopia
Llama · KoboldAI
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
WI
winter garden 7b beta
Winter · mradermacher
Params7.24B
Context32K
Q4_K_M4.5 GB
GGUF
CO
c4ai-command-r-plus
Command R · pmysl
Params104B
Context128K
Q4_K_M62.8 GB
GGUF
LL
Llama 3.1 8B Stheno v3.4
Llama · QuantFactory
Params8B
Context128K
Q4_K_M4.9 GB
GGUF
KI
KittyNyanster v1
Kittynyanster · mradermacher
Params7.24B
Context32K
Q4_K_M4.5 GB
Roleplay
HO
Holo4 27B Abliterix
Holo · mradermacher
Params27B
Context256K
Q4_K_M16.5 GB
Vision
OU
Oumuamua-7b-RP
Oumuamua · mradermacher
Params7.33B
Context32K
Q4_K_M4.4 GB
Roleplay
DE
Vigyan 1.5B 4x MoE
DeepSeek · shreyansh12183
Params6.4B
Context128K
Q4_K_M3.9 GB
Reasoning
PI
maywell_pivot-0.1-starling-lm-rp
Pivot · TheBloke
Params7.24B
Context8K
Q4_K_M4.4 GB
Roleplay
RE
reader lm 0.5b IMat
Reader · legraphista
Params494M
Context250K
Smallest0.3 GB
GGUF
MI
Mixtral_7Bx4_MOE_24B
Mistral · mradermacher
Params24.2B
Context32K
Q4_K_M14.6 GB
GGUF
AI
airoboros-65b-gpt4-m2.0
Airoboros · mradermacher
Params65B
Context2K
Q4_K_M39.3 GB
GGUF
GE
shamrock 0 e4b
Gemma · oxalis-ink
Params7.46B
Context128K
Q4_K_M5.3 GB
Vision

Keep browsing