GGUF models: cc-by-nc-4.0 license

5195 GGUF models listed under the cc-by-nc-4.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 321B parameters. The longest trained context is 4194304K tokens.

Most downloadedNewestLargestLongest contextSmallest
TH
TherapyBeagle 11B v2 i1
Therapybeagle · mradermacher
Params10.7B
Context32K
Q4_K_M6.5 GB
GGUF
RI
Rivermind 24B v1
Rivermind · bartowski
Params23.6B
Context128K
Q4_K_M14.3 GB
GGUF
MI
K2S3 Mistral 7bx2 48layers_v1.2
Mistral · RichardErkhov
Params10.9B
Context32K
Q4_K_M6.6 GB
GGUF
JI
jina embeddings v5 omni nano classification
Jina · jinaai
Params212M
Context8K
Q4_K_M0.2 GB
EmbeddingVision
CH
chronos007 70b i1
Chronos · mradermacher
Params69B
Context4K
Q4_K_M41.7 GB
Roleplay
EU
L3-70B-Euryale-v2.1
Euryale · InferenceIllusionist
Params70.6B
Context8K
Q4_K_M42.5 GB
GGUF
LL
llama-3-Nephilim-v2-8B
Llama · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Llama-3-Oasis-v1-OAS-8B
Llama · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
MI
K2S3 Mistral 7b v1.46
Mistral · RichardErkhov
Params7.37B
Context32K
Q4_K_M4.5 GB
GGUF
SA
Saltware-solar-10.7b-v1.0
Saltware · mradermacher
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF
OM
OmniLing V1 8b experimental i1
Omniling · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
KU
Kunoichi DPO v2 7B
Kunoichi · brittlewis12
Params7.24B
Context8K
Q4_K_M4.4 GB
GGUF
QW
jinaai/test-qwen25-coder-jina-code-embeddings-1.5b
Qwen · jinaai
Params1.54B
Context32K
Smallest0.4 GB
CodingEmbedding
BI
Bielik 7B Instruct v0.1
Bielik · mradermacher
Params7.24B
Context4K
Q4_K_M4.4 GB
GGUF
ST
L3-8B-Stheno-v3.2
Stheno · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
RO
RoMistral-7b-Instruct
Romistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
Reasoning
JI
Jina Reranker M0
Jina · jinaai
Params1.54B
Context32K
Q4_K_M1.0 GB
Embedding
TT
f5 tts
Tts · cstr
Params351M
Context—
Smallest0.0 GB
GGUF
MI
NSFW DPO Noromaid 7b Mistral 7B Instruct v0.1
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.5 GB
Roleplay
MA
Marconi v1 3x7B 10B MoE
Marconi · mradermacher
Params18.5B
Context32K
Q4_K_M11.2 GB
Tool use
FI
Fimbulvetr-11B-v2
Fimbulvetr · backyardai
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF
HE
Hemmingway 1.5
Hemmingway · mradermacher
Params27.3B
Context256K
Q4_K_M16.8 GB
ReasoningTool use
ME
q-bert_merged-agi-7b
Merged · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
CO
C4Ai Command R 08 2024
Command R · bartowski
Params32.3B
Context128K
Q4_K_M19.8 GB
GGUF
IA
Iambe 20B DARE
Iambe · TheBloke
Params20B
Context4K
Q4_K_M12.0 GB
GGUF
SP
SpatialAxiom 35B A3B
Spatialaxiom · bartowski
Params34.7B
Context256K
Q4_K_M21.4 GB
Vision
HE
Hemmingway 1
Hemmingway · mradermacher
Params27.3B
Context256K
Q4_K_M16.8 GB
ReasoningTool use
MA
Marcoroni 7b
Marcoroni · TheBloke
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
AT
Athnete 13B
Athnete · mradermacher
Params13B
Context4K
Q4_K_M8.1 GB
GGUF
JI
jina embeddings v5 omni small retrieval
Jina · jinaai
Params596M
Context32K
Q4_K_M0.4 GB
EmbeddingVision

Keep browsing