GGUF models: cc license

119 GGUF models listed under the cc license on Hugging Face. Always read the license text before commercial use. Sizes run from 33M to 70.6B parameters. The longest trained context is 1000K tokens.

Most downloadedNewestLargestLongest contextSmallest
ME
medalpaca 13b i1
Medalpaca · mradermacher
Params13B
Context2K
Q4_K_M7.9 GB
GGUF
BR
go bruins v2.1.1
Bruins · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MB
MBX 7B v3
Mbx · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
GE
Gemma 7B Instruct Function Calling
Gemma · mradermacher
Params8.54B
Context8K
Q4_K_M5.3 GB
Tool use
GE
Gemma 7B Instruct Function Calling
Gemma · mradermacher
Params8.54B
Context8K
Q4_K_M5.3 GB
Tool use
PR
Phonetic Tibetan To English Translation
Prototype · mradermacher
Params738M
Context512
Q4_K_M0.5 GB
GGUF
CA
CabraMixtral 8x7b
Cabramixtral · mradermacher
Params46.7B
Context32K
Q4_K_M28.4 GB
GGUF
MB
macadeliccc/MBX-7B-v3-DPO
Mbx · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
EM
EmoCaliber S1
Emocaliber · mradermacher
Params7.62B
Context125K
Q4_K_M4.7 GB
Vision
TI
TimeLlama 7b
Timellama · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
AI
Aika 7B i1
Aika · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
CA
CabraQwen7b
Cabraqwen · mradermacher
Params7.72B
Context32K
Q4_K_M4.8 GB
GGUF
LL
Meta Llama 3 8B Instruct
Llama · RichardErkhov
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
ZO
ZooZeroGPT V1 i1
Zoozerogpt · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
BG
IMPETUS Climate bge small i1
BGE · mradermacher
Params33M
Context512
Q4_K_M0.0 GB
Embedding
MI
Mistral 7B Instruct v0.2 Function Calling
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
Tool use
YU
Yugo45 GPT Quantized
Yugo · datatab
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
GA
GalaxyFarAway DialoGPT Vader i1
Galaxyfaraway · mradermacher
Params355M
Context1K
Q4_K_M0.2 GB
GGUF
LL
dreamgen llama3 8b assistant test run1 sft e2
Llama · RichardErkhov
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
HE
T1 Heavy
Heavy · mradermacher
Params4.02B
Context40K
Q4_K_M2.5 GB
ReasoningTool use
YI
Yi 6B Infinity Chat i1
Yi · mradermacher
Params6.06B
Context4K
Q4_K_M3.7 GB
GGUF
MA
macadeliccc SOLAR 10.7b Instruct truthy dpo
Macadeliccc · RichardErkhov
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF
LL
cloudyu/Meta-Llama-3-8B-Instruct-DPO
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
CA
CabraQwen14b
Cabraqwen · MaziyarPanahi
Params14.2B
Context32K
Smallest10.0 GB
GGUF
ME
medalpaca 13b
Medalpaca · mradermacher
Params13B
Context2K
Q4_K_M7.9 GB
GGUF
MI
mistral 18B v0.1
Mistral · mradermacher
Params17.7B
Context32K
Q4_K_M10.8 GB
GGUF
GA
Hansolo
Galaxyfaraway · mradermacher
Params355M
Context1K
Q4_K_M0.2 GB
GGUF
SE
sethuiyer Aika 7B
Sethuiyer · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
GA
GalaxyFarAway DialoGPT Vader
Galaxyfaraway · mradermacher
Params355M
Context1K
Q4_K_M0.2 GB
GGUF
HE
T1 Heavy
Heavy · mradermacher
Params4.02B
Context40K
Q4_K_M2.5 GB
ReasoningTool use

Keep browsing