GGUF models: cc license
119 GGUF models listed under the cc license on Hugging Face. Always read the license text before commercial use. Sizes run from 33M to 70.6B parameters. The longest trained context is 1000K tokens.
ME
medalpaca 13b i1
Medalpaca · mradermacher
Params13B
Context2K
Q4_K_M7.9 GB
BR
go bruins v2.1.1
Bruins · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
MB
MBX 7B v3
Mbx · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GE
Gemma 7B Instruct Function Calling
Gemma · mradermacher
Params8.54B
Context8K
Q4_K_M5.3 GB
GE
Gemma 7B Instruct Function Calling
Gemma · mradermacher
Params8.54B
Context8K
Q4_K_M5.3 GB
PR
Phonetic Tibetan To English Translation
Prototype · mradermacher
Params738M
Context512
Q4_K_M0.5 GB
CA
CabraMixtral 8x7b
Cabramixtral · mradermacher
Params46.7B
Context32K
Q4_K_M28.4 GB
MB
macadeliccc/MBX-7B-v3-DPO
Mbx · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
EM
EmoCaliber S1
Emocaliber · mradermacher
Params7.62B
Context125K
Q4_K_M4.7 GB
TI
TimeLlama 7b
Timellama · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
AI
Aika 7B i1
Aika · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
CA
CabraQwen7b
Cabraqwen · mradermacher
Params7.72B
Context32K
Q4_K_M4.8 GB
LL
Meta Llama 3 8B Instruct
Llama · RichardErkhov
Params8.03B
Context8K
Q4_K_M4.9 GB
ZO
ZooZeroGPT V1 i1
Zoozerogpt · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
BG
IMPETUS Climate bge small i1
BGE · mradermacher
Params33M
Context512
Q4_K_M0.0 GB
MI
Mistral 7B Instruct v0.2 Function Calling
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
YU
Yugo45 GPT Quantized
Yugo · datatab
Params7.24B
Context32K
Q4_K_M4.4 GB
GA
GalaxyFarAway DialoGPT Vader i1
Galaxyfaraway · mradermacher
Params355M
Context1K
Q4_K_M0.2 GB
LL
dreamgen llama3 8b assistant test run1 sft e2
Llama · RichardErkhov
Params8.03B
Context8K
Q4_K_M4.9 GB
HE
T1 Heavy
Heavy · mradermacher
Params4.02B
Context40K
Q4_K_M2.5 GB
YI
Yi 6B Infinity Chat i1
Yi · mradermacher
Params6.06B
Context4K
Q4_K_M3.7 GB
MA
macadeliccc SOLAR 10.7b Instruct truthy dpo
Macadeliccc · RichardErkhov
Params10.7B
Context4K
Q4_K_M6.5 GB
LL
cloudyu/Meta-Llama-3-8B-Instruct-DPO
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
CA
CabraQwen14b
Cabraqwen · MaziyarPanahi
Params14.2B
Context32K
Smallest10.0 GB
ME
medalpaca 13b
Medalpaca · mradermacher
Params13B
Context2K
Q4_K_M7.9 GB
MI
mistral 18B v0.1
Mistral · mradermacher
Params17.7B
Context32K
Q4_K_M10.8 GB
GA
Hansolo
Galaxyfaraway · mradermacher
Params355M
Context1K
Q4_K_M0.2 GB
SE
sethuiyer Aika 7B
Sethuiyer · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GA
GalaxyFarAway DialoGPT Vader
Galaxyfaraway · mradermacher
Params355M
Context1K
Q4_K_M0.2 GB
HE
T1 Heavy
Heavy · mradermacher
Params4.02B
Context40K
Q4_K_M2.5 GB