GGUF models by RichardErkhov

14354 GGUF models quantized by RichardErkhov on Hugging Face. Sizes run from 1M to 316B parameters. The longest trained context is 102400K tokens.

Most downloadedNewestLargestLongest contextSmallest
GI
Gille StrangeMerges 21 7B slerp
Gille · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
FI
Finance Chat
Finance · RichardErkhov
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
LL
CodeLlama-70b-Python-hf
Llama · RichardErkhov
Params69B
Context4K
Q4_K_M41.4 GB
Coding
ML
mlfoundations dev oh teknium scaling down ratiocontrolled 1.0
Mlfoundations · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama 3 Nephilim v2.1 8B
Llama · RichardErkhov
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
GO
google shieldgemma 9b
Google · RichardErkhov
Params9.24B
Context8K
Q4_K_M3.1 GB
GGUF
GR
Granite 3b Code Instruct 2k
Granite · RichardErkhov
Params3.48B
Context2K
Q4_K_M2.1 GB
Coding
MI
macadeliccc Mistral 7B v0.2 OpenHermes
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
Tool use
MA
Magic-Dolphin-7b
Magic · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
chlee10 T3Q Merge Mistral7B
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
LL
Vegybin11 Llama 3.1 8B bnb 4bit python
Llama · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
SA
sabia-7b
Sabia · RichardErkhov
Params6.74B
Context2K
Q4_K_M4.1 GB
GGUF
SA
saishf Multi Verse RP 7B
Saishf · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
Roleplay
LL
bugdaryan Code Llama 2 13B instruct text2sql
Llama · RichardErkhov
Params3.8B
Context—
Q4_K_M0.0 GB
Coding
PH
microsoft phi 1 5
Phi · RichardErkhov
Params1.42B
Context2K
Q4_K_M0.9 GB
GGUF
SA
Salamandra 2b Instruct
Salamandra · RichardErkhov
Params2.25B
Context8K
Q4_K_M1.5 GB
GGUF
CA
CalliopeDS L2 13B
Calliopeds · RichardErkhov
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
MI
eldogbbhed NeuralMonarchCoderPearlBeagle T3Q Mistral Orca Math DPO 7b
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
Coding
AM
amitk23 autonomous learner 1
Amitk · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
MLP KTLim llama 3 Korean Bllossom 8B
Llama · RichardErkhov
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
swap uniba LLaMAntino 2 chat 13b hf ITA
Llama · RichardErkhov
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
LL
meta llama CodeLlama 7b Python hf
Llama · RichardErkhov
Params6.74B
Context16K
Q4_K_M4.1 GB
Coding
KR
krishnachaitanya5555 fitness chatbot model
Krishnachaitanya · RichardErkhov
Params121M
Context1K
Q4_K_M0.1 GB
GGUF
SM
SmolLlama-1.5B-Sorted
Smolllama · RichardErkhov
Params1.5B
Context2K
Q4_K_M0.9 GB
GGUF
TI
TIPO 500M
Tipo · RichardErkhov
Params508M
Context2K
Q4_K_M0.3 GB
GGUF
MI
nbeerbower Stella mistral nemo 12B
Mistral · RichardErkhov
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
GE
gemma-2b
Gemma · RichardErkhov
Params2.51B
Context8K
Q4_K_M1.6 GB
GGUF
IN
AlchemistCoder L 7B
InternLM · RichardErkhov
Params6.74B
Context16K
Q4_K_M4.1 GB
Coding
LL
Llama 3 SynE
Llama · RichardErkhov
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
MI
nbeerbower mistral nemo wissenschaft 12B
Mistral · RichardErkhov
Params12.2B
Context1000K
Q4_K_M7.5 GB
Tool use

Keep browsing