GGUF models by RichardErkhov

14354 GGUF models quantized by RichardErkhov on Hugging Face. Sizes run from 1M to 316B parameters. The longest trained context is 102400K tokens.

Most downloadedNewestLargestLongest contextSmallest
YI
Yi 1.5 9B
Yi · RichardErkhov
Params8.83B
Context4K
Q4_K_M5.3 GB
GGUF
LL
AI Sweden Models Llama 3 8B
Llama · RichardErkhov
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Llama 3.2 1B Instruct Commonsense_Qa Zh Linear
Llama · RichardErkhov
Params1.24B
Context128K
Q4_K_M0.8 GB
Tool use
TA
TatvaJoshi AHS new tinyllama spo faq v5.4
Tatvajoshi · RichardErkhov
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
PH
1995Austin phi 3.5 tuning decomposer v1
Phi · RichardErkhov
Params3.82B
Context128K
Q4_K_M2.4 GB
GGUF
RE
reflect_llm8B_Om2SftT1-Om2IpsdpG8kIpsdpIter1T1_b1.0
Reflect · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
MI
ebinzack15 mistral 7b finance v1.x mergedmodel
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
PH
lllyasviel omost phi 3 mini 128k
Phi · RichardErkhov
Params3.82B
Context128K
Q4_K_M2.4 GB
GGUF
LL
ELYZA Japanese Llama 2 7b Instruct
Llama · RichardErkhov
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
LL
Llama2 0.7B Scratch
Llama · RichardErkhov
Params783M
Context4K
Q4_K_M0.5 GB
GGUF
LL
Llama 3.2 3b It MathBot v1 Final 1
Llama · RichardErkhov
Params3.21B
Context128K
Q4_K_M2.0 GB
GGUF
LL
Magpie Align Llama 3 8B Magpie Align SFT v0.3
Llama · RichardErkhov
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
AL
alnrg2arg blockchainlabs tinyllama fusion LHK yunkong v2
Alnrg · RichardErkhov
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
MI
mlfoundations dev hp ablations grid mistral bsz2048 lr5e 6 scheduler cosine warmup0.15
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
GE
BAAI bge reranker v2 gemma
Gemma · RichardErkhov
Params2.51B
Context8K
Q4_K_M1.6 GB
Embedding
QW
Qwen2.5 0.5B Instruct
Qwen · RichardErkhov
Params494M
Context32K
Q4_K_M0.4 GB
Tool use
LL
MMed Llama 3 8B
Llama · RichardErkhov
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
KU
Kukedlc NeuralAlgo 7B DPO
Kukedlc · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
LL
mrngodi llama 3.2 3b Merged Ecommerce ChatBot
Llama · RichardErkhov
Params3.21B
Context128K
Q4_K_M2.0 GB
Tool use
MI
Mixtral 8x7B Instruct v0.1
Mistral · RichardErkhov
Params46.7B
Context32K
Q4_K_M28.4 GB
GGUF
AM
amitakumarjha gita text generation gpt2
Amitakumarjha · RichardErkhov
Params163M
Context1K
Q4_K_M0.1 GB
GGUF
GP
gpt2-medium-emailgen
Gpt · RichardErkhov
Params406M
Context1K
Q4_K_M0.3 GB
GGUF
DO
DopeorNope Dear My best Friend SFT v2 13B
Dopeornope · RichardErkhov
Params13.2B
Context2K
Q4_K_M8.0 GB
GGUF
SI
SinGung7B DPO v0.1 12600c
Singung · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
SE
Sentient Simulations Pydecompiler 3.7 6.7b v0.9
Sentient · RichardErkhov
Params6.74B
Context16K
Q4_K_M4.1 GB
GGUF
MI
mlfoundations dev hp ablations mistral lr1e 6 dcftv1.2
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
mlfoundations dev hp ablations mistral scheduler cosine warmup0.05 dcftv1.2
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
RI
Yi Ko 6B
Richarderkhov · RichardErkhov
Params6.18B
Context2K
Q4_K_M3.8 GB
GGUF
FR
freewheelin free solar instrunction v0.1
Freewheelin · RichardErkhov
Params10.9B
Context4K
Q4_K_M6.6 GB
GGUF
GE
Gemma 2b It
Gemma · RichardErkhov
Params2.51B
Context8K
Q4_K_M1.6 GB
GGUF

Keep browsing