GGUF models by RichardErkhov
14354 GGUF models quantized by RichardErkhov on Hugging Face. Sizes run from 1M to 316B parameters. The longest trained context is 102400K tokens.
YI
Yi 1.5 9B
Yi · RichardErkhov
Params8.83B
Context4K
Q4_K_M5.3 GB
LL
AI Sweden Models Llama 3 8B
Llama · RichardErkhov
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
Llama 3.2 1B Instruct Commonsense_Qa Zh Linear
Llama · RichardErkhov
Params1.24B
Context128K
Q4_K_M0.8 GB
TA
TatvaJoshi AHS new tinyllama spo faq v5.4
Tatvajoshi · RichardErkhov
Params1.1B
Context2K
Q4_K_M0.7 GB
PH
1995Austin phi 3.5 tuning decomposer v1
Phi · RichardErkhov
Params3.82B
Context128K
Q4_K_M2.4 GB
RE
reflect_llm8B_Om2SftT1-Om2IpsdpG8kIpsdpIter1T1_b1.0
Reflect · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
MI
ebinzack15 mistral 7b finance v1.x mergedmodel
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
PH
lllyasviel omost phi 3 mini 128k
Phi · RichardErkhov
Params3.82B
Context128K
Q4_K_M2.4 GB
LL
ELYZA Japanese Llama 2 7b Instruct
Llama · RichardErkhov
Params6.74B
Context4K
Q4_K_M4.1 GB
LL
Llama2 0.7B Scratch
Llama · RichardErkhov
Params783M
Context4K
Q4_K_M0.5 GB
LL
Llama 3.2 3b It MathBot v1 Final 1
Llama · RichardErkhov
Params3.21B
Context128K
Q4_K_M2.0 GB
LL
Magpie Align Llama 3 8B Magpie Align SFT v0.3
Llama · RichardErkhov
Params8.03B
Context8K
Q4_K_M4.9 GB
AL
alnrg2arg blockchainlabs tinyllama fusion LHK yunkong v2
Alnrg · RichardErkhov
Params1.1B
Context2K
Q4_K_M0.7 GB
MI
mlfoundations dev hp ablations grid mistral bsz2048 lr5e 6 scheduler cosine warmup0.15
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GE
BAAI bge reranker v2 gemma
Gemma · RichardErkhov
Params2.51B
Context8K
Q4_K_M1.6 GB
QW
Qwen2.5 0.5B Instruct
Qwen · RichardErkhov
Params494M
Context32K
Q4_K_M0.4 GB
LL
MMed Llama 3 8B
Llama · RichardErkhov
Params8.03B
Context8K
Q4_K_M4.9 GB
KU
Kukedlc NeuralAlgo 7B DPO
Kukedlc · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
LL
mrngodi llama 3.2 3b Merged Ecommerce ChatBot
Llama · RichardErkhov
Params3.21B
Context128K
Q4_K_M2.0 GB
MI
Mixtral 8x7B Instruct v0.1
Mistral · RichardErkhov
Params46.7B
Context32K
Q4_K_M28.4 GB
AM
amitakumarjha gita text generation gpt2
Amitakumarjha · RichardErkhov
Params163M
Context1K
Q4_K_M0.1 GB
GP
gpt2-medium-emailgen
Gpt · RichardErkhov
Params406M
Context1K
Q4_K_M0.3 GB
DO
DopeorNope Dear My best Friend SFT v2 13B
Dopeornope · RichardErkhov
Params13.2B
Context2K
Q4_K_M8.0 GB
SI
SinGung7B DPO v0.1 12600c
Singung · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
SE
Sentient Simulations Pydecompiler 3.7 6.7b v0.9
Sentient · RichardErkhov
Params6.74B
Context16K
Q4_K_M4.1 GB
MI
mlfoundations dev hp ablations mistral lr1e 6 dcftv1.2
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
mlfoundations dev hp ablations mistral scheduler cosine warmup0.05 dcftv1.2
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
RI
Yi Ko 6B
Richarderkhov · RichardErkhov
Params6.18B
Context2K
Q4_K_M3.8 GB
FR
freewheelin free solar instrunction v0.1
Freewheelin · RichardErkhov
Params10.9B
Context4K
Q4_K_M6.6 GB
GE
Gemma 2b It
Gemma · RichardErkhov
Params2.51B
Context8K
Q4_K_M1.6 GB