GGUF models by RichardErkhov

14354 GGUF models quantized by RichardErkhov on Hugging Face. Sizes run from 1M to 316B parameters. The longest trained context is 102400K tokens.

Most downloadedNewestLargestLongest contextSmallest
LL
GenSEC LLM SLT Task1 Llama2 7b HyPo baseline
Llama · RichardErkhov
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
TI
TinyLlama-1.1B-intermediate-step-715k-1.5T
Tinyllama · RichardErkhov
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
IK
Iker ClickbaitFighter 2B
Iker · RichardErkhov
Params2.51B
Context8K
Q4_K_M1.6 GB
GGUF
LL
JaphetHernandez Llama 3.1 8B Instruct Similarity Score
Llama · RichardErkhov
Params1.24B
Context128K
Q4_K_M0.8 GB
GGUF
NE
NeuralDaredevil-8B-abliterated
Neuraldaredevil · RichardErkhov
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
UN
Uncensored Jordan 13B
Uncensored · RichardErkhov
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
NO
nologin ppo
Nologin · RichardErkhov
Params162M
Context2K
Q4_K_M0.1 GB
GGUF
LL
anakin87 Llama 3 8b ita ties pro
Llama · RichardErkhov
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
EQ
Equall Saul 7B Instruct v1
Equall · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
CH
Chronomaid Storytelling 13b
Chronomaid · RichardErkhov
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
MH
mhenrichsen context aware splitter 1b
Mhenrichsen · RichardErkhov
Params1.1B
Context8K
Q4_K_M0.7 GB
GGUF
LI
Lite Oute 1 300M Instruct
Lite · RichardErkhov
Params300M
Context4K
Q4_K_M0.2 GB
GGUF
MI
juhwanlee llmdo Mistral 7B case c v1
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
CorticalStack mistral 7b jondurbin truthy dpo
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
DI
Distilgpt2
Distilgpt · RichardErkhov
Params121M
Context1K
Q4_K_M0.1 GB
GGUF
ME
mergekit community mergekit model stock anvdilz
Mergekit · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama 3.2 1B Instruct Commonsenseqa Zh Slerp
Llama · RichardErkhov
Params1.24B
Context128K
Q4_K_M0.8 GB
Tool use
PH
g ronimo phi 2 OpenHermes 2.5 v2
Phi · RichardErkhov
Params2.78B
Context2K
Q4_K_M1.7 GB
Tool use
MI
dolphin-2.6-mistral-7b-dpo-orca-v1
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
LL
saransh03sharma mintrec llama 2 7b Folder 4
Llama · RichardErkhov
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
XI
xiaojingyan lora model r64 merged16
Xiaojingyan · RichardErkhov
Params1.24B
Context128K
Q4_K_M0.8 GB
Tool use
PH
IntelLabs sqft sparsepeft phi 3 mini 4k 40 math heu
Phi · RichardErkhov
Params3.82B
Context4K
Q4_K_M2.4 GB
GGUF
SO
SOLAR 10.7B
Solar · RichardErkhov
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF
LL
Llama3 70B Orion Chinese
Llama · RichardErkhov
Params70.6B
Context8K
Q4_K_M42.5 GB
GGUF
LL
DsnTgr llama 3.2 1b it Ecommerce ChatBot
Llama · RichardErkhov
Params1.24B
Context128K
Q4_K_M0.8 GB
GGUF
MI
IntelLabs sqft sparsepeft mistral 7b v0.3 40 gsm8k heu
Mistral · RichardErkhov
Params7.25B
Context32K
Q4_K_M4.4 GB
GGUF
GE
gemma-2b-ko-dev-pbmt192
Gemma · RichardErkhov
Params2.51B
Context8K
Q4_K_M1.6 GB
GGUF
ER
eren23 dpo binarized NeutrixOmnibe 7B
Eren · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
GE
11andrea2233 gemma 2b instruct ft medical qa
Gemma · RichardErkhov
Params2B
Context8K
Q4_K_M1.6 GB
GGUF
MI
Mp_Mistral7Bv3_Sft
Mistral · RichardErkhov
Params7.25B
Context32K
Q4_K_M4.4 GB
Tool use

Keep browsing