GGUF models by RichardErkhov
14354 GGUF models quantized by RichardErkhov on Hugging Face. Sizes run from 1M to 316B parameters. The longest trained context is 102400K tokens.
LL
GenSEC LLM SLT Task1 Llama2 7b HyPo baseline
Llama · RichardErkhov
Params6.74B
Context4K
Q4_K_M4.1 GB
TI
TinyLlama-1.1B-intermediate-step-715k-1.5T
Tinyllama · RichardErkhov
Params1.1B
Context2K
Q4_K_M0.7 GB
IK
Iker ClickbaitFighter 2B
Iker · RichardErkhov
Params2.51B
Context8K
Q4_K_M1.6 GB
LL
JaphetHernandez Llama 3.1 8B Instruct Similarity Score
Llama · RichardErkhov
Params1.24B
Context128K
Q4_K_M0.8 GB
NE
NeuralDaredevil-8B-abliterated
Neuraldaredevil · RichardErkhov
Params8.03B
Context8K
Q4_K_M4.9 GB
UN
Uncensored Jordan 13B
Uncensored · RichardErkhov
Params13B
Context4K
Q4_K_M7.9 GB
NO
nologin ppo
Nologin · RichardErkhov
Params162M
Context2K
Q4_K_M0.1 GB
LL
anakin87 Llama 3 8b ita ties pro
Llama · RichardErkhov
Params8.03B
Context8K
Q4_K_M4.9 GB
EQ
Equall Saul 7B Instruct v1
Equall · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
CH
Chronomaid Storytelling 13b
Chronomaid · RichardErkhov
Params13B
Context4K
Q4_K_M7.9 GB
MH
mhenrichsen context aware splitter 1b
Mhenrichsen · RichardErkhov
Params1.1B
Context8K
Q4_K_M0.7 GB
LI
Lite Oute 1 300M Instruct
Lite · RichardErkhov
Params300M
Context4K
Q4_K_M0.2 GB
MI
juhwanlee llmdo Mistral 7B case c v1
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
CorticalStack mistral 7b jondurbin truthy dpo
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
DI
Distilgpt2
Distilgpt · RichardErkhov
Params121M
Context1K
Q4_K_M0.1 GB
ME
mergekit community mergekit model stock anvdilz
Mergekit · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.2 1B Instruct Commonsenseqa Zh Slerp
Llama · RichardErkhov
Params1.24B
Context128K
Q4_K_M0.8 GB
PH
g ronimo phi 2 OpenHermes 2.5 v2
Phi · RichardErkhov
Params2.78B
Context2K
Q4_K_M1.7 GB
MI
dolphin-2.6-mistral-7b-dpo-orca-v1
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
LL
saransh03sharma mintrec llama 2 7b Folder 4
Llama · RichardErkhov
Params6.74B
Context4K
Q4_K_M4.1 GB
XI
xiaojingyan lora model r64 merged16
Xiaojingyan · RichardErkhov
Params1.24B
Context128K
Q4_K_M0.8 GB
PH
IntelLabs sqft sparsepeft phi 3 mini 4k 40 math heu
Phi · RichardErkhov
Params3.82B
Context4K
Q4_K_M2.4 GB
SO
SOLAR 10.7B
Solar · RichardErkhov
Params10.7B
Context4K
Q4_K_M6.5 GB
LL
Llama3 70B Orion Chinese
Llama · RichardErkhov
Params70.6B
Context8K
Q4_K_M42.5 GB
LL
DsnTgr llama 3.2 1b it Ecommerce ChatBot
Llama · RichardErkhov
Params1.24B
Context128K
Q4_K_M0.8 GB
MI
IntelLabs sqft sparsepeft mistral 7b v0.3 40 gsm8k heu
Mistral · RichardErkhov
Params7.25B
Context32K
Q4_K_M4.4 GB
GE
gemma-2b-ko-dev-pbmt192
Gemma · RichardErkhov
Params2.51B
Context8K
Q4_K_M1.6 GB
ER
eren23 dpo binarized NeutrixOmnibe 7B
Eren · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GE
11andrea2233 gemma 2b instruct ft medical qa
Gemma · RichardErkhov
Params2B
Context8K
Q4_K_M1.6 GB
MI
Mp_Mistral7Bv3_Sft
Mistral · RichardErkhov
Params7.25B
Context32K
Q4_K_M4.4 GB