GGUF models by RichardErkhov
14354 GGUF models quantized by RichardErkhov on Hugging Face. Sizes run from 1M to 316B parameters. The longest trained context is 102400K tokens.
HW
hwkwon S SOLAR 10.7B SFT v1.3
Hwkwon · RichardErkhov
Params10.8B
Context4K
Q4_K_M6.5 GB
DO
dolphin-ultrafeedback-dpo
Dolphin · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
PH
Phi 3 Mini 4k Instruct
Phi · RichardErkhov
Params3.82B
Context4K
Q4_K_M2.4 GB
LG
lgaalves gpt2 camel physics platypus
Lgaalves · RichardErkhov
Params163M
Context1K
Q4_K_M0.1 GB
DE
ahmedheakl asm2asm deepseek 1.3b 100k x86 arm gcc
DeepSeek · RichardErkhov
Params1.35B
Context16K
Q4_K_M0.9 GB
FR
Fredithefish Guanaco 3B Uncensored v2
Fredithefish · RichardErkhov
Params2.78B
Context2K
Q4_K_M1.8 GB
FA
Falcon
Falcon · RichardErkhov
Params5.47B
Context2K
Q4_K_M3.4 GB
MI
Mistral 7B v0.2 Ko Y24_v2.0
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
rana shahroz mistral openorca openplatypus
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
PY
Pythia 160m
Pythia · RichardErkhov
Params162M
Context2K
Q4_K_M0.1 GB
LL
Llama 3b Finnish
Llama · RichardErkhov
Params3.63B
Context2K
Q4_K_M2.8 GB
PY
Pythia 2.8b
Pythia · RichardErkhov
Params2.78B
Context2K
Q4_K_M1.8 GB
LL
brianmatzelle llama3.2 1b instruct hasanpiker abliterated
Llama · RichardErkhov
Params1.24B
Context128K
Q4_K_M0.8 GB
WA
wamegabe tinyllama wame 4bit curi2
Wamegabe · RichardErkhov
Params1.1B
Context2K
Q4_K_M0.7 GB
NO
nothingiisreal MN 12B Celeste V1.9
Nothingiisreal · RichardErkhov
Params12.2B
Context1000K
Q4_K_M7.5 GB
KY
kyujinpy Sakura SOLRCA Instruct DPO
Kyujinpy · RichardErkhov
Params10.7B
Context4K
Q4_K_M6.5 GB
LL
disi unibo nlp llama3.2 1B SFT medqa triples cot
Llama · RichardErkhov
Params1.24B
Context128K
Q4_K_M0.8 GB
MI
IntelLabs sqft sparsepeft mistral 7b v0.3 50 gsm8k heu
Mistral · RichardErkhov
Params7.25B
Context32K
Q4_K_M4.4 GB
SO
SOLAR 10.7B Orca Alpaca Gpt4 Lora 653
Solar · RichardErkhov
Params10.7B
Context4K
Q4_K_M6.5 GB
FI
FILM 7B
Film · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
SP
Speechless Hermes Coig Lite 13b
Speechless · RichardErkhov
Params13B
Context4K
Q4_K_M7.9 GB
LL
zomd AISquare Instruct llama2 koen 13b v0.9.17
Llama · RichardErkhov
Params13.2B
Context2K
Q4_K_M8.0 GB
XU
XueyingJia pythia 1b deduped hh online dpo merge
Xueyingjia · RichardErkhov
Params1.01B
Context2K
Q4_K_M0.7 GB
TI
TinySolar-248m-4k-code-instruct
Tinysolar · RichardErkhov
Params248M
Context32K
Q4_K_M0.2 GB
QW
Qwen2-0.5B-OnlineDPO-PairRM
Qwen · RichardErkhov
Params494M
Context32K
Q4_K_M0.4 GB
QW
Qwen2.5 72B Instruct
Qwen · RichardErkhov
Params72.7B
Context32K
Q4_K_M47.4 GB
MI
Mistral-7b-instruct-v0.2-summ-sft-e2m
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
mlfoundations dev mistral alpaca sft sample 5
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
sania963 Mistral instruct sql v0.3
Mistral · RichardErkhov
Params7.25B
Context32K
Q4_K_M4.4 GB
WE
Weyaxi openchat 3.5 1210 Seraph Slerp
Weyaxi · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB