GGUF models by RichardErkhov

14354 GGUF models quantized by RichardErkhov on Hugging Face. Sizes run from 1M to 316B parameters. The longest trained context is 102400K tokens.

Most downloadedNewestLargestLongest contextSmallest
HW
hwkwon S SOLAR 10.7B SFT v1.3
Hwkwon · RichardErkhov
Params10.8B
Context4K
Q4_K_M6.5 GB
GGUF
DO
dolphin-ultrafeedback-dpo
Dolphin · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
PH
Phi 3 Mini 4k Instruct
Phi · RichardErkhov
Params3.82B
Context4K
Q4_K_M2.4 GB
GGUF
LG
lgaalves gpt2 camel physics platypus
Lgaalves · RichardErkhov
Params163M
Context1K
Q4_K_M0.1 GB
GGUF
DE
ahmedheakl asm2asm deepseek 1.3b 100k x86 arm gcc
DeepSeek · RichardErkhov
Params1.35B
Context16K
Q4_K_M0.9 GB
GGUF
FR
Fredithefish Guanaco 3B Uncensored v2
Fredithefish · RichardErkhov
Params2.78B
Context2K
Q4_K_M1.8 GB
GGUF
FA
Falcon
Falcon · RichardErkhov
Params5.47B
Context2K
Q4_K_M3.4 GB
GGUF
MI
Mistral 7B v0.2 Ko Y24_v2.0
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
rana shahroz mistral openorca openplatypus
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
PY
Pythia 160m
Pythia · RichardErkhov
Params162M
Context2K
Q4_K_M0.1 GB
GGUF
LL
Llama 3b Finnish
Llama · RichardErkhov
Params3.63B
Context2K
Q4_K_M2.8 GB
GGUF
PY
Pythia 2.8b
Pythia · RichardErkhov
Params2.78B
Context2K
Q4_K_M1.8 GB
GGUF
LL
brianmatzelle llama3.2 1b instruct hasanpiker abliterated
Llama · RichardErkhov
Params1.24B
Context128K
Q4_K_M0.8 GB
Tool use
WA
wamegabe tinyllama wame 4bit curi2
Wamegabe · RichardErkhov
Params1.1B
Context2K
Q4_K_M0.7 GB
Tool use
NO
nothingiisreal MN 12B Celeste V1.9
Nothingiisreal · RichardErkhov
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
KY
kyujinpy Sakura SOLRCA Instruct DPO
Kyujinpy · RichardErkhov
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF
LL
disi unibo nlp llama3.2 1B SFT medqa triples cot
Llama · RichardErkhov
Params1.24B
Context128K
Q4_K_M0.8 GB
Tool use
MI
IntelLabs sqft sparsepeft mistral 7b v0.3 50 gsm8k heu
Mistral · RichardErkhov
Params7.25B
Context32K
Q4_K_M4.4 GB
GGUF
SO
SOLAR 10.7B Orca Alpaca Gpt4 Lora 653
Solar · RichardErkhov
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF
FI
FILM 7B
Film · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
SP
Speechless Hermes Coig Lite 13b
Speechless · RichardErkhov
Params13B
Context4K
Q4_K_M7.9 GB
Tool use
LL
zomd AISquare Instruct llama2 koen 13b v0.9.17
Llama · RichardErkhov
Params13.2B
Context2K
Q4_K_M8.0 GB
GGUF
XU
XueyingJia pythia 1b deduped hh online dpo merge
Xueyingjia · RichardErkhov
Params1.01B
Context2K
Q4_K_M0.7 GB
GGUF
TI
TinySolar-248m-4k-code-instruct
Tinysolar · RichardErkhov
Params248M
Context32K
Q4_K_M0.2 GB
Coding
QW
Qwen2-0.5B-OnlineDPO-PairRM
Qwen · RichardErkhov
Params494M
Context32K
Q4_K_M0.4 GB
GGUF
QW
Qwen2.5 72B Instruct
Qwen · RichardErkhov
Params72.7B
Context32K
Q4_K_M47.4 GB
Tool use
MI
Mistral-7b-instruct-v0.2-summ-sft-e2m
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
Coding
MI
mlfoundations dev mistral alpaca sft sample 5
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
sania963 Mistral instruct sql v0.3
Mistral · RichardErkhov
Params7.25B
Context32K
Q4_K_M4.4 GB
Tool use
WE
Weyaxi openchat 3.5 1210 Seraph Slerp
Weyaxi · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF

Keep browsing