GGUF models by RichardErkhov

14354 GGUF models quantized by RichardErkhov on Hugging Face. Sizes run from 1M to 316B parameters. The longest trained context is 102400K tokens.

Most downloadedNewestLargestLongest contextSmallest
TI
TinyLlama-1.1B-Chat-v0.1_fictional_arc_challenge_Korean_v1
Tinyllama · RichardErkhov
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
GR
Granite Guardian 3.0 2b
Granite · RichardErkhov
Params2.53B
Context8K
Q4_K_M1.5 GB
GGUF
GP
Gpt2 Medium
Gpt · RichardErkhov
Params406M
Context1K
Q4_K_M0.3 GB
GGUF
JO
Jolteon Instruct 13B Alpha
Jolteon · RichardErkhov
Params13.4B
Context4K
Q4_K_M8.1 GB
GGUF
AL
allknowingroger WestLakeLaser 12B MoE
Allknowingroger · RichardErkhov
Params12.9B
Context32K
Q4_K_M7.8 GB
GGUF
MI
Locutusque Hercules 3.1 Mistral 7B
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
OP
OpenELM 1_1B DPO Full Least Similar
Openelm · RichardErkhov
Params1.08B
Context2K
Q4_K_M0.7 GB
GGUF
SM
Avibhi SmolLM2 FT EnHindiTranslation 8 16
SmolLM · RichardErkhov
Params135M
Context8K
Q4_K_M0.1 GB
GGUF
LO
LordNoah Alpaca refine gpt2 e0 se1
Lordnoah · RichardErkhov
Params838M
Context1K
Q4_K_M0.5 GB
GGUF
LL
Llama3 Compressor Adapter 4 60000steps
Llama · RichardErkhov
Params839M
Context1K
Q4_K_M0.5 GB
GGUF
ZO
zomd AISquare Instruct yi ko 6b v0.9.28
Zomd · RichardErkhov
Params6.18B
Context2K
Q4_K_M3.8 GB
GGUF
FE
Fett-uccine-11B-Experiment
Fett · RichardErkhov
Params10.7B
Context32K
Q4_K_M6.5 GB
GGUF
YO
youri-7b-instruction
Youri · RichardErkhov
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
LL
Llama-3-11.5B-Instruct-V2
Llama · RichardErkhov
Params11.5B
Context8K
Q4_K_M7.0 GB
GGUF
IN
interview eval zephyr 7b math case 6
Interview · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
NY
Nyxene-11B
Nyxene · RichardErkhov
Params10.7B
Context32K
Q4_K_M6.5 GB
GGUF
ME
mergekit community mergekit model stock fhjvgqq
Mergekit · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
ML
mlfoundations dev oh dcft v1.2 no curation gpt 4o mini wo airoboros
Mlfoundations · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
PO
potpourri-8b-inst-fft-induction-bc-trajectory-max1-per-task-tool-token
Potpourri · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
ML
mlfoundations dev oh teknium scaling down ratiocontrolled 0.5
Mlfoundations · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama3.2Inst
Llama · RichardErkhov
Params1.24B
Context128K
Q4_K_M0.8 GB
Tool use
BL
Bloom 560m
Bloom · RichardErkhov
Params816M
Context1K
Q4_K_M0.6 GB
GGUF
LL
Llama3 8b Math Sft
Llama · RichardErkhov
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
GE
AlexTereshkov gemma2 promo date prediction
Gemma · RichardErkhov
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
MI
Mistral 7B Merge 14 v0.3
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
Embedding
QW
Qwen2-1.5B-Instruct-Abliterated
Qwen · RichardErkhov
Params1.54B
Context32K
Q4_K_M1.0 GB
GGUF
RI
Yi Ko 6B
Richarderkhov · RichardErkhov
Params6.18B
Context2K
Q4_K_M3.8 GB
GGUF
MI
Speechless Thoughts Mistral 7b
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
LL
Llama 3.2 3b It Ecommerce ChatBot
Llama · RichardErkhov
Params3.21B
Context128K
Q4_K_M2.0 GB
GGUF
LL
Llama 3 Chat Empathy Test FR
Llama · RichardErkhov
Params1.24B
Context128K
Q4_K_M0.8 GB
GGUF

Keep browsing