GGUF models by RichardErkhov
14354 GGUF models quantized by RichardErkhov on Hugging Face. Sizes run from 1M to 316B parameters. The longest trained context is 102400K tokens.
TI
TinyLlama-1.1B-Chat-v0.1_fictional_arc_challenge_Korean_v1
Tinyllama · RichardErkhov
Params1.1B
Context2K
Q4_K_M0.7 GB
GR
Granite Guardian 3.0 2b
Granite · RichardErkhov
Params2.53B
Context8K
Q4_K_M1.5 GB
GP
Gpt2 Medium
Gpt · RichardErkhov
Params406M
Context1K
Q4_K_M0.3 GB
JO
Jolteon Instruct 13B Alpha
Jolteon · RichardErkhov
Params13.4B
Context4K
Q4_K_M8.1 GB
AL
allknowingroger WestLakeLaser 12B MoE
Allknowingroger · RichardErkhov
Params12.9B
Context32K
Q4_K_M7.8 GB
MI
Locutusque Hercules 3.1 Mistral 7B
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
OP
OpenELM 1_1B DPO Full Least Similar
Openelm · RichardErkhov
Params1.08B
Context2K
Q4_K_M0.7 GB
SM
Avibhi SmolLM2 FT EnHindiTranslation 8 16
SmolLM · RichardErkhov
Params135M
Context8K
Q4_K_M0.1 GB
LO
LordNoah Alpaca refine gpt2 e0 se1
Lordnoah · RichardErkhov
Params838M
Context1K
Q4_K_M0.5 GB
LL
Llama3 Compressor Adapter 4 60000steps
Llama · RichardErkhov
Params839M
Context1K
Q4_K_M0.5 GB
ZO
zomd AISquare Instruct yi ko 6b v0.9.28
Zomd · RichardErkhov
Params6.18B
Context2K
Q4_K_M3.8 GB
FE
Fett-uccine-11B-Experiment
Fett · RichardErkhov
Params10.7B
Context32K
Q4_K_M6.5 GB
YO
youri-7b-instruction
Youri · RichardErkhov
Params6.74B
Context4K
Q4_K_M4.1 GB
LL
Llama-3-11.5B-Instruct-V2
Llama · RichardErkhov
Params11.5B
Context8K
Q4_K_M7.0 GB
IN
interview eval zephyr 7b math case 6
Interview · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
NY
Nyxene-11B
Nyxene · RichardErkhov
Params10.7B
Context32K
Q4_K_M6.5 GB
ME
mergekit community mergekit model stock fhjvgqq
Mergekit · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
ML
mlfoundations dev oh dcft v1.2 no curation gpt 4o mini wo airoboros
Mlfoundations · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
PO
potpourri-8b-inst-fft-induction-bc-trajectory-max1-per-task-tool-token
Potpourri · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
ML
mlfoundations dev oh teknium scaling down ratiocontrolled 0.5
Mlfoundations · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama3.2Inst
Llama · RichardErkhov
Params1.24B
Context128K
Q4_K_M0.8 GB
BL
Bloom 560m
Bloom · RichardErkhov
Params816M
Context1K
Q4_K_M0.6 GB
LL
Llama3 8b Math Sft
Llama · RichardErkhov
Params8.03B
Context8K
Q4_K_M4.9 GB
GE
AlexTereshkov gemma2 promo date prediction
Gemma · RichardErkhov
Params2.61B
Context8K
Q4_K_M1.7 GB
MI
Mistral 7B Merge 14 v0.3
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
QW
Qwen2-1.5B-Instruct-Abliterated
Qwen · RichardErkhov
Params1.54B
Context32K
Q4_K_M1.0 GB
RI
Yi Ko 6B
Richarderkhov · RichardErkhov
Params6.18B
Context2K
Q4_K_M3.8 GB
MI
Speechless Thoughts Mistral 7b
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
LL
Llama 3.2 3b It Ecommerce ChatBot
Llama · RichardErkhov
Params3.21B
Context128K
Q4_K_M2.0 GB
LL
Llama 3 Chat Empathy Test FR
Llama · RichardErkhov
Params1.24B
Context128K
Q4_K_M0.8 GB