GGUF models by RichardErkhov

14354 GGUF models quantized by RichardErkhov on Hugging Face. Sizes run from 1M to 316B parameters. The longest trained context is 102400K tokens.

Most downloadedNewestLargestLongest contextSmallest
RE
04_rendoo_luman0004_49
Rendoo · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
DE
DeepSeek V3 1B Test
DeepSeek · RichardErkhov
Params1.05B
Context160K
Q4_K_M0.7 GB
Tool use
NO
mlfoundations dev oh v3 1 only dataforge economics
Nomic · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama3 instrucTrans Enko 8b
Llama · RichardErkhov
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LD
LDCC SOLAR 10.7B
Ldcc · RichardErkhov
Params10.9B
Context4K
Q4_K_M6.6 GB
GGUF
JA
japanese-stablelm-base-ja_vocab-beta-7b
Japanese · RichardErkhov
Params6.88B
Context4K
Q4_K_M4.2 GB
GGUF
PH
Phi 3 Mini 128k Instruct
Phi · RichardErkhov
Params3.82B
Context128K
Q4_K_M2.4 GB
GGUF
LL
KoboldAI LLaMA2 13B Erebus v3
Llama · RichardErkhov
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
QW
Echelon AI Med Qwen2 7B
Qwen · RichardErkhov
Params7.62B
Context32K
Q4_K_M4.7 GB
GGUF
MI
laser-dolphin-mixtral-2x7b-dpo
Mistral · RichardErkhov
Params12.9B
Context32K
Q4_K_M7.8 GB
GGUF
BE
x2bee POLAR 14B v0.5
Bee · RichardErkhov
Params14.2B
Context4K
Q4_K_M8.6 GB
GGUF
SM
SmolLM 1.7B Instruct
SmolLM · RichardErkhov
Params1.71B
Context2K
Q4_K_M1.1 GB
GGUF
KA
kaiwenw nov22 lr 3e 6 lora 32 dropout 0.1 all reject first ep 4
Kaiwenw · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
FI
FinChat298_Solar248M_Pretrain_DJ30_Model_V2
Finchat · RichardErkhov
Params309M
Context2K
Q4_K_M0.2 GB
GGUF
LL
Llama 13b
Llama · RichardErkhov
Params13B
Context2K
Q4_K_M7.9 GB
GGUF
BI
BishFish DialoGPT medium stitch
Bishfish · RichardErkhov
Params406M
Context1K
Q4_K_M0.3 GB
GGUF
MI
Flammen3
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
BR
BroAlanTaps GPT2 large 128 26000steps
Broalantaps · RichardErkhov
Params838M
Context1K
Q4_K_M0.5 GB
GGUF
LL
Ankit2789 llama 3 8b chat finance
Llama · RichardErkhov
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
CO
codegemma-7b
Codegemma · RichardErkhov
Params8.54B
Context8K
Q4_K_M5.3 GB
GGUF
NO
mlfoundations dev OH DCFT V3 wo dataforge economics
Nomic · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
ML
mlfoundations dev oh v1.3 camel biology x.25
Mlfoundations · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
ML
mlfoundations dev OH DCFT V3 wo cot alpaca
Mlfoundations · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
nldemo Llama 3 8B Story Summarization QLoRA
Llama · RichardErkhov
Params8.03B
Context16K
Q4_K_M4.9 GB
GGUF
ME
merlinite-7b-lab
Merlinite · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
QW
Ref Pretrain Qwen 104M
Qwen · RichardErkhov
Params104M
Context32K
Q4_K_M0.1 GB
GGUF
RI
Yi Ko 6B
Richarderkhov · RichardErkhov
Params6.18B
Context2K
Q4_K_M3.8 GB
GGUF
MI
Infinity Instruct 7M Gen Mistral 7B
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
SA
Sarathbabu Karunanithi SQLgpt2
Sarathbabu · RichardErkhov
Params163M
Context1K
Q4_K_M0.1 GB
GGUF
LL
Llama2 1B 50krope Scratch
Llama · RichardErkhov
Params1.1B
Context4K
Q4_K_M0.7 GB
GGUF

Keep browsing