GGUF models by RichardErkhov
14354 GGUF models quantized by RichardErkhov on Hugging Face. Sizes run from 1M to 316B parameters. The longest trained context is 102400K tokens.
RE
04_rendoo_luman0004_49
Rendoo · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
DE
DeepSeek V3 1B Test
DeepSeek · RichardErkhov
Params1.05B
Context160K
Q4_K_M0.7 GB
NO
mlfoundations dev oh v3 1 only dataforge economics
Nomic · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama3 instrucTrans Enko 8b
Llama · RichardErkhov
Params8.03B
Context8K
Q4_K_M4.9 GB
LD
LDCC SOLAR 10.7B
Ldcc · RichardErkhov
Params10.9B
Context4K
Q4_K_M6.6 GB
JA
japanese-stablelm-base-ja_vocab-beta-7b
Japanese · RichardErkhov
Params6.88B
Context4K
Q4_K_M4.2 GB
PH
Phi 3 Mini 128k Instruct
Phi · RichardErkhov
Params3.82B
Context128K
Q4_K_M2.4 GB
LL
KoboldAI LLaMA2 13B Erebus v3
Llama · RichardErkhov
Params13B
Context4K
Q4_K_M7.9 GB
QW
Echelon AI Med Qwen2 7B
Qwen · RichardErkhov
Params7.62B
Context32K
Q4_K_M4.7 GB
MI
laser-dolphin-mixtral-2x7b-dpo
Mistral · RichardErkhov
Params12.9B
Context32K
Q4_K_M7.8 GB
BE
x2bee POLAR 14B v0.5
Bee · RichardErkhov
Params14.2B
Context4K
Q4_K_M8.6 GB
SM
SmolLM 1.7B Instruct
SmolLM · RichardErkhov
Params1.71B
Context2K
Q4_K_M1.1 GB
KA
kaiwenw nov22 lr 3e 6 lora 32 dropout 0.1 all reject first ep 4
Kaiwenw · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
FI
FinChat298_Solar248M_Pretrain_DJ30_Model_V2
Finchat · RichardErkhov
Params309M
Context2K
Q4_K_M0.2 GB
LL
Llama 13b
Llama · RichardErkhov
Params13B
Context2K
Q4_K_M7.9 GB
BI
BishFish DialoGPT medium stitch
Bishfish · RichardErkhov
Params406M
Context1K
Q4_K_M0.3 GB
MI
Flammen3
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
BR
BroAlanTaps GPT2 large 128 26000steps
Broalantaps · RichardErkhov
Params838M
Context1K
Q4_K_M0.5 GB
LL
Ankit2789 llama 3 8b chat finance
Llama · RichardErkhov
Params8.03B
Context8K
Q4_K_M4.9 GB
CO
codegemma-7b
Codegemma · RichardErkhov
Params8.54B
Context8K
Q4_K_M5.3 GB
NO
mlfoundations dev OH DCFT V3 wo dataforge economics
Nomic · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
ML
mlfoundations dev oh v1.3 camel biology x.25
Mlfoundations · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
ML
mlfoundations dev OH DCFT V3 wo cot alpaca
Mlfoundations · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
nldemo Llama 3 8B Story Summarization QLoRA
Llama · RichardErkhov
Params8.03B
Context16K
Q4_K_M4.9 GB
ME
merlinite-7b-lab
Merlinite · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
QW
Ref Pretrain Qwen 104M
Qwen · RichardErkhov
Params104M
Context32K
Q4_K_M0.1 GB
RI
Yi Ko 6B
Richarderkhov · RichardErkhov
Params6.18B
Context2K
Q4_K_M3.8 GB
MI
Infinity Instruct 7M Gen Mistral 7B
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
SA
Sarathbabu Karunanithi SQLgpt2
Sarathbabu · RichardErkhov
Params163M
Context1K
Q4_K_M0.1 GB
LL
Llama2 1B 50krope Scratch
Llama · RichardErkhov
Params1.1B
Context4K
Q4_K_M0.7 GB