GGUF models by RichardErkhov
14354 GGUF models quantized by RichardErkhov on Hugging Face. Sizes run from 1M to 316B parameters. The longest trained context is 102400K tokens.
LL
Llama 3 Base 8B SFT DPO
Llama · RichardErkhov
Params8B
Context8K
Q4_K_M4.9 GB
OP
OpenELM 3B
Openelm · RichardErkhov
Params3.04B
Context2K
Q4_K_M1.9 GB
LL
ProjectZLLM SFT dna Llama 3.1 8B Instruct 20 r16 merged
Llama · RichardErkhov
Params8B
Context128K
Q4_K_M4.9 GB
PH
Phi 3.5 Mini Instruct
Phi · RichardErkhov
Params3.82B
Context128K
Q4_K_M2.4 GB
LL
mlfoundations dev llama3 1 8b mlfoundations dev stackoverflow 25000tasks 5p
Llama · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Einstein-v6.1-LLama3-8B-Instruct-Ties
Llama · RichardErkhov
Params8B
Context8K
Q4_K_M4.9 GB
SW
Swallow-MS-7b-v0.1
Swallow · RichardErkhov
Params7.33B
Context4K
Q4_K_M4.4 GB
PH
phi3-4x4b-v1
Phi · RichardErkhov
Params11.1B
Context4K
Q4_K_M6.7 GB
QW
Qwen2.5 Coder 1.5B Instruct Abliterated
Qwen · RichardErkhov
Params1.78B
Context32K
Q4_K_M1.1 GB
AL
Alphacode AI AlphaMist7B slr v3
Alphacode · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
IN
Intel neural chat 7b v3 1
Intel · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
TA
TableLLM 7b
Tablellm · RichardErkhov
Params6.74B
Context16K
Q4_K_M4.1 GB
LL
Llama 3 Meerkat 70b v1.0
Llama · RichardErkhov
Params70.6B
Context8K
Q4_K_M42.5 GB
IN
InternLM2
InternLM · RichardErkhov
Params19.9B
Context8K
Q4_K_M12.0 GB
EV
L3 Evil Stheno v3.2 8B
Evil · RichardErkhov
Params8.03B
Context8K
Q4_K_M4.9 GB
MI
Mistral 7B v0.3
Mistral · RichardErkhov
Params7.25B
Context32K
Q4_K_M4.4 GB
GE
lemon mint gemma ko 7b instruct v0.71
Gemma · RichardErkhov
Params8.54B
Context8K
Q4_K_M5.3 GB
LL
wassimm Llama 3.1 8B psycology w 6k data
Llama · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
MI
jisukim8873 mistral 7B alpaca 1 epoch
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
TH
THaLLE 0.1 7B Fa
Thalle · RichardErkhov
Params7.62B
Context32K
Q4_K_M4.7 GB
LL
llama-3-typhoon-v1.5-8b-instruct
Llama · RichardErkhov
Params8B
Context8K
Q4_K_M4.9 GB
MA
macadeliccc magistrate 3.2 3b it
Macadeliccc · RichardErkhov
Params3.21B
Context128K
Q4_K_M2.0 GB
LL
Llama 3 Tulu 2 70b
Llama · RichardErkhov
Params70.6B
Context2K
Q4_K_M42.5 GB
LL
Llama 2 7b Pruned50 Retrained
Llama · RichardErkhov
Params6.74B
Context4K
Q4_K_M4.1 GB
KU
Kukedlc SuperMente 7B v4
Kukedlc · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
LL
Llama 2 7b Chat Hf
Llama · RichardErkhov
Params6.74B
Context4K
Q4_K_M4.1 GB
LL
kykim0 Llama 2 7b ultrachat syn
Llama · RichardErkhov
Params6.74B
Context4K
Q4_K_M4.1 GB
RE
reflect_llm8B_om2-mstlrg-300k460k-llm33-130k-t12_SFTt1-DPOsPSDPt1_b1
Reflect · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
SA
SanGuoYanYi 6b
Sanguoyanyi · RichardErkhov
Params6.06B
Context4K
Q4_K_M3.7 GB
LL
KISTI KONI KONI Llama3 8B Merged 20240724
Llama · RichardErkhov
Params8B
Context8K
Q4_K_M4.9 GB