GGUF models by RichardErkhov

14354 GGUF models quantized by RichardErkhov on Hugging Face. Sizes run from 1M to 316B parameters. The longest trained context is 102400K tokens.

Most downloadedNewestLargestLongest contextSmallest
LL
akshit Gupta llamanew1merged FinetunedByAG
Llama · RichardErkhov
Params1.24B
Context128K
Q4_K_M0.8 GB
Tool use
CR
crestf411 L3.1 8B sunfall v0.6.1 dpo
Crestf · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
jan hq llama3 s instruct v0.3 checkpoint 3000
Llama · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
Llama3 S Instruct v0.3 Checkpoint 7000
Llama · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
BL
Bloom 7b1
Bloom · RichardErkhov
Params8.1B
Context4K
Q4_K_M5.3 GB
GGUF
ON
Only_Mini
Only · RichardErkhov
Params1.24B
Context128K
Q4_K_M0.8 GB
GGUF
PY
Pythia 1b
Pythia · RichardErkhov
Params1.01B
Context2K
Q4_K_M0.7 GB
GGUF
YO
yoshility model merge dare ties v1
Yoshility · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
GE
Gemma 2 2b
Gemma · RichardErkhov
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
GR
GritLM 7B
Gritlm · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
lmlab-mistral-1b-untrained
Mistral · RichardErkhov
Params1.13B
Context32K
Q4_K_M0.7 GB
GGUF
LL
Llama3 8B Dpo Sft v1
Llama · RichardErkhov
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
YU
yuntian deng gpt2 implicit cot multiplication 20 digits
Yuntian · RichardErkhov
Params163M
Context1K
Q4_K_M0.1 GB
GGUF
RI
Yi Ko 6B
Richarderkhov · RichardErkhov
Params6.18B
Context2K
Q4_K_M3.8 GB
GGUF
MI
mlfoundations dev hp ablations mistral adambeta2 0.95 dcftv1.2
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Mistral 7B Instruct KTO
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Tess 2.0 Mixtral 8x7B
Mistral · RichardErkhov
Params46.7B
Context32K
Q4_K_M28.4 GB
GGUF
OP
OpenLLM Ro RoMistral 7b Instruct 2024 05 17
Openllm · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
LL
mlfoundations dev mistral 7b 0 3 oh dcft v3.1 llama 3.1 8b
Llama · RichardErkhov
Params7.25B
Context32K
Q4_K_M4.4 GB
GGUF
NU
AI MO NuminaMath 72B TIR
Numinamath · RichardErkhov
Params72.7B
Context128K
Q4_K_M47.4 GB
GGUF
QW
Pretrain Qwen 500M
Qwen · RichardErkhov
Params464M
Context32K
Q4_K_M0.3 GB
GGUF
LL
Llama 2 Ko 7b
Llama · RichardErkhov
Params6.86B
Context2K
Q4_K_M4.2 GB
GGUF
LL
Llama 2 13b
Llama · RichardErkhov
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
GP
Gpt2 Context_Generator
Gpt · RichardErkhov
Params163M
Context1K
Q4_K_M0.1 GB
GGUF
MI
martyn mixtral megamerge dare 8x7b v2
Mistral · RichardErkhov
Params46.7B
Context32K
Q4_K_M9.4 GB
GGUF
EN
ENERGY DRINK LOVE eeve leaderboard inst v1.5
Energy · RichardErkhov
Params10.8B
Context4K
Q4_K_M6.5 GB
GGUF
PH
IntelLabs sqft phi 3 mini 4k 60 base
Phi · RichardErkhov
Params3.82B
Context4K
Q4_K_M2.4 GB
GGUF
GI
Gille StrangeMerges 8 7B slerp
Gille · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
LL
Open_Llama_3B
Llama · RichardErkhov
Params3.43B
Context2K
Q4_K_M2.6 GB
GGUF
GP
Gpt2 Large
Gpt · RichardErkhov
Params838M
Context1K
Q4_K_M0.5 GB
GGUF

Keep browsing