GGUF models by RichardErkhov

14354 GGUF models quantized by RichardErkhov on Hugging Face. Sizes run from 1M to 316B parameters. The longest trained context is 102400K tokens.

Most downloadedNewestLargestLongest contextSmallest
LL
Llama 3.2 1B Instruct Oracmath3
Llama · RichardErkhov
Params1.24B
Context128K
Q4_K_M0.8 GB
Tool use
YU
yuntian deng gpt2 no cot multiplication
Yuntian · RichardErkhov
Params163M
Context1K
Q4_K_M0.1 GB
GGUF
LL
Llama 2 Koen 13b
Llama · RichardErkhov
Params13.2B
Context2K
Q4_K_M8.0 GB
GGUF
MI
Mistral 7B Discord 0.2
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
BL
Blexus Quble Test Model v1 Pretrain
Blexus · RichardErkhov
Params163M
Context1K
Q4_K_M0.1 GB
GGUF
GE
Gemma 2 9b It
Gemma · RichardErkhov
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
DE
defog sqlcoder 7b 2
Defog · RichardErkhov
Params6.74B
Context16K
Q4_K_M4.1 GB
Coding
LL
Llama-3-8B-Dolphin-Portuguese-v0.2
Llama · RichardErkhov
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
MI
flammenai flammen12 mistral 7B
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
TI
TinyLlama 1.1B Chat v1.0
Tinyllama · RichardErkhov
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
NL
nlpguy Lelantos low tune
Nlpguy · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
WE
Weyaxi OpenHermes 2.5 neural chat v3 2 Slerp
Weyaxi · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
Tool use
KR
kromcomp L3 Ceto Epith Humanity.A v0.1 8B
Kromcomp · RichardErkhov
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
MI
Mistral 7B v0.1
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
LL
posicube Llama2 chat AYT 13B
Llama · RichardErkhov
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
TH
thanhtunguet vietnamese administrative units model
Thanhtunguet · RichardErkhov
Params406M
Context1K
Q4_K_M0.3 GB
GGUF
MA
martimfasantos tinyllama 1.1b sum sft full v1.1
Martimfasantos · RichardErkhov
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
LL
harborwater open llama 3b v2 wizard evol instuct v2 196k
Llama · RichardErkhov
Params3.43B
Context2K
Q4_K_M2.6 GB
GGUF
MS
msahu gita text generation gpt2
Msahu · RichardErkhov
Params163M
Context1K
Q4_K_M0.1 GB
GGUF
MI
Mistral 7B v0.3
Mistral · RichardErkhov
Params7.25B
Context32K
Q4_K_M4.4 GB
Tool use
MI
mii llm maestrale chat v0.2 alpha sft
Mii · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
SM
SmolLM2-1.7B-FT-SCP-Wiki
SmolLM · RichardErkhov
Params1.71B
Context8K
Q4_K_M1.1 GB
GGUF
BE
besimray miner id 3 39af4c9e af50 4caf 82df 9b39957446f9 1729801295
Besimray · RichardErkhov
Params3.82B
Context128K
Q4_K_M2.3 GB
GGUF
LL
CDS CodeLlama Ins 7b E2E 20241017
Llama · RichardErkhov
Params6.74B
Context16K
Q4_K_M4.1 GB
Coding
YI
Configurable-Yi-1.5-9B-Chat
Yi · RichardErkhov
Params8.83B
Context4K
Q4_K_M5.3 GB
GGUF
QW
Openbuddy Qwen1.5 14b v21.1 32k
Qwen · RichardErkhov
Params14.2B
Context32K
Q4_K_M9.2 GB
GGUF
QW
habapchan Qwen2.5 Coder 3B aihub text to sql
Qwen · RichardErkhov
Params3.09B
Context32K
Q4_K_M1.9 GB
CodingTool use
AP
Apollo 7B
Apollo · RichardErkhov
Params8.54B
Context8K
Q4_K_M5.3 GB
GGUF
IS
ismail h TinyLlama 1.1B Mental Health Classification
Ismail · RichardErkhov
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
MI
synapsellm-7b-mistral-v0.3-preview
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF

Keep browsing