GGUF models by RichardErkhov

14354 GGUF models quantized by RichardErkhov on Hugging Face. Sizes run from 1M to 316B parameters. The longest trained context is 102400K tokens.

Most downloadedNewestLargestLongest contextSmallest
BG
CamiloGC93 bge large en v1.5 soft skills
BGE · RichardErkhov
Params334M
Context512
Q4_K_M0.2 GB
Embedding
DE
Deepseek Coder 1.3B Kexer
DeepSeek · RichardErkhov
Params1.35B
Context16K
Q4_K_M0.9 GB
Coding
LL
Llama 3.1 Tulu 3 8B SFT
Llama · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
Vision
GI
giux78 zefiro 7b sft qlora ITA v0.5
Giux · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
BL
Bloom 7b1
Bloom · RichardErkhov
Params8.1B
Context4K
Q4_K_M5.3 GB
GGUF
TE
TeeZee Bielik SOLAR LIKE 10.7B Instruct v0.1
Teezee · RichardErkhov
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF
KO
KoRAE 13b
Korae · RichardErkhov
Params13.2B
Context2K
Q4_K_M8.0 GB
GGUF
LL
Radiantloom Llama 70b Instruct
Llama · RichardErkhov
Params69B
Context32K
Q4_K_M41.4 GB
GGUF
MA
ManthanKulakarni TinyLlama 1.1B Text2SQL
Manthankulakarni · RichardErkhov
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
PH
ihughes15234 phi35 tictactoe dpo5epoch
Phi · RichardErkhov
Params3.82B
Context128K
Q4_K_M2.3 GB
GGUF
BR
Breeze-7B-Instruct-v1_0
Breeze · RichardErkhov
Params7.49B
Context32K
Q4_K_M4.5 GB
GGUF
IN
Internlm2_5 7b Chat Abliterated
InternLM · RichardErkhov
Params7.74B
Context32K
Q4_K_M4.7 GB
GGUF
LL
Llama 3 LewdPlay 8B Evo
Llama · RichardErkhov
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
ML
mlfoundations dev stackoverflow 5000tasks .25p
Mlfoundations · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
thkim0305 Meta Llama3 8B Circuit breaker
Llama · RichardErkhov
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
SO
SOLAR-10.7B-Instruct-SOLARC-M-10.7B-slerp
Solar · RichardErkhov
Params10.7B
Context4K
Q4_K_M6.5 GB
Coding
BR
BroAlanTaps GPT2 large 4 62000steps
Broalantaps · RichardErkhov
Params839M
Context1K
Q4_K_M0.5 GB
GGUF
MO
Mondhirch Natural Language to Cypher 2.7b
Mondhirch · RichardErkhov
Params2.78B
Context2K
Q4_K_M1.7 GB
GGUF
SA
SakanaAI EvoLLM JP v1 7B
Sakanaai · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
RA
RaushanTurganbay GPT2 sft and dpo tuned
Raushanturganbay · RichardErkhov
Params406M
Context1K
Q4_K_M0.3 GB
GGUF
DA
Dans DiscountModels Dans Instruct Mix 8b ChatML V0.0.1
Dans · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
CH
BM25Chunk
Chunk · RichardErkhov
Params1.35B
Context8K
Q4_K_M0.9 GB
GGUF
MI
Mistral 7B Base SFT SimPO
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
LL
phildunphy14 llama 3 1 non quant 8b 55k
Llama · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
arnavgrg codellama 13b instruct nf4 fp16 upscaled
Llama · RichardErkhov
Params13B
Context16K
Q4_K_M7.9 GB
Coding
PH
grounded ai phi3.5 rag relevance judge merge
Phi · RichardErkhov
Params3.82B
Context128K
Q4_K_M2.4 GB
GGUF
LL
Layerskip Llama3.2 1B
Llama · RichardErkhov
Params1.24B
Context128K
Q4_K_M0.8 GB
GGUF
JP
jpalgo jp 3k shlow qft v1
Jpalgo · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Vikhr-Llama-3.2-1B-Instruct-abliterated
Llama · RichardErkhov
Params1.24B
Context128K
Q4_K_M0.8 GB
Tool use
LO
LordNoah Alpaca spin gpt2 e1 se0
Lordnoah · RichardErkhov
Params838M
Context1K
Q4_K_M0.5 GB
GGUF

Keep browsing