GGUF models by RichardErkhov

14354 GGUF models quantized by RichardErkhov on Hugging Face. Sizes run from 1M to 316B parameters. The longest trained context is 102400K tokens.

Most downloadedNewestLargestLongest contextSmallest
LL
klcsp llama3.1 8b gpt4o 100k coding fft
Llama · RichardErkhov
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
AB
Abhinavanand21 gita text generation gpt2
Abhinavanand · RichardErkhov
Params163M
Context1K
Q4_K_M0.1 GB
GGUF
MI
mlfoundations dev hp ablations mistral scheduler inverse sqrt
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
LL
EmTpro01 codellama 7b finetuned
Llama · RichardErkhov
Params6.74B
Context16K
Q4_K_M4.1 GB
Coding
FA
ssmits Falcon2 5.5B Polish
Falcon · RichardErkhov
Params5.47B
Context2K
Q4_K_M3.4 GB
GGUF
LL
Llama 3.2 1B Instruct
Llama · RichardErkhov
Params1.5B
Context128K
Q4_K_M1.0 GB
Tool use
PH
M1LL1X microsoft phi 3 5 mini trained abliterated QA 100 all modules merged
Phi · RichardErkhov
Params3.82B
Context128K
Q4_K_M2.4 GB
GGUF
MA
Math Chunk Refining Lm
Math · RichardErkhov
Params354M
Context2K
Q4_K_M0.2 GB
GGUF
ML
mlfoundations dev oh v1.3 camel biology x.5
Mlfoundations · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
CDS CodeLlama 7b Instruct Hf 20240926
Llama · RichardErkhov
Params6.74B
Context16K
Q4_K_M4.1 GB
Coding
GE
gemma-2b-data-std
Gemma · RichardErkhov
Params2.51B
Context8K
Q4_K_M1.6 GB
GGUF
LL
komt-llama2-7b-v1
Llama · RichardErkhov
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
YI
HenryJJ Instruct Yi 6B Dolly15K
Yi · RichardErkhov
Params6.06B
Context4K
Q4_K_M3.7 GB
GGUF
MI
shenzhi wang Mistral 7B v0.3 Chinese Chat
Mistral · RichardErkhov
Params7.25B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Speechless Mistral 7B v0.2 Mixed 1
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
LL
meta llama LlamaGuard 7b
Llama · RichardErkhov
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
PH
tuong nguyen prd Phi 3.1 mini 128k instruct
Phi · RichardErkhov
Params3.82B
Context128K
Q4_K_M2.4 GB
GGUF
QW
Qwen2.5 3B Instruct
Qwen · RichardErkhov
Params3.09B
Context32K
Q4_K_M1.9 GB
Tool use
RO
rocket-3B
Rocket · RichardErkhov
Params2.8B
Context4K
Q4_K_M1.7 GB
GGUF
DC
Dclm Perplexity Correlations Spearmanr No Samp 160m
Dclm · RichardErkhov
Params162M
Context2K
Q4_K_M0.1 GB
GGUF
LL
ArliAI Llama 3 8B Instruct DPO v0.2
Llama · RichardErkhov
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
GR
Granite 3.0 2b Instruct
Granite · RichardErkhov
Params2.63B
Context4K
Q4_K_M1.6 GB
Tool use
GE
ecdev gemma 2b instruct ft medical qa
Gemma · RichardErkhov
Params2.51B
Context8K
Q4_K_M1.6 GB
GGUF
GP
gpt2-medium-vaguely-human-dialogue
Gpt · RichardErkhov
Params406M
Context1K
Q4_K_M0.3 GB
GGUF
IS
ishmanish gpt2 autotrain text HrPolicy aug v2
Ishmanish · RichardErkhov
Params163M
Context1K
Q4_K_M0.1 GB
GGUF
RO
RoamifyMML financial advice model
Roamifymml · RichardErkhov
Params163M
Context1K
Q4_K_M0.1 GB
GGUF
LL
Llama 3.2 3b It Library ChatBot
Llama · RichardErkhov
Params3.21B
Context128K
Q4_K_M2.0 GB
GGUF
LL
Llama-3.2-1B-Instruct-APIGen-FC-v0.1
Llama · RichardErkhov
Params1.24B
Context128K
Q4_K_M0.8 GB
Tool use
RW
rwitz2 go bruins v2.1.1
Rwitz · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
SA
saishf West Hermes 7B
Saishf · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
Tool use

Keep browsing