GGUF models by RichardErkhov

14354 GGUF models quantized by RichardErkhov on Hugging Face. Sizes run from 1M to 316B parameters. The longest trained context is 102400K tokens.

Most downloadedNewestLargestLongest contextSmallest
EL
Elfrino HarmonicHarlequin v5 20B
Elfrino · RichardErkhov
Params33.3B
Context4K
Q4_K_M20.1 GB
GGUF
DO
DongfuJiang prm math only hf
Dongfujiang · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
PH
Phi 3 4B 4k Instruct CMC
Phi · RichardErkhov
Params3.82B
Context4K
Q4_K_M2.4 GB
GGUF
LL
Llama 3.2 1B Instruct Sw Be Linear
Llama · RichardErkhov
Params1.24B
Context128K
Q4_K_M0.8 GB
Tool use
PY
Pythia 1.4b
Pythia · RichardErkhov
Params1.41B
Context2K
Q4_K_M0.9 GB
GGUF
PL
Plaban81 Moe 4x7b math reason code
Plaban · RichardErkhov
Params24.2B
Context32K
Q4_K_M14.6 GB
Coding
OR
Yi Ko 6B Orca Alpaca Gpt4 Math
Orca · RichardErkhov
Params6.18B
Context2K
Q4_K_M3.8 GB
GGUF
MI
Mistral 7B Base SFT IPO
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
MathHermes-2.5-Mistral-7B
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
Tool use
XL
xLAM 1b Fc R
Xlam · RichardErkhov
Params1.35B
Context16K
Q4_K_M0.9 GB
Tool use
LL
chargoddard prometheus 2 llama 3 8b
Llama · RichardErkhov
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
MI
microsoft rho math 1b v0.1
Microsoft · RichardErkhov
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
RE
ReflectionCoder DS 6.7B
Reflectioncoder · RichardErkhov
Params6.74B
Context16K
Q4_K_M4.1 GB
Coding
CA
CarbonVillain En 10.7B v5
Carbonvillain · RichardErkhov
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF
SM
toastloaf smollm2 135m it orca agentinstruct creative
SmolLM · RichardErkhov
Params135M
Context8K
Q4_K_M0.1 GB
GGUF
MA
Marsouuu lareneg3B ECE PRYMMAL Martial
Marsouuu · RichardErkhov
Params3.82B
Context4K
Q4_K_M2.4 GB
GGUF
PH
IntelLabs sqft sparsepeft phi 3 mini 4k 50 cs heu
Phi · RichardErkhov
Params3.82B
Context4K
Q4_K_M2.4 GB
GGUF
QW
Qwen1.5-7B-Chat
Qwen · RichardErkhov
Params7.72B
Context32K
Q4_K_M4.8 GB
GGUF
MI
PiVoT 10.7B Mistral v0.2 RP
Mistral · RichardErkhov
Params10.7B
Context32K
Q4_K_M6.5 GB
Roleplay
MI
abhishek autotrain xva0j mixtral8x7b
Mistral · RichardErkhov
Params46.7B
Context32K
Q4_K_M28.4 GB
GGUF
RI
Yi Ko 6B
Richarderkhov · RichardErkhov
Params6.18B
Context2K
Q4_K_M3.8 GB
GGUF
PS
Psyfighter2 Noromaid Ties Capybara 13B
Psyfighter · RichardErkhov
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
OP
OPEN SOLAR KO 10.7B
Open · RichardErkhov
Params10.9B
Context2K
Q4_K_M6.5 GB
GGUF
RI
Yi Ko 6B
Richarderkhov · RichardErkhov
Params6.18B
Context2K
Q4_K_M3.8 GB
GGUF
PH
jcorte real phi35 pd kb lora model
Phi · RichardErkhov
Params3.82B
Context128K
Q4_K_M2.3 GB
GGUF
BR
BroAlanTaps GPT2 large 64 34000steps
Broalantaps · RichardErkhov
Params838M
Context1K
Q4_K_M0.5 GB
GGUF
JU
MD Judge v0.1
Judge · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Hercules-2.0-Mistral-7B
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
GA
garage bAInd Platypus 30B
Garage · RichardErkhov
Params32.5B
Context2K
Q4_K_M19.6 GB
GGUF
QW
Qwen2.5 Coder 1.5B Instruct
Qwen · RichardErkhov
Params1.54B
Context32K
Q4_K_M1.0 GB
CodingTool use

Keep browsing