GGUF models by RichardErkhov
14354 GGUF models quantized by RichardErkhov on Hugging Face. Sizes run from 1M to 316B parameters. The longest trained context is 102400K tokens.
TR
Truthful_DPO_TomGrc_FusionNet_7Bx2_MoE_13B
Truthful · RichardErkhov
Params12.9B
Context32K
Q4_K_M7.8 GB
BL
Bloom 7b1
Bloom · RichardErkhov
Params8.1B
Context4K
Q4_K_M5.3 GB
IB
ibivibiv aegolius acadicus v1 30b
Ibivibiv · RichardErkhov
Params29.8B
Context32K
Q4_K_M18.0 GB
MI
Minerva
Minerva · RichardErkhov
Params2.89B
Context16K
Q4_K_M1.8 GB
GE
Gemma 2 9b Chatml
Gemma · RichardErkhov
Params9.24B
Context8K
Q4_K_M5.8 GB
LL
saqada Llama 3.1 8B with 16bit merged lora adapters MOV v7
Llama · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
MI
QuantumIntelligence QI mistral 7B slerp
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
DE
deepseek-coder-33b-instruct
DeepSeek · RichardErkhov
Params33.3B
Context16K
Q4_K_M19.9 GB
JE
Jellyfish 8B
Jellyfish · RichardErkhov
Params8.03B
Context8K
Q4_K_M4.9 GB
ML
mlfoundations dev stackoverflow 10000tasks 1p
Mlfoundations · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
RLHFlow LLaMA3 iterative DPO final
Llama · RichardErkhov
Params8.03B
Context8K
Q4_K_M4.9 GB
YC
ycros BagelMIsteryTour 8x7B
Ycros · RichardErkhov
Params57.6B
Context32K
Q4_K_M28.4 GB
LL
LLaMAntino 2 Chat 7b Hf UltraChat ITA
Llama · RichardErkhov
Params6.74B
Context4K
Q4_K_M4.1 GB
AM
amazingvince Not WizardLM 2 7B
Amazingvince · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
E5 R Mistral 7b
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
BR
BroAlanTaps GPT2 large 256 16500steps
Broalantaps · RichardErkhov
Params838M
Context1K
Q4_K_M0.5 GB
RE
reflect_llm8B_Om2SftT1-Om2G8kOm2AgIpsdpIter1T1_b1.0
Reflect · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
ML
mlfoundations dev stackoverflow 5000tasks .75p
Mlfoundations · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
TI
Tiny-Pirate-1.1b-v0.1
Tiny · RichardErkhov
Params1.1B
Context2K
Q4_K_M0.7 GB
BL
Bloom 7b1
Bloom · RichardErkhov
Params8.1B
Context4K
Q4_K_M5.3 GB
YI
dolphin-2.9.1-yi-1.5-34b
Yi · RichardErkhov
Params34.4B
Context8K
Q4_K_M20.7 GB
LL
BramVanroy llama2 13b ft mc4 nl cleaned tiny
Llama · RichardErkhov
Params13B
Context4K
Q4_K_M7.9 GB
LL
LDCC Instruct Llama 2 Ko 13B v4.1.2
Llama · RichardErkhov
Params13B
Context2K
Q4_K_M7.9 GB
FU
FusionNet
Fusionnet · RichardErkhov
Params21.2B
Context4K
Q4_K_M12.7 GB
DI
Diksha2001 VLLM new
Diksha · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
cais HarmBench Llama 2 13b cls multimodal behaviors
Llama · RichardErkhov
Params13B
Context4K
Q4_K_M7.9 GB
LL
vicgalle Configurable Llama 3 8B v0.3
Llama · RichardErkhov
Params8.03B
Context8K
Q4_K_M4.9 GB
MI
Mixtral-8x7B-Instruct-v0.1
Mistral · RichardErkhov
Params46.7B
Context32K
Q4_K_M28.4 GB
GE
Gemma 7b Aps It
Gemma · RichardErkhov
Params8.54B
Context8K
Q4_K_M5.3 GB
CH
Christoph LSN gpt2 finetuned on metadata
Christoph · RichardErkhov
Params163M
Context1K
Q4_K_M0.1 GB