GGUF models by RichardErkhov
14354 GGUF models quantized by RichardErkhov on Hugging Face. Sizes run from 1M to 316B parameters. The longest trained context is 102400K tokens.
LI
lightblue reranker 0.5 bin filt
Lightblue · RichardErkhov
Params630M
Context32K
Q4_K_M0.5 GB
DO
DongfuJiang prm version3 full hf
Dongfujiang · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
YI
Yi 6b 200k
Yi · RichardErkhov
Params6.06B
Context195K
Q4_K_M3.7 GB
LL
MaziyarPanahi calme 2.2 llama3 70b
Llama · RichardErkhov
Params70.6B
Context8K
Q4_K_M42.5 GB
SA
Sailor 4B
Sailor · RichardErkhov
Params3.95B
Context32K
Q4_K_M2.5 GB
MI
mistralai Mistral 7B Instruct v0.1
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
PO
postboxat18 AR400GroqModel
Postboxat · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3 10b It Kor Extented Chang
Llama · RichardErkhov
Params9.78B
Context8K
Q4_K_M6.0 GB
WI
WizardLM-2-7B-abliterated
Wizardlm · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
SM
Smaug 34B v0.1
Smaug · RichardErkhov
Params34.4B
Context195K
Q4_K_M20.7 GB
QW
quocdat25 fast apply 16bit v0.v16 Qwen2.5 Coder 1.5B Instruct
Qwen · RichardErkhov
Params1.54B
Context32K
Q4_K_M1.0 GB
LL
Llama-2-7B-instruct-text2sql
Llama · RichardErkhov
Params6.74B
Context4K
Q4_K_M4.1 GB
MA
Matter 0.1 Slim 7B C
Matter · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
SE
semcoder semcoder 1030
Semcoder · RichardErkhov
Params6.74B
Context16K
Q4_K_M4.1 GB
PH
IntelLabs sqft phi 3 mini 4k 30 base
Phi · RichardErkhov
Params3.82B
Context4K
Q4_K_M2.4 GB
LL
leap llm Meta Llama 3 8B Instruct sft alfworld iter2
Llama · RichardErkhov
Params8B
Context8K
Q4_K_M4.9 GB
LL
Papy_2_Llama 3.1 8B Instruct_text
Llama · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
MA
Matter 0.1 7B Boost
Matter · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
PH
tuong nguyen prd Phi 3.5 mini 128k instruct
Phi · RichardErkhov
Params3.82B
Context128K
Q4_K_M2.4 GB
SA
SambaLingo Arabic Base
Sambalingo · RichardErkhov
Params6.95B
Context4K
Q4_K_M4.2 GB
BI
BioMistral BioMistral 7B TIES
Biomistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
RO
roadz dv finetuned 211124
Roadz · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
liyimengwork llama 3.1 8B wenyanwen2
Llama · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
GE
Gemma 2 27b It
Gemma · RichardErkhov
Params27.2B
Context8K
Q4_K_M16.6 GB
LI
lightblue reranker 0.5 bincont filt
Lightblue · RichardErkhov
Params630M
Context32K
Q4_K_M0.5 GB
LL
DarkIdol Llama 3.1 8B Instruct 1.2 Uncensored
Llama · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
SA
saishf SOVLish Maid L3 8B
Saishf · RichardErkhov
Params8.03B
Context8K
Q4_K_M4.9 GB
PR
PranavHarshan NarraLarge
Pranavharshan · RichardErkhov
Params8.03B
Context8K
Q4_K_M4.9 GB
CO
Yi Coder 9B Chat Instruct TIES
Coder · RichardErkhov
Params28.3B
Context128K
Q4_K_M17.1 GB
LL
namespace Pt Llama 3 8B Instruct 80K QLoRA Merged
Llama · RichardErkhov
Params8.03B
Context80K
Q4_K_M4.9 GB