GGUF models by featherless-ai-quants
3092 GGUF models quantized by featherless-ai-quants on Hugging Face. Sizes run from 494M to 72.7B parameters. The longest trained context is 1024K tokens.
MO
muhammadkwanso/model
Model · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
QW
maldv/Qwentile2.5-32B-Instruct
Qwen · featherless-ai-quants
Params32.8B
Context32K
Q4_K_M19.9 GB
GE
elliotthwangmsa/Kimlan-gemma2_tw
Gemma · featherless-ai-quants
Params2.61B
Context8K
Q4_K_M1.7 GB
VE
Dorian2B/Vera-v1.1-Instruct
Vera · featherless-ai-quants
Params2.61B
Context8K
Q4_K_M1.7 GB
NE
Kukedlc/NeuralMiLLaMa-8B-slerp
Neuralmillama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GE
AMindToThink/gemma-2-2b_RMU_s400_a500_layer3
Gemma · featherless-ai-quants
Params2.61B
Context8K
Q4_K_M1.7 GB
LL
louisbrulenaudet/Romulus-cpt-Llama-3.1-8B-v0.1
Llama · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
kimwooglae/WebSquareAI-Instruct-llama-3-8B-v0.5.39
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
MI
Ja-ck/Mistral-instruct-Y24-DPO
Mistral · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
GE
AMindToThink/gemma-2-2b_RMU_s400_a500_layer7
Gemma · featherless-ai-quants
Params2.61B
Context8K
Q4_K_M1.7 GB
GE
elliotthwang/Kimlan-gemma2_tw
Gemma · featherless-ai-quants
Params2.61B
Context8K
Q4_K_M1.7 GB
CH
mlabonne/ChimeraLlama-3-8B
Chimerallama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GE
MinaMila/gemma_unlearned_unbalance_gender_1e-5_1.0_1.0_1.0_epoch1
Gemma · featherless-ai-quants
Params2.61B
Context8K
Q4_K_M1.7 GB
GE
AMindToThink/gemma-2-2b_RMU_s100_a100_layer7
Gemma · featherless-ai-quants
Params2.61B
Context8K
Q4_K_M1.7 GB
LL
NESPED-GEN/Llama-3.2-text2SQL-v0
Llama · featherless-ai-quants
Params1.24B
Context128K
Q4_K_M0.8 GB
CO
williamlcn/6851_16_32_0320_combined
Combined · featherless-ai-quants
Params2.61B
Context8K
Q4_K_M1.7 GB
GE
AMindToThink/gemma-2-2b_RMU_s200_a500_layer7
Gemma · featherless-ai-quants
Params2.61B
Context8K
Q4_K_M1.7 GB
LL
JesseLiu/llama_099
Llama · featherless-ai-quants
Params1.24B
Context128K
Q4_K_M0.8 GB
BL
kromeurus/L3-Blackfall-Summanus-v0.1-15B
Blackfall · featherless-ai-quants
Params15B
Context8K
Q4_K_M9.1 GB
QW
Hachipo/qwen2.5-0.5B_educational_instruct_top3000_en-ja_noncreated
Qwen · featherless-ai-quants
Params494M
Context32K
Q4_K_M0.4 GB
LL
gaverfraxz/Meta-Llama-3.1-8B-Instruct-HalfAbliterated-TIES
Llama · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
GE
pavanKumar2004/gemma-2b-it-finetuned-linkedin
Gemma · featherless-ai-quants
Params2.61B
Context8K
Q4_K_M1.7 GB
LL
wisenut-nlp-team/wisenut-llama-3-8B-0.3-Instruct
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GE
IAmSkyDra/GemSUra-edu
Gemsura · featherless-ai-quants
Params2.51B
Context8K
Q4_K_M1.6 GB
MA
shyamieee/Maverick-v3.0
Maverick · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
SU
Fizzarolli/MN-12b-Sunrose
Sunrose · featherless-ai-quants
Params12.2B
Context1000K
Q4_K_M7.5 GB
GE
lemon-mint/gemma-2b-translation-v0.90
Gemma · featherless-ai-quants
Params2.51B
Context8K
Q4_K_M1.6 GB
LL
dreamgen/llama3-8b-instruct-align-test1-kto
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GR
OnlyCheeini/greesychat-turbo
Greesychat · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
QW
NaoS2/qwen2.5-0.5B_linear15_edu_instruct-3
Qwen · featherless-ai-quants
Params494M
Context32K
Q4_K_M0.4 GB