GGUF models by featherless-ai-quants
3092 GGUF models quantized by featherless-ai-quants on Hugging Face. Sizes run from 494M to 72.7B parameters. The longest trained context is 1024K tokens.
PO
ChaoticNeutrals/Poppy_Porpoise-v0.6-L3-8B
Poppy · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
sparsh35/Meta-Llama-3.1-8B-Instruct
Llama · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
wisenut-nlp-team/wisenut-llama-3-8B-0.9-Instruct
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
QW
cognitivecomputations/dolphin-2.9.2-qwen2-72b
Qwen · featherless-ai-quants
Params72.7B
Context128K
Q4_K_M47.4 GB
GE
Gkhfe/gemma-Code-Instruct-Finetune-test
Gemma · featherless-ai-quants
Params2.51B
Context8K
Q4_K_M1.6 GB
LL
WhiteRabbitNeo/Llama-3-WhiteRabbitNeo-8B-v2.0
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
cstr/llama3-8b-spaetzle-v37
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
SA
chrischain/Satoshi1337-8B
Satoshi · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
pavan01729/my_Llama-3.2-1B-Instruct
Llama · featherless-ai-quants
Params1.24B
Context128K
Q4_K_M0.8 GB
GE
DatafoundryAI/gemma-2-2b-v3-270k-27-08-2024
Gemma · featherless-ai-quants
Params2.61B
Context8K
Q4_K_M1.7 GB
LL
lordjia/Llama-3.1-Cantonese-8B-Instruct
Llama · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
ArliAI/Llama-3-8B-ArliAI-Formax-v1.0
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
BA
jondurbin/bagel-8b-v1.0
Bagel · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
grimjim/Llama-3-Oasis-v1-OAS-8B
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
QW
NaoS2/qwen2.5-0.5B_uni30_edu_instruct-3
Qwen · featherless-ai-quants
Params494M
Context32K
Q4_K_M0.4 GB
GE
ghemdd/gemma_kto_only
Gemma · featherless-ai-quants
Params2.51B
Context8K
Q4_K_M1.6 GB
LL
grimjim/llama-3-merge-pp-instruct-8B
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
SI
SicariusSicariiStuff/Tinybra_13B
Sicariussicariistuff · featherless-ai-quants
Params13B
Context16K
Q4_K_M7.9 GB
LL
orai-nlp/Llama-eus-8B
Llama · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
AwanLLM/Awanllm-Llama-3-8B-Instruct-DPO-v0.2
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
BA
deval-core/base-eval
Base · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
GE
muhammadfiaz/gemma-2b-it
Gemma · featherless-ai-quants
Params2.51B
Context8K
Q4_K_M1.6 GB
GE
MergeBench/gemma-2-2b_coding
Gemma · featherless-ai-quants
Params2.61B
Context8K
Q4_K_M1.7 GB
MA
YellowDotGroup/mai3.1finetuned1
Mai · featherless-ai-quants
Params70.6B
Context128K
Q4_K_M42.5 GB
SM
FallenMerick/Smart-Lemon-Cookie-7B
Smart · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
GE
AMindToThink/gemma-2-2b_RMU_cyber-forget-corpus_s400_a300_layer7
Gemma · featherless-ai-quants
Params2.61B
Context8K
Q4_K_M1.7 GB
QW
noirchan/qwen2.5-0.5B_ichikara_4802
Qwen · featherless-ai-quants
Params494M
Context32K
Q4_K_M0.4 GB
DE
FuseAI/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview
DeepSeek · featherless-ai-quants
Params32.8B
Context128K
Q4_K_M19.9 GB
LL
princeton-nlp/Llama-3-Instruct-8B-CPO
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GE
AliMaatouk/Gemma-2-2B-Tele
Gemma · featherless-ai-quants
Params2.61B
Context8K
Q4_K_M1.7 GB