GGUF models by featherless-ai-quants
3092 GGUF models quantized by featherless-ai-quants on Hugging Face. Sizes run from 494M to 72.7B parameters. The longest trained context is 1024K tokens.
LL
wisenut-nlp-team/wisenut-llama-3-8B-0.7-Instruct
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
SongTonyLi Llama 3.2 1B Instruct SFT D1 chosen HuggingFaceH4 ultrafeedback binarized Xlarge
Llama · featherless-ai-quants
Params1.24B
Context128K
Q4_K_M0.8 GB
MF
netcat420/MFANNv0.15.10
Mfannv · featherless-ai-quants
Params8.03B
Context32K
Q4_K_M4.9 GB
LL
EIRTHAIMED/Llama-3.1-EIRAI-8B-Prob
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
QW
magnifi/qwen2-rephrase-classify-multitask-v7
Qwen · featherless-ai-quants
Params494M
Context32K
Q4_K_M0.4 GB
LL
Gryphe/Pantheon-RP-1.0-8b-Llama-3
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
meta-llama/Meta-Llama-3-8B-Instruct
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
TroyDoesAI/Llama-3.1-8B-Instruct
Llama · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
NE
bongbongs/NewMes-v15
Newmes · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
TroyDoesAI/Mermaid-Llama-3-8B
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
Walmart-the-bag/Llama-3-LizardCoder-8B
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
Jsoo/Llama3-beomi-Open-Ko-8B-Instruct-preview-test6
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
QW
Hachipo/Qwen2.5-0.5B_MIFT-enja_250
Qwen · featherless-ai-quants
Params494M
Context32K
Q4_K_M0.4 GB
QW
zJuu/Qwen-Qwen2-0.5B-1717968102
Qwen · featherless-ai-quants
Params494M
Context128K
Q4_K_M0.4 GB
AL
Alsebay/new-turn-1
Alsebay · featherless-ai-quants
Params10.7B
Context4K
Q4_K_M6.5 GB
AA
Aaryan-Nakhat/experiment-45-intelligent-layer-2-plus-exp-39-data
Aaryan · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
QW
Hachipo/qwen2.5-0.5B_educational_instruct_top_4000_pythonblock_en_ja
Qwen · featherless-ai-quants
Params494M
Context32K
Q4_K_M0.4 GB
SY
v000000/SyntheticMoist-11B
Syntheticmoist · featherless-ai-quants
Params10.7B
Context4K
Q4_K_M6.5 GB
NE
netcat420/MFANNv0.16.10
Netcat · featherless-ai-quants
Params8.03B
Context32K
Q4_K_M4.9 GB
LL
KISTI-KONI/KONI-Llama3.1-8B-R-Preview-20250320
Llama · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
KI
moonshotai/Kimi-Dev-72B
Kimi · featherless-ai-quants
Params72.7B
Context128K
Q4_K_M47.4 GB
GE
MinaMila/gemma_unlearned_unbalance_gender_1e-5_1.0_0.25_0.25_epoch3
Gemma · featherless-ai-quants
Params2.61B
Context8K
Q4_K_M1.7 GB
LL
Edgerunners/Llama-3-8B-Instruct-ortho-baukit-toxic-n128-v3
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
JA
bardsai/jaskier-7b-dpo-v5.6
Jaskier · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
PA
ParasiticRogue/Magnum-Instruct-12B
Parasiticrogue · featherless-ai-quants
Params12.2B
Context1000K
Q4_K_M7.5 GB
QW
magnifi/qwen2-classify-10-epochs
Qwen · featherless-ai-quants
Params494M
Context32K
Q4_K_M0.4 GB
LL
fxmeng/PiSSA-Llama-3-8B-r128
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
EV
sophosympatheia/Evathene-v1.1
Evathene · featherless-ai-quants
Params72.7B
Context128K
Q4_K_M47.4 GB
JU
fblgit/juanako-7b-UNA
Juanako · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
QW
xinlai/Qwen2-7B-SFT
Qwen · featherless-ai-quants
Params7.62B
Context128K
Q4_K_M4.7 GB