GGUF models by featherless-ai-quants
3092 GGUF models quantized by featherless-ai-quants on Hugging Face. Sizes run from 494M to 72.7B parameters. The longest trained context is 1024K tokens.
LL
wisenut-nlp-team/wisenut-llama-3-8B-0.1-Instruct
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
ZI
SicariusSicariiStuff/Zion_Alpha_Instruction_Tuned_SLERP
Zion · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
LL
princeton-nlp/Llama-3-Base-8B-SFT-ORPO
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
wisenut-nlp-team/wisenut-llama-3-8B-0.8-Instruct
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
MI
besimray/miner_id_3_72df7d62-e0d6-41b2-9153-9843320d6b82_1729802122
Miner · featherless-ai-quants
Params1.24B
Context128K
Q4_K_M0.8 GB
QW
Hachipo/qwen2.5-0.5B_educational_instruct_top30000_codeonly
Qwen · featherless-ai-quants
Params494M
Context32K
Q4_K_M0.4 GB
LL
AwanLLM/Awanllm-Llama-3-8B-Cumulus-v0.2
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
LU
Undi95/Lumimaid-Magnum-12B
Lumimaid · featherless-ai-quants
Params12.2B
Context1000K
Q4_K_M7.5 GB
LL
unsloth/llama-2-13b
Llama · featherless-ai-quants
Params13B
Context4K
Q4_K_M7.9 GB
OV
yifanxie/overjoyed-koel-1-1-1
Overjoyed · featherless-ai-quants
Params2.51B
Context8K
Q4_K_M1.6 GB
GE
williamlcn/gemmadpo2
Gemma · featherless-ai-quants
Params2.61B
Context8K
Q4_K_M1.7 GB
PL
PleIAs/OCRonos
Pleias · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
ME
Langboat/Mengzi3-8B-Chat
Mengzi · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
princeton-nlp/Llama-3-Instruct-8B-RRHF-v0.2
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
lemon07r/Llama-3-RedMagic4-8B
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
ST
jan-hq/stealth-v1.3
Stealth · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
GE
AMindToThink/gemma-2-2b_RMU_s400_a300_layer7
Gemma · featherless-ai-quants
Params2.61B
Context8K
Q4_K_M1.7 GB
IN
nothingiisreal/L3-8B-Instruct-Abliterated-DWP
Instruct · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
FI
Undi95/MG-FinalMix-72B
Finalmix · featherless-ai-quants
Params72.7B
Context32K
Q4_K_M47.4 GB
LL
HODACHI/Llama-3.1-8B-EZO-1.1-it
Llama · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
GE
MergeMerge/gemma-2-2B-allenai-tulu-3-sft-glaive-v3
Gemma · featherless-ai-quants
Params2.61B
Context8K
Q4_K_M1.7 GB
AZ
AswanthCManoj/azma-v2
Azma · featherless-ai-quants
Params1.1B
Context2K
Q4_K_M0.7 GB
QW
maldv/Qwenstein2.5-32B-Instruct
Qwen · featherless-ai-quants
Params32.8B
Context128K
Q4_K_M19.9 GB
LL
macadeliccc/Opus-Samantha-Llama-3-8B
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
QU
QuantumIntelligence/QI-neural-chat-7B-ko-DPO
Quantumintelligence · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
QW
Qwen/Qwen1.5-1.8B-Chat
Qwen · featherless-ai-quants
Params1.84B
Context32K
Q4_K_M1.2 GB
QW
ArliAI/QwQ-32B-ArliAI-RpR-v1
Qwen · featherless-ai-quants
Params32.8B
Context40K
Q4_K_M19.9 GB
SE
ZySec-AI/ZySec-7B
Securityllm · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
SE
sethuiyer/Dr.Samantha-8B
Sethuiyer · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GE
MergeBench/gemma-2-2b-it_coding
Gemma · featherless-ai-quants
Params2.61B
Context8K
Q4_K_M1.7 GB