GGUF models by featherless-ai-quants
3092 GGUF models quantized by featherless-ai-quants on Hugging Face. Sizes run from 494M to 72.7B parameters. The longest trained context is 1024K tokens.
LL
sethuiyer/Medichat-Llama3-8B
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
QW
huihui-ai/Qwen2.5-72B-Instruct-abliterated
Qwen · featherless-ai-quants
Params72.7B
Context32K
Q4_K_M47.4 GB
NE
netcat420/MFANNv0.17.12
Netcat · featherless-ai-quants
Params8.03B
Context32K
Q4_K_M4.9 GB
LL
Orenguteng/Llama-3-8B-LexiFun-Uncensored-V1
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
NO
NeverSleep/Noromaid-13b-v0.3
Noromaid · featherless-ai-quants
Params13B
Context4K
Q4_K_M7.9 GB
QW
Qwen/Qwen2.5-Coder-0.5B
Qwen · featherless-ai-quants
Params494M
Context32K
Q4_K_M0.4 GB
DE
deepseek-ai/DeepSeek-R1-Distill-Llama-8B
DeepSeek · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
MI
chihoonlee10/T3Q-EN-DPO-Mistral-7B
Mistral · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
FI
mlabonne/FineLlama-3.1-8B
Finellama · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
LU
fblgit/LUNA-SOLARkrautLM-Instruct
Luna · featherless-ai-quants
Params10.7B
Context4K
Q4_K_M6.5 GB
LL
Cartinoe5930/Llama2_init_Mistral
Llama · featherless-ai-quants
Params7.24B
Context4K
Q4_K_M4.4 GB
DA
DavidAU/L3-Dark-Planet-8B
Dark · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
QW
noirchan/Qwen2.5-Coder-0.5B_mergelinear0.8
Qwen · featherless-ai-quants
Params494M
Context32K
Q4_K_M0.4 GB
LL
aisingapore/llama3.1-8b-cpt-sea-lionv3-base
Llama · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
BA
jondurbin/bagel-dpo-7b-v0.1
Bagel · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
QW
Qwen/Qwen2.5-Math-7B-Instruct
Qwen · featherless-ai-quants
Params7.62B
Context4K
Q4_K_M4.7 GB
CH
lashid11/CheckGPT-SOLAR-10.7B
Checkgpt · featherless-ai-quants
Params10.7B
Context4K
Q4_K_M6.5 GB
MY
Muhammad2003/Myriad-7B-Slerp
Myriad · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
KoboldAI/Mistral-7B-Holodeck-1
Mistral · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
PA
appvoid/palmer-004-overfit
Palmer · featherless-ai-quants
Params1.1B
Context2K
Q4_K_M0.7 GB
SA
kyujinpy/Sakura-SOLAR-Instruct-DPO-v2
Sakura · featherless-ai-quants
Params10.7B
Context4K
Q4_K_M6.5 GB
LL
lainshower/Llama3-8b-alpaca
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
TR
TroyDoesAI/Mermaid-Coder-MoE-Expert1
Troydoesai · featherless-ai-quants
Params10.7B
Context4K
Q4_K_M6.5 GB
MI
LeroyDyer/Mixtral_AI_CyberTron_Ultra
Mistral · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
HI
KaraKaraWitch/HiTZ-GoLLIE-13B-AsSafeTensors
Hitz · featherless-ai-quants
Params13B
Context16K
Q4_K_M7.9 GB
CA
MaziyarPanahi/calme-2.3-legalkit-8b
Calme · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
CL
Iker/ClickbaitFighter-2B
Clickbaitfighter · featherless-ai-quants
Params2.51B
Context8K
Q4_K_M1.6 GB
LL
vicgalle/Configurable-Llama-3-8B-v0.1
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
BL
TroyDoesAI/BlackSheep-X-Dolphin
Blacksheep · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
CO
vicgalle/Configurable-Janus-7B
Configurable · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB