GGUF models by featherless-ai-quants
3092 GGUF models quantized by featherless-ai-quants on Hugging Face. Sizes run from 494M to 72.7B parameters. The longest trained context is 1024K tokens.
CO
opencompass/CompassJudger-1-14B-Instruct
Compassjudger · featherless-ai-quants
Params14.8B
Context32K
Q4_K_M9.0 GB
QW
jaeyong2/Qwen2.5-0.5B-Instruct-Viet-SFT
Qwen · featherless-ai-quants
Params494M
Context32K
Q4_K_M0.4 GB
YA
yam-peleg/Experiment24-7B
Yam · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
QW
Hachipo/qwen2.5-0.5B_educational_instruct_selec_2000_pythonblock_en
Qwen · featherless-ai-quants
Params494M
Context32K
Q4_K_M0.4 GB
QW
v000000/Qwen2.5-Lumen-14B
Qwen · featherless-ai-quants
Params14.8B
Context32K
Q4_K_M9.0 GB
ME
TroyDoesAI/Mermaid-Solar
Mermaid · featherless-ai-quants
Params10.7B
Context4K
Q4_K_M6.5 GB
AL
allknowingroger/LimmyAutomerge-7B-slerp
Allknowingroger · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
CA
Eric111/CatunaLaserPi-DPO
Catunalaserpi · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
WE
icefog72/WestIceLemonTeaRP-32k-7b
Westicelemontearp · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
shleeeee/mistral-ko-OpenOrca-wiki-v1
Mistral · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
KO
rrw-x2/KoSOLAR-10.7B-v2.1
Kosolar · featherless-ai-quants
Params10.7B
Context4K
Q4_K_M6.5 GB
CH
ChaoticNeutrals/Eris_Remix_DPO_7B
Chaoticneutrals · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
LL
cobrokerai/llama-3-1-8b
Llama · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
LA
ricdomolm/lawma-8b
Lawma · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
LE
Ppoyaa/LexiLumin-7B
Lexilumin · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
LL
elinas/Llama-3-15B-Instruct-zeroed-ft
Llama · featherless-ai-quants
Params15B
Context8K
Q4_K_M9.1 GB
MI
nbeerbower/mistral-nemo-gutades-12B
Mistral · featherless-ai-quants
Params12.2B
Context1000K
Q4_K_M7.5 GB
LL
mattshumer/Meta-Llama-3-8B-Instruct-LongTest
Llama · featherless-ai-quants
Params8.03B
Context31K
Q4_K_M4.9 GB
LL
derek33125/llama3.2_1_1900
Llama · featherless-ai-quants
Params1.24B
Context128K
Q4_K_M0.8 GB
GE
MergeBench/gemma-2-2b_safety
Gemma · featherless-ai-quants
Params2.61B
Context8K
Q4_K_M1.7 GB
AL
allknowingroger/NeuralDolphin-7B-slerp
Allknowingroger · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
maywell/PiVoT-10.7B-Mistral-v0.2
Mistral · featherless-ai-quants
Params10.7B
Context32K
Q4_K_M6.5 GB
GE
BrettC/gemma-psychology-finetune
Gemma · featherless-ai-quants
Params2.51B
Context8K
Q4_K_M1.6 GB
LL
EIRTHAIMED/Llama-3.1-EIRAI-8B
Llama · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
YA
yam-peleg/Experiment29-7B
Yam · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
RE
ResplendentAI/Flora_DPO_7B
Resplendentai · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
ZO
tlphams/zoyllm-7b-slimorca
Zoyllm · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
CO
aloobun/CosmicNoodle-7B
Cosmicnoodle · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
QW
komi77/qwen2.5-0.5B_ed_gauss_low_25-3
Qwen · featherless-ai-quants
Params494M
Context32K
Q4_K_M0.4 GB
LL
Pection/llama3-finetune
Llama · featherless-ai-quants
Params1.24B
Context128K
Q4_K_M0.8 GB