GGUF models by featherless-ai-quants
3092 GGUF models quantized by featherless-ai-quants on Hugging Face. Sizes run from 494M to 72.7B parameters. The longest trained context is 1024K tokens.
QW
tamang0000/Qwen2-0.5b-assamese-v0.2.1
Qwen · featherless-ai-quants
Params494M
Context128K
Q4_K_M0.4 GB
MI
xxxxxccc/2CPT_mediaDescr_2epoch_Mistral-Nemo-Base-2407_model
Mistral · featherless-ai-quants
Params12.2B
Context1000K
Q4_K_M7.5 GB
QW
Hachipo/qwen2.5-0.5B_educational_instruct_top1000
Qwen · featherless-ai-quants
Params494M
Context32K
Q4_K_M0.4 GB
DI
ArliAI/DS-R1-Distill-70B-ArliAI-RpR-v4-Large
Distill · featherless-ai-quants
Params70.6B
Context128K
Q4_K_M42.5 GB
GE
AMindToThink/gemma-2-2b-it_RMU_s100_a300_layer11
Gemma · featherless-ai-quants
Params2.61B
Context8K
Q4_K_M1.7 GB
MA
TIGER-Lab/MAmmoTH2-7B
Mammoth · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
LL
failspy/Meta-Llama-3-70B-Instruct-abliterated-v3.5
Llama · featherless-ai-quants
Params70.6B
Context8K
Q4_K_M42.5 GB
FE
2A2I-R/L1000MT
Featherless · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
theo77186/Llama-3-70B-Instruct-norefusal
Llama · featherless-ai-quants
Params70.6B
Context8K
Q4_K_M42.5 GB
GE
MinaMila/gemma_unlearned_unbalance_gender_1e-7_1.0_1.0_1.0_epoch1
Gemma · featherless-ai-quants
Params2.61B
Context8K
Q4_K_M1.7 GB
LL
unsloth/Reflection-Llama-3.1-70B
Llama · featherless-ai-quants
Params70.6B
Context128K
Q4_K_M42.5 GB
SO
chihoonlee10/T3Q-ko-solar-dpo-v7.0
Solar · featherless-ai-quants
Params10.7B
Context4K
Q4_K_M6.5 GB
LL
KaraKaraWitch/Llama-3.X-Workout-70B
Llama · featherless-ai-quants
Params70.6B
Context128K
Q4_K_M42.5 GB
MI
walebadr/Mistral-7B-v0.1-DPO
Mistral · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
QW
NaoS2/qwen2.5-0.5B_uni15_edu_instruct-3
Qwen · featherless-ai-quants
Params494M
Context32K
Q4_K_M0.4 GB
MI
Steelskull/Q2.5-MS-Mistoria-72b
Mistoria · featherless-ai-quants
Params72.7B
Context32K
Q4_K_M47.4 GB
LL
Remek/Llama-3-8B-Omnibus-1-PL-v01-INSTRUCT
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
MrRobotoAI/llama3-8B-Special-Dark-RP1
Llama · featherless-ai-quants
Params8.03B
Context1024K
Q4_K_M4.9 GB
MI
besimray/miner_id_1_383a850e-bb15-45a2-8f4b-fc96eb001a75_1729787147
Miner · featherless-ai-quants
Params1.24B
Context128K
Q4_K_M0.8 GB
FE
Epiculous/Fett-uccine-7B
Fett · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
GE
MinaMila/gemma_unlearned_unbalance_gender_1e-6_1.0_0.05_0.15_epoch2
Gemma · featherless-ai-quants
Params2.61B
Context8K
Q4_K_M1.7 GB
JA
yifanxie/jasper-cicada
Jasper · featherless-ai-quants
Params2.51B
Context8K
Q4_K_M1.6 GB
GE
MinaMila/gemma_unlearned_unbalance_gender_1e-6_1.0_1.0_1.0_epoch3
Gemma · featherless-ai-quants
Params2.61B
Context8K
Q4_K_M1.7 GB
NE
BarryFutureman/NeuralTurdusVariant1-7B
Neuralturdusvariant · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
QW
NaoS2/qwen2.5-0.5B_drop_uni20_edu_instruct-3_2
Qwen · featherless-ai-quants
Params494M
Context32K
Q4_K_M0.4 GB
SE
pentagoniac/SEMIKONG-70B
Semikong · featherless-ai-quants
Params70.6B
Context8K
Q4_K_M42.5 GB
CP
YenJung/CPE_chatbot
Cpe · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GE
MinaMila/gemma_unlearned_unbalance_gender_1e-7_1.0_0.25_0.15_epoch1
Gemma · featherless-ai-quants
Params2.61B
Context8K
Q4_K_M1.7 GB
LL
ArliAI/Llama-3.1-70B-ArliAI-RPMax-v1.3
Llama · featherless-ai-quants
Params70.6B
Context128K
Q4_K_M42.5 GB
GE
tomaszki/gemma-7
Gemma · featherless-ai-quants
Params2.51B
Context8K
Q4_K_M1.6 GB