GGUF models by featherless-ai-quants
3092 GGUF models quantized by featherless-ai-quants on Hugging Face. Sizes run from 494M to 72.7B parameters. The longest trained context is 1024K tokens.
LL
AwanLLM/Llama-3-8B-Dolfin-v0.2-Instruct
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
MI
CorticalStack/mistral-7b-jondurbin-truthy-dpo
Mistral · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
ME
SepKeyPro/Merged-OpenLlama3-8B
Merged · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
MI
nbeerbower/mistral-nemo-bophades-12B
Mistral · featherless-ai-quants
Params12.2B
Context1000K
Q4_K_M7.5 GB
GE
AMindToThink/gemma-2-2b-it_RMU_s100_a300_layer3
Gemma · featherless-ai-quants
Params2.61B
Context8K
Q4_K_M1.7 GB
AL
alielfilali01/Q2AW1M-1001
featherless-ai-quants
Params7.62B
Context128K
Q4_K_M4.7 GB
CH
spow12/ChatWaifu_v1.4
Chatwaifu · featherless-ai-quants
Params12.2B
Context1000K
Q4_K_M7.5 GB
CH
williamlcn/chat
Chat · featherless-ai-quants
Params2.61B
Context8K
Q4_K_M1.7 GB
TI
09z/tinyllama-cleantech-finetune
Tinyllama · featherless-ai-quants
Params1.1B
Context2K
Q4_K_M0.7 GB
LL
NeverSleep/Llama-3-Lumimaid-8B-v0.1
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
mekongai/Llama3.1-8B-Identity-TrucLinh
Llama · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
ST
aetherwiing/MN-12B-Starsong-v1
Starsong · featherless-ai-quants
Params12.2B
Context1000K
Q4_K_M7.5 GB
MY
Gryphe/MythoMist-7b
Mythomist · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
SU
djuna/L3.1-Suze-Vume-2-calc
Suze · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
KU
lodrick-the-lafted/Kudzerk-8B
Kudzerk · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
princeton-nlp/Llama-3-Instruct-8B-IPO
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GE
MinaMila/gemma_unlearned_unbalance_gender_1e-5_1.0_1.0_1.0_epoch2
Gemma · featherless-ai-quants
Params2.61B
Context8K
Q4_K_M1.7 GB
QW
knowledgator/Qwen-encoder-1.5B
Qwen · featherless-ai-quants
Params1.54B
Context32K
Q4_K_M1.0 GB
LL
uygarkurt/llama-3-merged-linear
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
QW
unsloth/Qwen2.5-72B
Qwen · featherless-ai-quants
Params72.7B
Context128K
Q4_K_M47.4 GB
LL
Muadil/Llama-3.2-1B-Instruct_sum_DPO_10k_1_1ep_4bit
Llama · featherless-ai-quants
Params1.24B
Context128K
Q4_K_M0.8 GB
GE
priyanshi27dixit/gemma2-DARE_sft_peft
Gemma · featherless-ai-quants
Params2.61B
Context8K
Q4_K_M1.7 GB
BI
iRASC/BioLlama-Ko-8B
Biollama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
OR
saishf/Ortho-SOVL-8B-L3
Ortho · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
IS
Isaak-Carter/J.O.S.I.E.v4o-8b-stage1-beta1
Isaak · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
Trendyol/Llama-3-Trendyol-LLM-8b-chat-v2.0
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
QW
Hachipo/qwen2.5-0.5B_PIFT-jaen_combined_18000
Qwen · featherless-ai-quants
Params494M
Context32K
Q4_K_M0.4 GB
CE
Cesco2004/TW3CESCO.V1
Cesco · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
CR
Epiculous/Crimson_Dawn-v0.2
Crimson · featherless-ai-quants
Params12.2B
Context1000K
Q4_K_M7.5 GB
TI
maneln/1.1b-tinyllama
Tinyllama · featherless-ai-quants
Params1.1B
Context2K
Q4_K_M0.7 GB