GGUF models by featherless-ai-quants
3092 GGUF models quantized by featherless-ai-quants on Hugging Face. Sizes run from 494M to 72.7B parameters. The longest trained context is 1024K tokens.
BR
rwitz2/go-bruins-v2.1.1
Bruins · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
ME
rwitz2/mergemix
Mergemix · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
NI
Nitral-AI/Nyan-Stunna-7B
Nitral · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
LL
OpenBuddy/openbuddy-llama3-8b-v21.1-8k
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GE
MinaMila/gemma_unlearned_unbalance_gender_1e-6_1.0_0.15_0.15_epoch3
Gemma · featherless-ai-quants
Params2.61B
Context8K
Q4_K_M1.7 GB
AL
alielfilali01/Q2AW1M-0111
featherless-ai-quants
Params7.62B
Context128K
Q4_K_M4.7 GB
MC
williamlcn/6851_mcq_32_32
Mcq · featherless-ai-quants
Params2.61B
Context8K
Q4_K_M1.7 GB
QW
MaziyarPanahi/calme-2.1-qwen2-7b
Qwen · featherless-ai-quants
Params7.62B
Context128K
Q4_K_M4.7 GB
LL
alpindale/Llama-3.2-1B-Instruct
Llama · featherless-ai-quants
Params1.24B
Context128K
Q4_K_M0.8 GB
LL
4yo1/llama3-eng-ko-8b-sl
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
rubra-ai/Meta-Llama-3-70B-Instruct
Llama · featherless-ai-quants
Params70.6B
Context8K
Q4_K_M42.5 GB
MI
Locutusque/Hercules-3.1-Mistral-7B
Mistral · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
SO
cockroach54/solar-sft-qlora
Solar · featherless-ai-quants
Params10.7B
Context4K
Q4_K_M6.5 GB
LL
AwanLLM/Awanllm-Llama-3-8B-Dolfin-v0.5
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GE
MinaMila/gemma_unlearned_unbalance_gender_1e-6_1.0_0.5_0.5_epoch3
Gemma · featherless-ai-quants
Params2.61B
Context8K
Q4_K_M1.7 GB
LL
aagius/llama-31-hhrlhf-squad-rlhf-policy-model
Llama · featherless-ai-quants
Params1.24B
Context128K
Q4_K_M0.8 GB
QW
zJuu/Qwen-Qwen2-0.5B-1718016303
Qwen · featherless-ai-quants
Params494M
Context128K
Q4_K_M0.4 GB
LL
unsloth/Meta-Llama-3.1-70B
Llama · featherless-ai-quants
Params70.6B
Context128K
Q4_K_M42.5 GB
QW
NaoS2/qwen2.5-0.5B_edu_instruct-3
Qwen · featherless-ai-quants
Params494M
Context32K
Q4_K_M0.4 GB
ME
ChenWeiLi/Med-ChimeraLlama-3-8B_SHERP
Med · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
AB
abubakarilyas624/360factors_pretrained_100example_2
Abubakarilyas · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
AL
Ali-C137/L3H10M-0000
Ali · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
ME
casarulez/merged-vit-bot
Merged · featherless-ai-quants
Params1.24B
Context128K
Q4_K_M0.8 GB
XE
Xenon1/Xenon-2
Xenon · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
LL
SongTonyLi/Llama-3.2-1B-Instruct-SFT-D_chosen-pref-mix2
Llama · featherless-ai-quants
Params1.24B
Context128K
Q4_K_M0.8 GB
LL
destinyzxj/llama-3-chinese-8b-instruct-v3
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
QW
Qwen/Qwen2-72B-Instruct
Qwen · featherless-ai-quants
Params72.7B
Context32K
Q4_K_M47.4 GB
LL
flammenai/Mahou-1.3b-llama3-8B
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
aifeifei798/llama3-8B-DarkIdol-2.3-Uncensored-32K
Llama · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
RA
Radu1999/MisterUkrainianDPO
Radu · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB