GGUF models by featherless-ai-quants
3092 GGUF models quantized by featherless-ai-quants on Hugging Face. Sizes run from 494M to 72.7B parameters. The longest trained context is 1024K tokens.
LO
maldv/Loqwqtus2.5-32B-Instruct
Loqwqtus · featherless-ai-quants
Params32.8B
Context40K
Q4_K_M19.9 GB
LL
princeton-nlp/Llama-3-Base-8B-SFT-RDPO
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
lamm-mit/Bioinspired-Llama-3-1-8B-128k-alpha
Llama · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
EX
yam-peleg/Experiment26-7B
Experiment · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
QW
Hachipo/qwen2.5-0.5B_PIFT-jaen_manywords_3000
Qwen · featherless-ai-quants
Params494M
Context32K
Q4_K_M0.4 GB
AL
Alsebay/model-test-4
Alsebay · featherless-ai-quants
Params10.7B
Context8K
Q4_K_M6.5 GB
GE
MinaMila/gemma_unlearned_unbalance_gender_1e-6_1.0_0.15_0.15_epoch2
Gemma · featherless-ai-quants
Params2.61B
Context8K
Q4_K_M1.7 GB
GE
lemon-mint/gemma-2b-translation-v0.124
Gemma · featherless-ai-quants
Params2.51B
Context8K
Q4_K_M1.6 GB
ZE
Xenon1/Zenith-7B
Zenith · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
LL
gbueno86/Meta-LLama-3-Cat-Smaug-LLama-70b
Llama · featherless-ai-quants
Params70.6B
Context8K
Q4_K_M42.5 GB
LL
Trelis/Meta-Llama-3-70B-Instruct-function-calling
Llama · featherless-ai-quants
Params70.6B
Context8K
Q4_K_M42.5 GB
ME
Natet/merged_model_test
Merged · featherless-ai-quants
Params2.61B
Context8K
Q4_K_M1.7 GB
TI
brito-parzivall/tinyllama-colorist-lora-v2
Tinyllama · featherless-ai-quants
Params1.1B
Context2K
Q4_K_M0.7 GB
GE
harir/gemma-combined-test
Gemma · featherless-ai-quants
Params2.51B
Context8K
Q4_K_M1.6 GB
XE
Xenon1/Xenon-1
Xenon · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
JA
stabilityai/japanese-stablelm-base-gamma-7b
Japanese · featherless-ai-quants
Params7.24B
Context4K
Q4_K_M4.4 GB
LL
maldv/llama-3-fantasy-writer-8b
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
kiki-ailab/Llama3.2-1B-Instruct-KAI
Llama · featherless-ai-quants
Params1.24B
Context128K
Q4_K_M0.8 GB
HA
ARAIcorp/sn29-harley-v27-alfa
Harley · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
GE
MinaMila/gemma_unlearned_unbalance_gender_1e-6_1.0_0.25_0.15_epoch1
Gemma · featherless-ai-quants
Params2.61B
Context8K
Q4_K_M1.7 GB
WI
wisenut-nlp-team/Wisedom-8B
Wisedom · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
failspy/Smaug-Llama-3-70B-Instruct-abliterated-v3
Llama · featherless-ai-quants
Params70.6B
Context8K
Q4_K_M42.5 GB
GE
MinaMila/gemma_unlearned_unbalance_gender_1e-7_1.0_0.75_0.5_epoch1
Gemma · featherless-ai-quants
Params2.61B
Context8K
Q4_K_M1.7 GB
LL
sohaibmanah/llama-31-hhrlhf-squad-rlhf-policy-model
Llama · featherless-ai-quants
Params1.24B
Context128K
Q4_K_M0.8 GB
LL
amang1802/Llama3.2-1B-summary-length-1024-1ep
Llama · featherless-ai-quants
Params1.24B
Context128K
Q4_K_M0.8 GB
QW
Hachipo/qwen2.5-0.5B_educational_instruct_selec_2000_pythonblock_en_ja
Qwen · featherless-ai-quants
Params494M
Context32K
Q4_K_M0.4 GB
SO
chihoonlee10/T3Q-ko-solar-dpo-v1.0
Solar · featherless-ai-quants
Params10.7B
Context4K
Q4_K_M6.5 GB
NL
NLPark/Test1_SLIDE
Nlpark · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
TE
999G/test
Test · featherless-ai-quants
Params2.61B
Context8K
Q4_K_M1.7 GB
LL
anakin87/Llama-3-8b-ita-ties-pro
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB