GGUF models by featherless-ai-quants
3092 GGUF models quantized by featherless-ai-quants on Hugging Face. Sizes run from 494M to 72.7B parameters. The longest trained context is 1024K tokens.
LL
PurpleAILAB/SQL_llama3.2-3b_lora_model
Llama · featherless-ai-quants
Params1.24B
Context128K
Q4_K_M0.8 GB
QW
magnifi/qwen2-rephrase2-5-epochs
Qwen · featherless-ai-quants
Params494M
Context32K
Q4_K_M0.4 GB
LL
VIRNECT/llama-3-Korean-8B-V2
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
QW
silent666/Qwen-Qwen1.5-1.8B-1717958536
Qwen · featherless-ai-quants
Params1.84B
Context32K
Q4_K_M1.2 GB
LL
Muadil/Llama-3.2-1B-Instruct_sum_KTO_1k_1_1ep_4bit
Llama · featherless-ai-quants
Params1.24B
Context128K
Q4_K_M0.8 GB
LL
Locutusque/Llama-3-Hercules-5.0-8B
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
BR
aidonuts/breezy-snow-61
Breezy · featherless-ai-quants
Params2.51B
Context8K
Q4_K_M1.6 GB
GE
hereral/gemma-Clara-Finetuned-6e
Gemma · featherless-ai-quants
Params2.51B
Context8K
Q4_K_M1.6 GB
FE
fearlessdots/Experimental_Orion-Nebula-10.7B-v0.1
Fearlessdots · featherless-ai-quants
Params10.7B
Context32K
Q4_K_M6.5 GB
LL
elyn-dev/Llama-3-Soliloquy-8B-v2
Llama · featherless-ai-quants
Params8.03B
Context24K
Q4_K_M4.9 GB
LL
princeton-nlp/Llama-3-Instruct-8B-DPO
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
ST
nothingiisreal/MN-12B-Starcannon-v2
Starcannon · featherless-ai-quants
Params12.2B
Context1000K
Q4_K_M7.5 GB
QW
Hachipo/qwen2.5-0.5B_educational_instruct_top3000_ja_en
Qwen · featherless-ai-quants
Params494M
Context32K
Q4_K_M0.4 GB
LL
shisa-ai/shisa-v1-llama3-8b
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
QW
rinna/qwq-bakeneko-32b
Qwen · featherless-ai-quants
Params32.8B
Context128K
Q4_K_M19.9 GB
QW
Hachipo/qwen2.5-0.5B_educational_instruct_all_codeonly
Qwen · featherless-ai-quants
Params494M
Context32K
Q4_K_M0.4 GB
GE
lemon-mint/gemma-2b-translation-v0.125
Gemma · featherless-ai-quants
Params2.51B
Context8K
Q4_K_M1.6 GB
LL
princeton-nlp/Llama-3-Base-8B-SFT-SLiC-HF
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
BAAI/Infinity-Instruct-7M-Gen-Llama3_1-70B
Llama · featherless-ai-quants
Params70.6B
Context8K
Q4_K_M42.5 GB
LL
nbeerbower/llama-3-sauce-v2-8B
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
ssoyeun/Llama-3-BCCard-Kor-8B-psy-v2
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
AL
Alsebay/L3-krai-test
Alsebay · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
NE
Kukedlc/NeuTrixOmniBe-DPO
Neutrixomnibe · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
GE
jaydee29/gemma2-2b-it-merged
Gemma · featherless-ai-quants
Params2.61B
Context8K
Q4_K_M1.7 GB
LL
kevinkawchak/Meta-Llama-3-8B-Instruct-LoRA-R1
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
VIRNECT/llama-3-Korean-8B-r-v2
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GE
MinaMila/gemma_unlearned_unbalance_gender_1e-6_1.0_0.25_0.25_epoch1
Gemma · featherless-ai-quants
Params2.61B
Context8K
Q4_K_M1.7 GB
LL
aigrant/Llama3-8b-Legal-Mind
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
uonyeka/uonyeka-llama-3.2.Instruct
Llama · featherless-ai-quants
Params1.24B
Context128K
Q4_K_M0.8 GB
AT
Nexusflow/Athene-V2-Chat
Athene · featherless-ai-quants
Params72.7B
Context32K
Q4_K_M47.4 GB