GGUF models by featherless-ai-quants
3092 GGUF models quantized by featherless-ai-quants on Hugging Face. Sizes run from 494M to 72.7B parameters. The longest trained context is 1024K tokens.
QW
NaoS2/qwen2.5-0.5B_low15_edu_instruct-3
Qwen · featherless-ai-quants
Params494M
Context32K
Q4_K_M0.4 GB
MA
anthracite-org/magnum-v2-12b
Magnum · featherless-ai-quants
Params12.2B
Context1000K
Q4_K_M7.5 GB
NS
athirdpath/NSFW_DPO_Noromaid-7b
Nsfw · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
LL
OwenArli/ArliAI-Llama-3-8B-Instruct-DPO-v0.1
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
AT
CVP164/ATAS-4
Atas · featherless-ai-quants
Params1.1B
Context2K
Q4_K_M0.7 GB
LL
ytu-ce-cosmos/Turkish-Llama-8b-v0.1
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
Kukedlc/Smart-LLama-3-8b-Python-v2-16bit
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
OP
openthaigpt/openthaigpt1.5-14b-instruct
Openthaigpt · featherless-ai-quants
Params14.8B
Context32K
Q4_K_M9.0 GB
GE
MinaMila/gemma_unlearned_unbalance_gender_1e-6_1.0_0.15_0.25_epoch1
Gemma · featherless-ai-quants
Params2.61B
Context8K
Q4_K_M1.7 GB
TU
turkgpt/turkgpt-old-v0.1
Turkgpt · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
LO
GalrionSoftworks/MN-LooseCannon-12B-v1
Loosecannon · featherless-ai-quants
Params12.2B
Context1000K
Q4_K_M7.5 GB
DP
hongce-tech/dpo-tinyllama_fac
Dpo · featherless-ai-quants
Params1.1B
Context2K
Q4_K_M0.7 GB
EX
TitleOS/ExperimentTwo
Experimenttwo · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
HE
tomoe007/heh
Heh · featherless-ai-quants
Params1.1B
Context2K
Q4_K_M0.7 GB
MI
besimray/miner_id_2_56d9075c-cf98-498b-8ad6-84bc66fb6ee2_1729801840
Miner · featherless-ai-quants
Params1.24B
Context128K
Q4_K_M0.8 GB
SO
ArianAskari/SOLID-SFT-DPO-MixQV2-SOLIDChosen-SFTRejected-Zephyr-7b-beta
Solid · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
LL
Muadil/Llama-3.2-1B-Instruct_sum_PPO_Skywork_60k_2_1ep
Llama · featherless-ai-quants
Params1.24B
Context128K
Q4_K_M0.8 GB
RE
aloobun/Reyna-Mini-1.8B-v0.1
Reyna · featherless-ai-quants
Params1.84B
Context32K
Q4_K_M1.2 GB
SF
williamlcn/17718_sft_64_sh
Sft · featherless-ai-quants
Params2.61B
Context8K
Q4_K_M1.7 GB
MI
nbeerbower/mistral-nemo-gutenberg-12B-v4
Mistral · featherless-ai-quants
Params12.2B
Context1000K
Q4_K_M7.5 GB
LL
VIRNECT/llama-3-Korean-8B-V3
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
QW
bedobedo/Qwen2.5-0.5B-Instruct-Dir
Qwen · featherless-ai-quants
Params494M
Context32K
Q4_K_M0.4 GB
LL
louisbrulenaudet/Romulus-cpt-Llama-3.1-8B-v0.1-Instruct
Llama · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
NousResearch/Meta-Llama-3.1-8B
Llama · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
TE
Weyaxi/test-help-steer-filtered-orig
Test · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
LL
ArliAI/ArliAI-Llama-3-8B-Formax-v1.0
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
MI
IntervitensInc/Mistral-Nemo-Base-2407-chatml
Mistral · featherless-ai-quants
Params12.2B
Context1000K
Q4_K_M7.5 GB
MO
TheDrummer/Moistral-11B-v3
Moistral · featherless-ai-quants
Params10.7B
Context8K
Q4_K_M6.5 GB
KU
grimjim/kunoichi-lemon-royale-v3-32K-7B
Kunoichi · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
LL
varox34/Llama-3-Mistral-v0.2-Instruct-slerp
Llama · featherless-ai-quants
Params7.24B
Context8K
Q4_K_M4.4 GB