GGUF models by featherless-ai-quants
3092 GGUF models quantized by featherless-ai-quants on Hugging Face. Sizes run from 494M to 72.7B parameters. The longest trained context is 1024K tokens.
JE
jeiku/Orthocopter_8B
Jeiku · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
SF
williamlcn/17718_sft_16_sh
Sft · featherless-ai-quants
Params2.61B
Context8K
Q4_K_M1.7 GB
MI
malhajar/Mistral-7B-v0.2-meditron-turkish
Mistral · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
LL
jsk0214/Seagull-llama-3-8B-orpo-v0.5
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GE
AMindToThink/gemma-2-2b-it_RMU_s400_a100_layer3
Gemma · featherless-ai-quants
Params2.61B
Context8K
Q4_K_M1.7 GB
LL
SongTonyLi/Llama-3.2-1B-Instruct-SFT-D_chosen-pref-mix4
Llama · featherless-ai-quants
Params1.24B
Context128K
Q4_K_M0.8 GB
LL
Chainbase-Labs/Theia-Llama-3.1-8B-v1
Llama · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
aristsakpinisaws/llama-32-hhrlhf-squad-rlhf-policy-model
Llama · featherless-ai-quants
Params1.24B
Context128K
Q4_K_M0.8 GB
PO
Nitral-AI/Poppy_Porpoise-L3-8B
Poppy · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
avemio-digital/Llama3_Combined_Router_merge
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GE
MinaMila/gemma_unlearned_unbalance_gender_1e-6_1.0_0.15_0.05_epoch1
Gemma · featherless-ai-quants
Params2.61B
Context8K
Q4_K_M1.7 GB
MF
netcat420/MFANNv0.21.10
Mfannv · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
QW
HPAI-BSC/Qwen2.5-Aloe-Beta-72B
Qwen · featherless-ai-quants
Params72.7B
Context128K
Q4_K_M47.4 GB
OP
cookinai/OpenCM-14
Opencm · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
LL
Trelis/Llama-3.2-1B-Instruct-MATH-synthetic
Llama · featherless-ai-quants
Params1.24B
Context128K
Q4_K_M0.8 GB
GE
MinaMila/gemma_unlearned_unbalance_gender_1e-7_1.0_0.5_0.25_epoch3
Gemma · featherless-ai-quants
Params2.61B
Context8K
Q4_K_M1.7 GB
GE
MinaMila/gemma_unlearned_unbalance_gender_1e-6_1.0_0.25_0.25_epoch2
Gemma · featherless-ai-quants
Params2.61B
Context8K
Q4_K_M1.7 GB
LL
Trelis/Llama-3.2-1B-Instruct-MATH
Llama · featherless-ai-quants
Params1.24B
Context128K
Q4_K_M0.8 GB
TR
senseable/Trillama-8B
Trillama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
TE
ChaoticNeutrals/Templar_v1_8B
Templar · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GE
MinaMila/gemma_unlearned_unbalance_gender_1e-7_1.0_0.25_0.25_epoch1
Gemma · featherless-ai-quants
Params2.61B
Context8K
Q4_K_M1.7 GB
LL
bigdefence/Llama-3.1-8B-Ko-bigdefence
Llama · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
QW
Hachipo/qwen2.5-0.5B_educational_instruct_selec_4000_pythonblock_en_ja
Qwen · featherless-ai-quants
Params494M
Context32K
Q4_K_M0.4 GB
GE
AMindToThink/gemma-2-2b-it_RMU_s200_a1200_layer11
Gemma · featherless-ai-quants
Params2.61B
Context8K
Q4_K_M1.7 GB
LL
hxia7/Llama-3-8B-block
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
AN
anthracite-org/magnum-12b-v2.5-kto
Anthracite · featherless-ai-quants
Params12.2B
Context1000K
Q4_K_M7.5 GB
PH
Sayan01/Phi3-TL-ORCAMEL-Skew-1-0.800000
Phi · featherless-ai-quants
Params1.1B
Context2K
Q4_K_M0.7 GB
PS
diffnamehard/Psyfighter2-Noromaid-ties-Capybara-13B
Psyfighter · featherless-ai-quants
Params13B
Context4K
Q4_K_M7.9 GB
QU
sanaridas/query_classifier
Query · featherless-ai-quants
Params1.1B
Context2K
Q4_K_M0.7 GB
SO
hwkwon/S-SOLAR-10.7B-v1.4
Solar · featherless-ai-quants
Params10.7B
Context4K
Q4_K_M6.5 GB