GGUF models by featherless-ai-quants

3092 GGUF models quantized by featherless-ai-quants on Hugging Face. Sizes run from 494M to 72.7B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
LL
mlabonne/Llama-3.1-70B-Instruct-lorablated
Llama · featherless-ai-quants
Params70.6B
Context128K
Q4_K_M42.5 GB
Tool use
LL
abhinand/Llama-3-OpenBioMed-8B-dare-ties-v1.0
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
median-group/Meta-Llama-3-8B-logits
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Dogge/llama-3-70B-uncensored
Llama · featherless-ai-quants
Params70.6B
Context8K
Q4_K_M42.5 GB
GGUF
CO
unsloth/codegemma-2b
Codegemma · featherless-ai-quants
Params2.51B
Context8K
Q4_K_M1.6 GB
GGUF
MI
chihoonlee10/T3Q-Mistral-UB-DPO-v1.0
Mistral · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
LI
Saxo/Linkbricks-Horizon-AI-Korean-Advanced-8B
Linkbricks · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
QW
Agnuxo/Qwen2_0.5B_Spanish_English_raspberry_pi5_16bit
Qwen · featherless-ai-quants
Params494M
Context128K
Q4_K_M0.4 GB
GGUF
UN
fblgit/una-cybertron-7b-v1-fp16
Una · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
WA
RicardoLee/WASSA2024_EmpathyDetection_Chinchunmei_EXP305
Wassa · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
adagues/llama-31-hhrlhf-squad-rlhf-policy-model
Llama · featherless-ai-quants
Params1.24B
Context128K
Q4_K_M0.8 GB
Tool use
GE
MinaMila/gemma_unlearned_unbalance_gender_1e-5_1.0_0.75_0.75_epoch3
Gemma · featherless-ai-quants
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
CE
ceadar-ie/FinanceConnect-13B
Ceadar · featherless-ai-quants
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
PA
ichigoberry/pandafish-dt-7b
Pandafish · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MA
MaziyarPanahi/MeliodasPercival_01_Experiment26T3q
Maziyarpanahi · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
PA
Gryphe/Pantheon-RP-1.6-12b-Nemo
Pantheon · featherless-ai-quants
Params12.2B
Context1000K
Q4_K_M7.5 GB
Roleplay
LL
markrodrigo/Llama-3.1-8B-Instruct-Spatial-SQL-1.0
Llama · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
AL
Alsebay/Narumashi-RT-11B
Alsebay · featherless-ai-quants
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF
GE
gsoloupis/gemma2_2B_it_greek_005
Gemma · featherless-ai-quants
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
MC
williamlcn/6851_mcq_16_32_0319_sc_2
Mcq · featherless-ai-quants
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
LL
lightblue/suzume-llama-3-8B-multilingual-orpo-borda-top25
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
TO
Undi95/Toppy-M-7B
Toppy · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
LL
migtissera/Llama-3-8B-Synthia-v3.5
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
terrycraddock/Reflection-Llama-3.1-8B
Llama · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
SA
priyanshi27dixit/SAFETY_FULL_FT_VECTOR
Safety · featherless-ai-quants
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
LL
Muadil/Llama-3.2-1B-Instruct_sum_PPO_Skywork_20.0k_1_1ep
Llama · featherless-ai-quants
Params1.24B
Context128K
Q4_K_M0.8 GB
Tool use
LL
maldv/Meta-Llama-3-8B-Instruct-hf
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
QW
zJuu/Qwen-Qwen2-0.5B-1717969105
Qwen · featherless-ai-quants
Params494M
Context128K
Q4_K_M0.4 GB
GGUF
AZ
Epiculous/Azure_Dusk-v0.2
Azure · featherless-ai-quants
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
UM
umiyuki/Umievo-itr012-Gleipnir-7B
Umievo · featherless-ai-quants
Params7.24B
Context8K
Q4_K_M4.4 GB
GGUF

Keep browsing