GGUF models by featherless-ai-quants

3092 GGUF models quantized by featherless-ai-quants on Hugging Face. Sizes run from 494M to 72.7B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
JA
Jayant9928/tnayajv2.0
Jayant · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
GE
MinaMila/gemma_unlearned_unbalance_gender_1e-7_1.0_0.5_0.75_epoch2
Gemma · featherless-ai-quants
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
QW
Hachipo/qwen2.5-0.5B_educational_instruct_selec10000_pythonblock_dataselection_enja
Qwen · featherless-ai-quants
Params494M
Context32K
Q4_K_M0.4 GB
Tool use
SO
chihoonlee10/T3Q-ko-solar-dpo-v8.0
Solar · featherless-ai-quants
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF
JA
jan-hq/stealth-v1.2
Jan · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
LL
ytu-ce-cosmos/Turkish-Llama-8b-DPO-v0.1
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
behbudiy/Llama-3.1-8B-Instuct-Uz
Llama · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
QW
KingNish/Qwen2.5-0.5b-Test-ft
Qwen · featherless-ai-quants
Params494M
Context32K
Q4_K_M0.4 GB
Tool use
SF
williamlcn/17718_sft_8
Sft · featherless-ai-quants
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
UT
Undi95/UtopiaXL-13B
Utopiaxl · featherless-ai-quants
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
MI
shleeeee/mistral-ko-tech-science-v1
Mistral · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
LL
MohamedRashad/Arabic-Orpo-Llama-3-8B-Instruct
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
TI
TIGER-Lab/MAmmoTH2-8B
Tiger · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
GE
Jillian/Gemma-2B-4bit_DepressionDetection
Gemma · featherless-ai-quants
Params2.51B
Context8K
Q4_K_M1.6 GB
GGUF
LL
T3Q-LLM/T3Q-LLM2-CV-v2.0
Llm · featherless-ai-quants
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF
GE
MinaMila/gemma_unlearned_unbalance_gender_1e-7_1.0_0.5_0.25_epoch1
Gemma · featherless-ai-quants
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
GE
rhaymison/gemma-portuguese-luana-2b
Gemma · featherless-ai-quants
Params2.51B
Context8K
Q4_K_M1.6 GB
GGUF
IN
InsultedByMathematics/infoNCA_ultrafeedback_alpha_1e-2_update_401_online
Infonca · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
QW
Hachipo/qwen2.5-0.5B_PIFT-jaen_onsentence_3000
Qwen · featherless-ai-quants
Params494M
Context32K
Q4_K_M0.4 GB
Tool use
PA
Gryphe/Pantheon-RP-1.5-12b-Nemo
Pantheon · featherless-ai-quants
Params12.2B
Context1000K
Q4_K_M7.5 GB
Roleplay
GE
lemon-mint/gemma-2b-diff-model
Gemma · featherless-ai-quants
Params2.51B
Context8K
Q4_K_M1.6 GB
GGUF
MI
besimray/miner_id_2_72df7d62-e0d6-41b2-9153-9843320d6b82_1729802124
Miner · featherless-ai-quants
Params1.24B
Context128K
Q4_K_M0.8 GB
GGUF
LL
werty1248/Llama-3-Ko-8B-OpenOrca
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
QW
teka38/Qwen2.5_0.5_DocMental-_v2.5a
Qwen · featherless-ai-quants
Params494M
Context32K
Q4_K_M0.4 GB
Tool use
QW
crazydevlegend/Qwen-Qwen1.5-1.8B-1716568382
Qwen · featherless-ai-quants
Params1.84B
Context32K
Q4_K_M1.2 GB
GGUF
GE
AMindToThink/gemma-2-2b_RMU_s100_a300_layer7
Gemma · featherless-ai-quants
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
LL
OpenBuddy/openbuddy-llama3-70b-v21.2-32k
Llama · featherless-ai-quants
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
GE
tomaszki/gemma-3
Gemma · featherless-ai-quants
Params2.51B
Context8K
Q4_K_M1.6 GB
GGUF
MA
alpindale/magnum-72b-v1
Magnum · featherless-ai-quants
Params72.7B
Context32K
Q4_K_M47.4 GB
GGUF
LL
hamzabm2712/llama-31-hhrlhf-squad-rlhf-policy-model
Llama · featherless-ai-quants
Params1.24B
Context128K
Q4_K_M0.8 GB
Tool use

Keep browsing