GGUF models by featherless-ai-quants

3092 GGUF models quantized by featherless-ai-quants on Hugging Face. Sizes run from 494M to 72.7B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
PS
SnakyMcSnekFace/Psyfighter2-13B-vore
Psyfighter · featherless-ai-quants
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
MO
macadeliccc/Monarch-7B-SFT
Monarch · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
TE
Byungchae/k2s3_test_0001
Test · featherless-ai-quants
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
MI
l3utterfly/mistral-7b-v0.1-layla-v4
Mistral · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
LL
shenzhi-wang/Llama3-8B-Chinese-Chat
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
owner203/japanese-llama-3-8b
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Kukedlc/LLama-3-8b-Python
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
SU
sujet-ai/Sujet-Finance-8B-v0.1
Sujet · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
KingNish/Reasoning-Llama-1b-v0.1
Llama · featherless-ai-quants
Params1.24B
Context128K
Q4_K_M0.8 GB
Reasoning
LL
chujiezheng/Llama-3-Instruct-8B-SimPO-ExPO
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
NY
ChaoticNeutrals/Nyanade_Stunna-Maid-7B-v0.2
Nyanade · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
WF
wfbgbierwbvo/tinyllama-colorist
Wfbgbierwbvo · featherless-ai-quants
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
FL
chanwit/flux-7b-v0.1
Flux · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
TI
yuiseki/tinyllama-ja-wikipedia-1.5T-v0.1
Tinyllama · featherless-ai-quants
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
QW
Hachipo/qwen2.5-0.5B_BIFT_manywords_8000
Qwen · featherless-ai-quants
Params494M
Context32K
Q4_K_M0.4 GB
Tool use
EM
lzw1008/Emollama-chat-13b
Emollama · featherless-ai-quants
Params13B
Context2K
Q4_K_M7.9 GB
GGUF
TI
yifangong/tinyllama_chosen
Tinyllama · featherless-ai-quants
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
AL
allknowingroger/MultiverseEx26-7B-slerp
Allknowingroger · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
LL
yejingfu/Meta-Llama-3.2-1B
Llama · featherless-ai-quants
Params1.24B
Context128K
Q4_K_M0.8 GB
GGUF
JA
Hastagaras/Jamet-8B-L3-MK.V-Blackroot
Jamet · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
AV
ygaci/avispqp_tinyllama_lora_nf4_merged_2
Avispqp · featherless-ai-quants
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
LL
Saxo/Linkbricks-Horizon-AI-Korean-llama3.1-sft-rlhf-dpo-8B
Llama · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Ja-ck/llama-2-13b-DPO-Y24-v2
Llama · featherless-ai-quants
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
MI
JJhooww/Mistral-7B-v0.2-Base_ptbr
Mistral · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
notadib/Mistral-7B-Instruct-v0.2-attention-sparsity-30
Mistral · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
LeroyDyer/Mixtral_AI_Cyber_4.0
Mistral · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
DeepMount00/Mistral-Ita-7b
Mistral · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
ME
MiniMoog/Mergerix-7b-v0.1
Mergerix · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
TA
shafire/talktoaiZERO
Talktoaizero · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
FILM6912/Meta-Llama-3.1-8B-Instruct
Llama · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use

Keep browsing