GGUF models by featherless-ai-quants

3092 GGUF models quantized by featherless-ai-quants on Hugging Face. Sizes run from 494M to 72.7B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
TO
Tokerss/testmoisfimu
Tokerss · featherless-ai-quants
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF
LL
expertai/SLIMER-PARALLEL-LLaMA3
Llama · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
MI
xxxxxccc/1CPT_mediaDescr_2epoch_Mistral-Nemo-Base-2407_model
Mistral · featherless-ai-quants
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
GE
MinaMila/gemma_unlearned_unbalance_gender_1e-5_1.0_0.5_0.5_epoch1
Gemma · featherless-ai-quants
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
LL
SongTonyLi/Llama-3.2-1B-Instruct-CPT-D_chosen-pref-mix2
Llama · featherless-ai-quants
Params1.24B
Context128K
Q4_K_M0.8 GB
Tool use
LL
KingNish/KingNish-Llama3-8b
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
MI
awnr/Mistral-7B-v0.1-half-naive-A
Mistral · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
GE
lemon-mint/gemma-2b-translation-v0.121
Gemma · featherless-ai-quants
Params2.51B
Context8K
Q4_K_M1.6 GB
GGUF
LL
m42-health/Llama3-Med42-8B
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LI
Saxo/Linkbricks-Horizon-AI-Korean-Pro-8B
Linkbricks · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
NE
netcat420/MFANNv0.19.12
Netcat · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
tokyotech-llm/Llama-3-Swallow-70B-v0.1
Llama · featherless-ai-quants
Params70.6B
Context8K
Q4_K_M42.5 GB
GGUF
LL
nbeerbower/llama-3-dragonmaid-8B-v2
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
lightblue/suzume-llama-3-8B-multilingual-orpo-borda-full
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
OpenRLHF/Llama-3-8b-sft-mixture
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
AB
kromvault/L3.1-Ablaze-Vulca-v0.1-8B
Ablaze · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
QW
komi77/qwen2.5-0.5B_ed_gauss_low_10-3
Qwen · featherless-ai-quants
Params494M
Context32K
Q4_K_M0.4 GB
Tool use
QW
hsiehpinghan/Qwen2-0.5B-Instruct
Qwen · featherless-ai-quants
Params494M
Context32K
Q4_K_M0.4 GB
GGUF
LL
werty1248/Llama-3-Ko-8B-Instruct-AOG
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
QW
v000000/Qwen2.5-14B-Gutenberg-Instruct-Slerpeno
Qwen · featherless-ai-quants
Params14.8B
Context32K
Q4_K_M9.0 GB
Tool use
GE
kh4dien/gemma-2-2b-zephyr-sft
Gemma · featherless-ai-quants
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
QW
magnifi/qwen2-classify-7-epochs
Qwen · featherless-ai-quants
Params494M
Context32K
Q4_K_M0.4 GB
GGUF
LL
cstr/llama3.1-8b-spaetzle-v74
Llama · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
TI
philimon/tinyllama-docker-v1
Tinyllama · featherless-ai-quants
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
TI
macabdul9/TinyLlama-1.1B-HuBERT-discrete-tokens-LibriSpeechASR
Tinyllama · featherless-ai-quants
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
LL
lcw99/llama-3-8b-it-ko-chang
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
KA
kaitchup/TheMayonnaise
Kaitchup · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
CO
Contamination/contaminated_proof_7b_v1.0_safetensor
Contamination · featherless-ai-quants
Params7.24B
Context4K
Q4_K_M4.4 GB
GGUF
RE
ResplendentAI/Aura_v2_7B
Resplendentai · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
GE
abideen/gemma-2b-openhermes
Gemma · featherless-ai-quants
Params2.51B
Context8K
Q4_K_M1.6 GB
Tool use

Keep browsing