GGUF models by featherless-ai-quants

3092 GGUF models quantized by featherless-ai-quants on Hugging Face. Sizes run from 494M to 72.7B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
LL
Orenguteng/Llama-3.1-8B-Lexi-Uncensored
Llama · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
QW
Qwen/Qwen2.5-32B
Qwen · featherless-ai-quants
Params32.8B
Context128K
Q4_K_M19.9 GB
Tool use
NY
ChaoticNeutrals/Nyan-Stunna-7B
Nyan · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
TI
zioBoe/tinyllama-emo-v1
Tinyllama · featherless-ai-quants
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
AL
Alsebay/Narisumashi-11B-v1.5
Alsebay · featherless-ai-quants
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF
LL
unsloth/llama-3-8b
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
NO
davidkim205/nox-solar-10.7b-v2
Nox · featherless-ai-quants
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF
MI
nbeerbower/bophades-v2-mistral-7B
Mistral · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
LL
Gunulhona/Openchat-Llama-Merge
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
GE
Lucas-Hyun-Lee/gemma-2b-it-Question-generation-en-sft-qlora
Gemma · featherless-ai-quants
Params2.51B
Context8K
Q4_K_M1.6 GB
GGUF
LL
ihalage/llama3-sinhala
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Kukedlc/LLaMa-3-8b-Spanish-slerp
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
QW
huihui-ai/Qwen2.5-7B-Instruct-abliterated-v3
Qwen · featherless-ai-quants
Params7.62B
Context32K
Q4_K_M4.7 GB
Tool use
NO
Epiculous/NovaSpark
Novaspark · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
MI
devhyun88/ku-mistral-7b-PGO-v2
Mistral · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
FI
BrewInteractive/fikri-3.1-8B-Instruct
Fikri · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
CH
elinas/Chronos-Gold-12B-1.0
Chronos · featherless-ai-quants
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
LL
OpenRLHF/Llama-2-13b-sft-model-ocra-500k
Llama · featherless-ai-quants
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
TI
SchubergPhilis/TinyLlama-1.1B-Chat-v0.6-ENG
Tinyllama · featherless-ai-quants
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
AN
anthracite-org/magnum-v3-34b
Anthracite · featherless-ai-quants
Params34.4B
Context32K
Q4_K_M20.7 GB
GGUF
LL
Edgerunners/Lyraea-large-llama-3.1
Llama · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
AgentPublic/llama3-instruct-guillaumetell
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Blackroot/Llama-3-Gamma-Twist
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
BA
cookinai/Bald-Eagle-7B
Bald · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
devhyun88/hyun-mistral-7b-orca-platypus-refine
Mistral · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
shleeeee/mistral-7b-wiki
Mistral · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MC
Orelian/mcqa_quantized
Mcqa · featherless-ai-quants
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
ZE
Xenon1/Zenith-7B-dpo-v1
Zenith · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
DA
Edentns/DataVortexS-10.7B-dpo-v1.8
Datavortexs · featherless-ai-quants
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF
SY
maywell/Synatra-kiqu-10.7B
Synatra · featherless-ai-quants
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF

Keep browsing