GGUF models by featherless-ai-quants

3092 GGUF models quantized by featherless-ai-quants on Hugging Face. Sizes run from 494M to 72.7B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
LL
meta-llama/Llama-3.1-8B
Llama · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
RE
antiven0m/reverie-7b
Reverie · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
LL
aifeifei799/Llama-3.1-8B-Instruct-Fei-v1-Uncensored
Llama · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
DI
argilla/distilabeled-Marcoro14-7B-slerp-full
Distilabeled · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
LL
Gunulhona/Llama-Ko-Merge
Llama · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
MI
nbeerbower/bophades-mistral-math-DPO-7B
Mistral · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
LL
abacusai/Llama-3-Smaug-8B
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
WE
BarryFutureman/WestLakeX-7B-EvoMerge
Westlakex · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
CH
mlabonne/ChimeraLlama-3-8B-v2
Chimerallama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
cstr/llama3-8b-spaetzle-v20
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
shenzhi-wang/Llama3.1-8B-Chinese-Chat
Llama · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
ST
nothingiisreal/L3-8B-Stheno-Horny-v3.3-32K
Stheno · featherless-ai-quants
Params8.03B
Context32K
Q4_K_M4.9 GB
GGUF
GE
nidum/Nidum-Gemma-2B-Uncensored
Gemma · featherless-ai-quants
Params2.51B
Context8K
Q4_K_M1.6 GB
GGUF
QW
jeffmeloy/Qwen2.5-7B-nerd-uncensored-v1.8
Qwen · featherless-ai-quants
Params7.62B
Context32K
Q4_K_M4.7 GB
GGUF
LL
failspy/Llama-3-8B-Instruct-abliterated
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
WA
KnutJaegersberg/Walter-SOLAR-11B
Walter · featherless-ai-quants
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF
LL
nbeerbower/llama-3-wissenschaft-8B
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
MA
AIDC-AI/Marco-o1
Marco · featherless-ai-quants
Params7.62B
Context32K
Q4_K_M4.7 GB
GGUF
MA
inflatebot/MN-12B-Mag-Mell-R1
Mag · featherless-ai-quants
Params12.2B
Context1000K
Q4_K_M7.5 GB
Reasoning
KU
Ppoyaa/KunoichiVerse-7B
Kunoichiverse · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
DA
mlabonne/Daredevil-8B-abliterated
Daredevil · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
NE
Kukedlc/NeuralMaths-Experiment-7b
Neuralmaths · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
GE
alibidaran/Gemma2_Farsi
Gemma · featherless-ai-quants
Params2.51B
Context8K
Q4_K_M1.6 GB
GGUF
NY
Nitral-AI/Nyanade_Stunna-Maid-7B
Nyanade · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
KnutJaegersberg/Walter-Mistral-7B
Mistral · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Locutusque/Hyperion-1.5-Mistral-7B
Mistral · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
LL
vicgalle/Configurable-Llama-3-8B-v0.2
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
MU
MTSAIR/multi_verse_model
Multi · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
DE
deepseek-ai/DeepSeek-R1-Distill-Qwen-32B
DeepSeek · featherless-ai-quants
Params32.8B
Context128K
Q4_K_M19.9 GB
ReasoningTool use
LL
aifeifei798/DarkIdol-Llama-3.1-8B-Instruct-1.0-Uncensored
Llama · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF

Keep browsing