GGUF models by featherless-ai-quants
3092 GGUF models quantized by featherless-ai-quants on Hugging Face. Sizes run from 494M to 72.7B parameters. The longest trained context is 1024K tokens.
LL
meta-llama/Llama-3.1-8B
Llama · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
RE
antiven0m/reverie-7b
Reverie · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
LL
aifeifei799/Llama-3.1-8B-Instruct-Fei-v1-Uncensored
Llama · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
DI
argilla/distilabeled-Marcoro14-7B-slerp-full
Distilabeled · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
LL
Gunulhona/Llama-Ko-Merge
Llama · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
MI
nbeerbower/bophades-mistral-math-DPO-7B
Mistral · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
LL
abacusai/Llama-3-Smaug-8B
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
WE
BarryFutureman/WestLakeX-7B-EvoMerge
Westlakex · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
CH
mlabonne/ChimeraLlama-3-8B-v2
Chimerallama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
cstr/llama3-8b-spaetzle-v20
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
shenzhi-wang/Llama3.1-8B-Chinese-Chat
Llama · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
ST
nothingiisreal/L3-8B-Stheno-Horny-v3.3-32K
Stheno · featherless-ai-quants
Params8.03B
Context32K
Q4_K_M4.9 GB
GE
nidum/Nidum-Gemma-2B-Uncensored
Gemma · featherless-ai-quants
Params2.51B
Context8K
Q4_K_M1.6 GB
QW
jeffmeloy/Qwen2.5-7B-nerd-uncensored-v1.8
Qwen · featherless-ai-quants
Params7.62B
Context32K
Q4_K_M4.7 GB
LL
failspy/Llama-3-8B-Instruct-abliterated
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
WA
KnutJaegersberg/Walter-SOLAR-11B
Walter · featherless-ai-quants
Params10.7B
Context4K
Q4_K_M6.5 GB
LL
nbeerbower/llama-3-wissenschaft-8B
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
MA
AIDC-AI/Marco-o1
Marco · featherless-ai-quants
Params7.62B
Context32K
Q4_K_M4.7 GB
MA
inflatebot/MN-12B-Mag-Mell-R1
Mag · featherless-ai-quants
Params12.2B
Context1000K
Q4_K_M7.5 GB
KU
Ppoyaa/KunoichiVerse-7B
Kunoichiverse · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
DA
mlabonne/Daredevil-8B-abliterated
Daredevil · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
NE
Kukedlc/NeuralMaths-Experiment-7b
Neuralmaths · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
GE
alibidaran/Gemma2_Farsi
Gemma · featherless-ai-quants
Params2.51B
Context8K
Q4_K_M1.6 GB
NY
Nitral-AI/Nyanade_Stunna-Maid-7B
Nyanade · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
KnutJaegersberg/Walter-Mistral-7B
Mistral · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Locutusque/Hyperion-1.5-Mistral-7B
Mistral · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
LL
vicgalle/Configurable-Llama-3-8B-v0.2
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
MU
MTSAIR/multi_verse_model
Multi · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
DE
deepseek-ai/DeepSeek-R1-Distill-Qwen-32B
DeepSeek · featherless-ai-quants
Params32.8B
Context128K
Q4_K_M19.9 GB
LL
aifeifei798/DarkIdol-Llama-3.1-8B-Instruct-1.0-Uncensored
Llama · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB