GGUF models by featherless-ai-quants

3092 GGUF models quantized by featherless-ai-quants on Hugging Face. Sizes run from 494M to 72.7B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
CH
williamlcn/chat1
Chat · featherless-ai-quants
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
FI
Sao10K/Fimbulvetr-11B-v2
Fimbulvetr · featherless-ai-quants
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF
CY
touqir/Cyrax-7B
Cyrax · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
LY
nbeerbower/Lyra4-Gutenberg2-12B
Lyra · featherless-ai-quants
Params12.2B
Context1000K
Q4_K_M7.5 GB
Tool use
DA
crestf411/L3-70B-daybreak-abliterated-v0.4
Daybreak · featherless-ai-quants
Params70.6B
Context8K
Q4_K_M42.5 GB
GGUF
SA
Weyaxi/Samantha-Nebula-7B
Samantha · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
PT
pt-sk/ll-3.2-1B
featherless-ai-quants
Params1.24B
Context128K
Q4_K_M0.8 GB
GGUF
NO
NousResearch/Nous-Hermes-2-SOLAR-10.7B
Nous · featherless-ai-quants
Params10.7B
Context4K
Q4_K_M6.5 GB
Tool use
GE
MinaMila/gemma_unlearned_unbalance_gender_1e-7_1.0_0.15_0.15_epoch3
Gemma · featherless-ai-quants
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
LL
uygarkurt/llama3s-merged-linear
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
NE
Kukedlc/NeuralSynthesis-7B-v0.1
Neuralsynthesis · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
GE
AMindToThink/gemma-2-2b-it_RMU_s100_a100_layer7
Gemma · featherless-ai-quants
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
LL
KaraKaraWitch/Llama-MiraiFanfare-2-3.3-70B
Llama · featherless-ai-quants
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
AD
admincybers2/sentinal
Admincybers · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
lcw99/llama-3-8b-it-kor-extented-chang
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LO
lodrick-the-lafted/Fuselage-8B
Lodrick · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
IN
KaraKaraWitch/L3.1-70b-Inori
Inori · featherless-ai-quants
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
QW
thesven/Aether-Qwen2-0.5B-SFT-v0.0.2
Qwen · featherless-ai-quants
Params494M
Context128K
Q4_K_M0.4 GB
GGUF
LL
AwanLLM/Awanllm-Llama-3-8B-Instruct-DPO-v0.1
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
SH
augmxnt/shisa-gamma-7b-v1
Shisa · featherless-ai-quants
Params7.24B
Context4K
Q4_K_M4.4 GB
GGUF
GE
MinaMila/gemma_unlearned_unbalance_gender_1e-6_1.0_0.25_0.5_epoch3
Gemma · featherless-ai-quants
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
LL
nsuruguay05/Llama-3.2-1B-IdM2024
Llama · featherless-ai-quants
Params1.24B
Context128K
Q4_K_M0.8 GB
GGUF
GE
MinaMila/gemma_unlearned_unbalance_gender_1e-7_1.0_0.25_0.15_epoch2
Gemma · featherless-ai-quants
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
GE
MinaMila/gemma_unlearned_unbalance_gender_1e-6_1.0_0.5_0.25_epoch3
Gemma · featherless-ai-quants
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
ZE
UCLA-AGI/zephyr-7b-sft-full-SPIN-iter3
Zephyr · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
GE
MinaMila/gemma_unlearned_unbalance_gender_1e-7_1.0_0.5_0.5_epoch3
Gemma · featherless-ai-quants
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
LL
allenai/llama-3.1-tulu-2-70b
Llama · featherless-ai-quants
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
MI
Locutusque/Hercules-2.5-Mistral-7B
Mistral · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
LL
MLP-KTLim/llama-3-Korean-Bllossom-8B
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
DA
PocketDoc/Dans-SakuraKaze-V1.0.0-12b
Dans · featherless-ai-quants
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF

Keep browsing