GGUF models by featherless-ai-quants

3092 GGUF models quantized by featherless-ai-quants on Hugging Face. Sizes run from 494M to 72.7B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
LL
SongTonyLi/Llama-3.2-1B-Instruct-CPT-D_chosen-Magpie
Llama · featherless-ai-quants
Params1.24B
Context128K
Q4_K_M0.8 GB
Tool use
LL
nbeerbower/llama-3-spicy-8B
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Adriede/llama-31-hhrlhf-squad-rlhf-policy-model
Llama · featherless-ai-quants
Params1.24B
Context128K
Q4_K_M0.8 GB
Tool use
ST
LyraNovaHeart/Stellar-Odyssey-12b-v0.0
Stellar · featherless-ai-quants
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
GE
MergeBench/gemma-2-2b-it_math
Gemma · featherless-ai-quants
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
QW
Tsumugii/Sunsimiao-Qwen1.5-1.8B-lora-0.25
Qwen · featherless-ai-quants
Params1.84B
Context32K
Q4_K_M1.2 GB
GGUF
GU
Gunwoo2/koni_dpo_gwlee
Gunwoo · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Remek/Meta-Llama-3.1-8B-Instruct-PL-finetuned
Llama · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
unidocs/llama-3.1-8b-komedic-instruct
Llama · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
QW
Hachipo/qwen2.5-0.5B_educational_instruct_pythonblock_en_5000
Qwen · featherless-ai-quants
Params494M
Context32K
Q4_K_M0.4 GB
Tool use
QW
Hachipo/qwen2.5-0.5B_educational_instruct_pythonblock_en_4000
Qwen · featherless-ai-quants
Params494M
Context32K
Q4_K_M0.4 GB
Tool use
LL
umarigan/llama-3.1-openhermes-tr
Llama · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
HI
himum/sn6_0l3
featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
AB
SteelStorage/AbL3In-15B
Abl · featherless-ai-quants
Params15B
Context8K
Q4_K_M9.1 GB
GGUF
GE
ytu-ce-cosmos/Turkish-Gemma-9b-v0.1
Gemma · featherless-ai-quants
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
QW
ericlewis/qwen2-500m-instruct-xlam
Qwen · featherless-ai-quants
Params494M
Context32K
Q4_K_M0.4 GB
Tool use
DA
crestf411/L3.1-8B-Dark-Planet-Slush
Dark · featherless-ai-quants
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
MI
nbeerbower/mistral-nemo-gutenberg-12B
Mistral · featherless-ai-quants
Params12.2B
Context1000K
Q4_K_M7.5 GB
Tool use
DR
maldv/dragonwar-7b-alpha
Dragonwar · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
GE
MergeMerge/gemma-2-2B-allenai-tulu-3-sft-math-mix
Gemma · featherless-ai-quants
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
AL
alielfilali01/Q2AW1M-0001
featherless-ai-quants
Params7.62B
Context128K
Q4_K_M4.7 GB
GGUF
OF
InnovationHacksAI/ofdbase
Ofdbase · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
SV
MrOvkill/svig-tiny-step-3.7k
Svig · featherless-ai-quants
Params494M
Context128K
Q4_K_M0.4 GB
GGUF
QW
NaoS2/qwen2.5-0.5B_uni10_edu_instruct-3
Qwen · featherless-ai-quants
Params494M
Context32K
Q4_K_M0.4 GB
Tool use
QW
knowledgator/Qwen-encoder-0.5B
Qwen · featherless-ai-quants
Params494M
Context128K
Q4_K_M0.4 GB
Coding
PL
Weyaxi/Platypus-Nebula-v2-7B
Platypus · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
LL
SakanaAI/Llama-3-8B-Instruct-OS-Expert
Llama · featherless-ai-quants
Params8.03B
Context4K
Q4_K_M4.9 GB
GGUF
LL
geonmin-kim/raft_llama3.2_1b
Llama · featherless-ai-quants
Params1.24B
Context128K
Q4_K_M0.8 GB
Tool use
DP
williamlcn/221_dpo
Dpo · featherless-ai-quants
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
HY
HyperBlaze/L3-8B-Soliloquy-v2-SpicyMaid-Lewd-Mergetest
Hyperblaze · featherless-ai-quants
Params8.03B
Context24K
Q4_K_M4.9 GB
GGUF

Keep browsing