GGUF models by featherless-ai-quants
3092 GGUF models quantized by featherless-ai-quants on Hugging Face. Sizes run from 494M to 72.7B parameters. The longest trained context is 1024K tokens.
CA
Nitral-AI/Captain-Eris_Twilight-V0.420-12B
Captain · featherless-ai-quants
Params12.2B
Context1000K
Q4_K_M7.5 GB
LL
nztinversive/llama3.2-1b-Uncensored
Llama · featherless-ai-quants
Params1.24B
Context128K
Q4_K_M0.8 GB
SA
kyujinpy/Sakura-SOLRCA-Math-Instruct-DPO-v2
Sakura · featherless-ai-quants
Params10.7B
Context4K
Q4_K_M6.5 GB
HY
theNovaAI/Hypernova-experimental
Hypernova · featherless-ai-quants
Params13B
Context4K
Q4_K_M7.9 GB
HE
Weyaxi/HelpSteer-filtered-neural-chat-7b-v3-1-7B
Helpsteer · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
DA
PocketDoc/Dans-MysteryModel-13b
Dans · featherless-ai-quants
Params13B
Context4K
Q4_K_M7.9 GB
SI
hiig-ai-lab/simba_best_092024
Simba · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
owner203/japanese-llama-3-8b-instruct-v2
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
BA
kevin009/babyllama-v0.4
Babyllama · featherless-ai-quants
Params1.1B
Context2K
Q4_K_M0.7 GB
KO
kyujinpy/Korean-OpenOrca-v3
Korean · featherless-ai-quants
Params13B
Context2K
Q4_K_M7.9 GB
MI
sarahlintang/mistral-indo-7b
Mistral · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
QW
lordjia/Qwen2-Cantonese-7B-Instruct
Qwen · featherless-ai-quants
Params7.62B
Context32K
Q4_K_M4.7 GB
LL
ajibawa-2023/Code-Llama-3-8B
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
QW
Qwen/Qwen2.5-7B-Instruct-1M
Qwen · featherless-ai-quants
Params7.62B
Context986K
Q4_K_M4.7 GB
LL
chlee10/T3Q-Llama3-8B-dpo-v2.0
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
MI
DrNicefellow/Mistral-7-from-Mixtral-8x7B-v0.1
Mistral · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.6 GB
TI
LukAss8/tinyllama-PT-v0
Tinyllama · featherless-ai-quants
Params1.1B
Context2K
Q4_K_M0.7 GB
LL
DatPySci/tiny-llama-sft
Llama · featherless-ai-quants
Params1.1B
Context2K
Q4_K_M0.7 GB
AV
jeiku/Average_Normie_l3_v1_8B
Average · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
NousResearch/Meta-Llama-3-8B-Instruct
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
MI
StatPan/mistral7b-bartending-recipe-v1
Mistral · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
NE
MarinaraSpaghetti/NemoReRemix-12B
Nemoreremix · featherless-ai-quants
Params12.2B
Context1000K
Q4_K_M7.5 GB
CH
NTQAI/chatntq-ja-7b-v1.0
Chatntq · featherless-ai-quants
Params7.24B
Context4K
Q4_K_M4.4 GB
QW
Hachipo/Qwen2.5-Coder-0.5B-Instruct_MIFT-en_manywords_4000
Qwen · featherless-ai-quants
Params494M
Context32K
Q4_K_M0.4 GB
MI
cosmicvalor/mistral-orthogonalized
Mistral · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
AL
Alphacode-AI/AlphaMist7B-slr-v1
Alphacode · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
GE
williamlcn/genmod
Genmod · featherless-ai-quants
Params2.61B
Context8K
Q4_K_M1.7 GB
LL
zgrgr/Meta-Llama-3.1-8B-Instruct
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
MI
Herry443/Mistral-7B-KNUT-ref-en
Mistral · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
QW
trollek/Qwen2.5-7B-CySecButler-v0.1
Qwen · featherless-ai-quants
Params7.62B
Context128K
Q4_K_M4.7 GB